2024-05-08T19:42:08.468 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T19:42:08.468 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} --owner scheduled_pdonnell@teuthology --verbose --name pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962 -- /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/orig.config.yaml 2024-05-08T19:42:08.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T19:42:08.628 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962 branch: wip-pdonnell-testing-20240508.150423-reef description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} email: pdonnell@redhat.com first_in_suite: false job_id: '7697962' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true name: pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20240508.150423-reef ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync rbytes: false syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240508.150423-reef sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2738 sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 sleep_before_teardown: 0 subset: 17/512 suite: fs suite_branch: wip-pdonnell-testing-20240508.150423-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKMAo1eJ4s3TMxCNTMjxM60Q+e5/VU9xTYXjC1TP2nwc5k+TgOH4aS/aAymESfhVWbXU8dvZ93ss4eJUFFJbgk= smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIhJBJjRDUk45ZZqaXooq2VvtO0DurVuM5GtoPCf2RnUGUzi+xqpPaIVxnjSv9q7Pop2k2MyJU4TmDuq5EbVR94= smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJQIKSXALva1riajJJbRm3VM2gCh+RJrAyVAUoT9o38SHL6QN3OninL/6gMdcDnp5Xa5sEleYNI755ku/GngpqA= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_19:22:21 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T19:42:08.628 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa; will attempt to use it 2024-05-08T19:42:08.629 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_d21e4f961318b56f0d915caa2490c3711bf13c34/qa/tasks 2024-05-08T19:42:08.629 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T19:42:08.634 INFO:teuthology.task.internal:Checking packages... 2024-05-08T19:42:08.666 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'd21e4f961318b56f0d915caa2490c3711bf13c34' 2024-05-08T19:42:08.666 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T19:42:08.666 INFO:teuthology.packaging:ref: None 2024-05-08T19:42:08.666 INFO:teuthology.packaging:tag: None 2024-05-08T19:42:08.666 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240508.150423-reef 2024-05-08T19:42:08.666 INFO:teuthology.packaging:sha1: d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:42:08.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240508.150423-reef 2024-05-08T19:42:08.892 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1322.gd21e4f96 2024-05-08T19:42:08.893 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T19:42:08.900 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T19:42:08.900 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T19:42:08.912 INFO:teuthology.task.internal:Saving configuration 2024-05-08T19:42:08.933 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T19:42:08.939 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T19:42:08.962 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 19:37:00.184497', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKMAo1eJ4s3TMxCNTMjxM60Q+e5/VU9xTYXjC1TP2nwc5k+TgOH4aS/aAymESfhVWbXU8dvZ93ss4eJUFFJbgk='} 2024-05-08T19:42:08.981 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 19:37:00.186110', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIhJBJjRDUk45ZZqaXooq2VvtO0DurVuM5GtoPCf2RnUGUzi+xqpPaIVxnjSv9q7Pop2k2MyJU4TmDuq5EbVR94='} 2024-05-08T19:42:09.003 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 19:37:00.187229', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJQIKSXALva1riajJJbRm3VM2gCh+RJrAyVAUoT9o38SHL6QN3OninL/6gMdcDnp5Xa5sEleYNI755ku/GngpqA='} 2024-05-08T19:42:09.003 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T19:42:09.009 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-08T19:42:09.009 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-08T19:42:09.009 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-08T19:42:09.009 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T19:42:09.118 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0c97e95160>, signals=[15]) 2024-05-08T19:42:09.118 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T19:42:09.124 INFO:teuthology.task.internal:Opening connections... 2024-05-08T19:42:09.125 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T19:42:09.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:42:09.212 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T19:42:09.213 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:42:09.285 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T19:42:09.286 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:42:09.359 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T19:42:09.366 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2024-05-08T19:42:09.388 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2024-05-08T19:42:09.389 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2024-05-08T19:42:09.450 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T19:42:09.450 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T19:42:09.450 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2024-05-08T19:42:09.450 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2024-05-08T19:42:09.450 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.6" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T19:42:09.451 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T19:42:09.452 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2024-05-08T19:42:09.477 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-05-08T19:42:09.498 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-05-08T19:42:09.498 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-05-08T19:42:09.561 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T19:42:09.561 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:ID="rhel" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="fedora" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="8.6" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el8" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:42:09.562 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T19:42:09.563 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T19:42:09.563 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T19:42:09.563 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T19:42:09.563 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-05-08T19:42:09.586 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-05-08T19:42:09.606 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-05-08T19:42:09.606 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-05-08T19:42:09.665 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2024-05-08T19:42:09.666 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T19:42:09.667 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:42:09.667 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-08T19:42:09.667 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2024-05-08T19:42:09.667 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2024-05-08T19:42:09.667 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2024-05-08T19:42:09.667 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-05-08T19:42:09.686 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T19:42:09.696 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T19:42:09.701 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T19:42:09.701 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2024-05-08T19:42:09.704 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-05-08T19:42:09.706 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-05-08T19:42:09.724 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T19:42:09.730 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T19:42:09.730 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2024-05-08T19:42:09.763 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-05-08T19:42:09.766 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-05-08T19:42:09.794 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T19:42:09.866 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T19:42:09.880 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-08T19:42:09.880 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-05-08T19:42:09.880 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-05-08T19:42:09.880 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T19:42:09.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:42:09.901 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2024-05-08T19:42:09.962 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:42:09.962 INFO:teuthology.task.kernel:Running kernel on smithi033: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:42:09.963 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2024-05-08T19:42:11.644 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2024-05-08T19:42:11.644 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2024-05-08T19:42:11.769 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:42:11.769 INFO:teuthology.orchestra.run.smithi033.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:42:11.770 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:42:13.691 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-05-08T19:42:15.436 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 16 MB 00:01 2024-05-08T19:42:19.558 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 351 kB/s | 24 kB 00:00 2024-05-08T19:42:20.437 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-513.9.1.el8_9.x86_64 is already installed. 2024-05-08T19:42:20.437 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2024-05-08T19:42:20.526 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-05-08T19:42:20.527 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2024-05-08T19:42:20.527 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-05-08T19:42:20.689 DEBUG:teuthology.orchestra.run.smithi033:> echo no | sudo yum reinstall kernel || true 2024-05-08T19:42:21.078 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2024-05-08T19:42:21.078 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2024-05-08T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:42:21.138 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:42:21.498 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:02 ago on Wed 08 May 2024 07:42:19 PM UTC. 2024-05-08T19:42:21.585 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T19:42:21.593 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T19:42:21.633 INFO:teuthology.orchestra.run.smithi033.stderr:Error: No packages marked for reinstall. 2024-05-08T19:42:21.689 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum reinstall -y kernel || true 2024-05-08T19:42:22.073 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2024-05-08T19:42:22.073 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2024-05-08T19:42:22.188 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:42:22.188 INFO:teuthology.orchestra.run.smithi033.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2024-05-08T19:42:22.188 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:42:22.538 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:03 ago on Wed 08 May 2024 07:42:19 PM UTC. 2024-05-08T19:42:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-513.9.1.el8_9.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2024-05-08T19:42:22.609 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2024-05-08T19:42:22.643 INFO:teuthology.orchestra.run.smithi033.stderr:Error: No packages marked for reinstall. 2024-05-08T19:42:22.699 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T19:42:22.866 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:42:22.867 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-513.9.1.el8_9.x86_64 2024-05-08T19:42:22.867 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-05-08T19:42:22.867 DEBUG:teuthology.parallel:result is None 2024-05-08T19:42:22.867 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T19:42:22.874 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T19:42:22.874 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T19:42:22.876 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T19:42:22.879 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T19:42:22.900 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T19:42:22.907 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T19:42:22.919 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T19:42:22.919 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T19:42:22.936 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T19:42:22.939 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T19:42:22.977 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T19:42:22.984 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T19:42:22.984 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T19:42:23.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:42:23.025 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T19:42:23.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:42:23.044 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T19:42:23.046 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T19:42:23.067 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T19:42:23.085 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:23.104 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:23.108 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:23.121 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:23.122 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:23.145 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T19:42:23.147 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T19:42:23.154 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T19:42:23.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T19:42:23.157 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T19:42:23.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T19:42:23.217 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T19:42:23.240 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T19:42:23.240 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T19:42:23.242 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T19:42:23.245 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T19:42:23.276 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:42:23.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:42:23.416 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:42:23.463 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:42:23.513 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:42:23.513 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T19:42:23.587 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:42:23.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:42:23.690 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:42:23.776 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:42:23.822 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:42:23.823 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T19:42:23.892 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:42:23.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T19:42:23.994 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:42:24.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T19:42:24.128 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:42:24.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T19:42:24.199 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2024-05-08T19:42:24.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-05-08T19:42:24.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-05-08T19:42:24.260 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T19:42:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T19:42:24.328 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T19:42:24.640 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T19:42:24.646 INFO:teuthology.task.internal:Starting timer... 2024-05-08T19:42:24.646 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T19:42:24.656 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T19:42:24.665 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2024-05-08T19:42:24.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2024-05-08T19:42:24.757 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: 2024-05-08T19:42:24.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-05-08T19:42:24.818 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-05-08T19:42:24.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-05-08T19:42:24.882 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-05-08T19:42:24.884 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T19:42:24.884 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2024-05-08T19:42:24.908 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2024-05-08T19:42:24.908 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-05-08T19:42:24.937 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-05-08T19:42:24.937 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-05-08T19:42:24.965 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-05-08T19:42:24.965 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive'} 2024-05-08T19:42:24.965 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T19:42:24.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:42:24.997 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T19:42:25.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:42:25.026 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T19:42:25.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T19:42:25.054 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T19:42:25.054 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2024-05-08T19:42:25.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-05-08T19:42:25.111 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-05-08T19:42:25.138 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T19:42:25.148 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T19:42:25.152 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T19:42:25.299 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T19:42:25.315 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T19:42:25.316 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi082.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T19:52:26.470 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2024-05-08T19:52:26.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T19:52:26.473 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:52:26.554 DEBUG:teuthology.orchestra.run.smithi033:> true 2024-05-08T19:52:26.627 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2024-05-08T19:52:26.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T19:52:26.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:52:26.702 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-08T19:52:26.767 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T19:52:26.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-05-08T19:52:26.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T19:52:26.842 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-05-08T19:52:26.913 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-05-08T19:52:26.914 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T19:52:26.924 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T19:52:26.924 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T19:52:26.925 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T19:52:26.927 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T19:52:26.927 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T19:52:26.929 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T19:52:26.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T19:52:26.962 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T19:52:26.966 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T19:52:26.974 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T19:52:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T19:52:26.988 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T19:52:27.004 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T19:52:27.040 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-05-08T19:52:27.052 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-05-08T19:52:27.067 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T19:52:27.068 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2024-05-08T19:52:27.081 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T19:52:27.082 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2024-05-08T19:52:27.089 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-05-08T19:52:27.099 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T19:52:27.101 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-05-08T19:52:27.116 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T19:52:27.116 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T19:52:27.130 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T19:52:27.144 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2024-05-08T19:52:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T19:52:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-08T19:52:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.149 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.189 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2024-05-08T19:52:27.192 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T19:52:27.193 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-05-08T19:52:27.193 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.193 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.193 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.193 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.201 INFO:teuthology.orchestra.run.smithi132.stderr:bash: ntpq: command not found 2024-05-08T19:52:27.204 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T19:52:27.204 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-05-08T19:52:27.204 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.204 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.204 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.204 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T19:52:27.205 INFO:teuthology.run_tasks:Running task pexec... 2024-05-08T19:52:27.215 INFO:teuthology.task.pexec:Executing custom commands... 2024-05-08T19:52:27.216 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T19:52:27.216 DEBUG:teuthology.orchestra.run.smithi033:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T19:52:27.216 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T19:52:27.216 DEBUG:teuthology.orchestra.run.smithi082:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T19:52:27.217 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T19:52:27.217 DEBUG:teuthology.orchestra.run.smithi132:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-05-08T19:52:27.592 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2024-05-08T19:52:27.621 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2024-05-08T19:52:27.668 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2024-05-08T19:52:29.612 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 kB/s | 4.1 kB 00:00 2024-05-08T19:52:29.649 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 kB/s | 4.1 kB 00:00 2024-05-08T19:52:29.720 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 19 kB/s | 4.1 kB 00:00 2024-05-08T19:52:29.918 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 kB/s | 4.5 kB 00:00 2024-05-08T19:52:30.031 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 28 kB/s | 4.5 kB 00:00 2024-05-08T19:52:30.109 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 31 kB/s | 4.5 kB 00:00 2024-05-08T19:52:33.075 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-08T19:52:33.076 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout: Package Architecture Version Repository Size 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout:Resetting modules: 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout:================================================================================ 2024-05-08T19:52:33.077 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:52:33.206 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout:Resetting modules: 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: container-tools 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-05-08T19:52:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:52:33.608 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: Package Architecture Version Repository Size 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout:Resetting modules: 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout:================================================================================ 2024-05-08T19:52:33.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:52:41.357 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-08T19:52:41.834 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2024-05-08T19:52:42.480 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T19:52:42.999 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2024-05-08T19:52:43.410 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 35 kB/s | 4.1 kB 00:00 2024-05-08T19:52:43.722 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 kB/s | 4.5 kB 00:00 2024-05-08T19:52:44.871 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 27 kB/s | 4.1 kB 00:00 2024-05-08T19:52:45.202 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 kB/s | 4.5 kB 00:00 2024-05-08T19:52:46.066 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-05-08T19:52:46.583 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2024-05-08T19:52:46.811 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-08T19:52:46.973 INFO:teuthology.orchestra.run.smithi082.stdout:========================================================================================================== 2024-05-08T19:52:46.973 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-05-08T19:52:46.973 INFO:teuthology.orchestra.run.smithi082.stdout:========================================================================================================== 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout:Installing group/module packages: 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T19:52:46.974 INFO:teuthology.orchestra.run.smithi082.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout:Installing module profiles: 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools/common 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling module streams: 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout: container-tools rhel8 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout:========================================================================================================== 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout:Install 13 Packages 2024-05-08T19:52:46.975 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:52:46.976 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 26 M 2024-05-08T19:52:46.976 INFO:teuthology.orchestra.run.smithi082.stdout:Installed size: 87 M 2024-05-08T19:52:46.976 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-08T19:52:47.252 INFO:teuthology.orchestra.run.smithi082.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 143 kB/s | 39 kB 00:00 2024-05-08T19:52:47.277 INFO:teuthology.orchestra.run.smithi082.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 312 kB/s | 94 kB 00:00 2024-05-08T19:52:47.334 INFO:teuthology.orchestra.run.smithi082.stdout:(3/13): python3-pytoml-0.1.14-5.git7dea353.el8. 69 kB/s | 25 kB 00:00 2024-05-08T19:52:47.569 INFO:teuthology.orchestra.run.smithi082.stdout:(4/13): buildah-1.31.5-1.module+el8.9.0+21697+6 38 MB/s | 8.8 MB 00:00 2024-05-08T19:52:47.586 INFO:teuthology.orchestra.run.smithi082.stdout:(5/13): yajl-2.1.0-12.el8.x86_64.rpm 123 kB/s | 41 kB 00:00 2024-05-08T19:52:47.620 INFO:teuthology.orchestra.run.smithi082.stdout:(6/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 2.9 MB/s | 1.0 MB 00:00 2024-05-08T19:52:47.787 INFO:teuthology.orchestra.run.smithi082.stdout:(7/13): cockpit-podman-75-1.module+el8.9.0+2169 3.3 MB/s | 739 kB 00:00 2024-05-08T19:52:47.853 INFO:teuthology.orchestra.run.smithi082.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 896 kB/s | 239 kB 00:00 2024-05-08T19:52:47.979 INFO:teuthology.orchestra.run.smithi082.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 10 MB/s | 3.7 MB 00:00 2024-05-08T19:52:48.005 INFO:teuthology.orchestra.run.smithi082.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 706 kB/s | 154 kB 00:00 2024-05-08T19:52:48.188 INFO:teuthology.orchestra.run.smithi082.stdout:(11/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 24 MB/s | 8.1 MB 00:00 2024-05-08T19:52:48.246 INFO:teuthology.orchestra.run.smithi082.stdout:(12/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 9.5 MB/s | 2.5 MB 00:00 2024-05-08T19:52:48.271 INFO:teuthology.orchestra.run.smithi082.stdout:(13/13): udica-0.2.6-20.module+el8.9.0+21697+6a 185 kB/s | 49 kB 00:00 2024-05-08T19:52:48.272 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:52:48.272 INFO:teuthology.orchestra.run.smithi082.stdout:Total 20 MB/s | 26 MB 00:01 2024-05-08T19:52:48.314 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T19:52:48.484 INFO:teuthology.orchestra.run.smithi132.stdout:========================================================================================================== 2024-05-08T19:52:48.484 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T19:52:48.484 INFO:teuthology.orchestra.run.smithi132.stdout:========================================================================================================== 2024-05-08T19:52:48.484 INFO:teuthology.orchestra.run.smithi132.stdout:Installing group/module packages: 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-05-08T19:52:48.485 INFO:teuthology.orchestra.run.smithi132.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout:Installing module profiles: 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout: container-tools/common 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout:Enabling module streams: 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout: container-tools rhel8 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout:========================================================================================================== 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout:Install 13 Packages 2024-05-08T19:52:48.486 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:52:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 26 M 2024-05-08T19:52:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 87 M 2024-05-08T19:52:48.490 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T19:52:48.552 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-08T19:52:48.573 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-08T19:52:48.573 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-08T19:52:48.644 INFO:teuthology.orchestra.run.smithi132.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 599 kB/s | 94 kB 00:00 2024-05-08T19:52:48.653 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 kB/s | 4.1 kB 00:00 2024-05-08T19:52:48.661 INFO:teuthology.orchestra.run.smithi132.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 143 kB/s | 25 kB 00:00 2024-05-08T19:52:48.678 INFO:teuthology.orchestra.run.smithi132.stdout:(3/13): criu-libs-3.18-4.module+el8.9.0+20326+3 206 kB/s | 39 kB 00:00 2024-05-08T19:52:48.737 INFO:teuthology.orchestra.run.smithi132.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 444 kB/s | 41 kB 00:00 2024-05-08T19:52:48.801 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-08T19:52:48.810 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-08T19:52:48.820 INFO:teuthology.orchestra.run.smithi132.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 6.3 MB/s | 1.0 MB 00:00 2024-05-08T19:52:48.871 INFO:teuthology.orchestra.run.smithi132.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 5.4 MB/s | 739 kB 00:00 2024-05-08T19:52:49.046 INFO:teuthology.orchestra.run.smithi132.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 24 MB/s | 8.8 MB 00:00 2024-05-08T19:52:49.071 INFO:teuthology.orchestra.run.smithi132.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 955 kB/s | 239 kB 00:00 2024-05-08T19:52:49.097 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 22 kB/s | 4.5 kB 00:00 2024-05-08T19:52:49.155 INFO:teuthology.orchestra.run.smithi132.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 13 MB/s | 3.7 MB 00:00 2024-05-08T19:52:49.180 INFO:teuthology.orchestra.run.smithi132.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 1.1 MB/s | 154 kB 00:00 2024-05-08T19:52:49.297 INFO:teuthology.orchestra.run.smithi132.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 18 MB/s | 2.5 MB 00:00 2024-05-08T19:52:49.414 INFO:teuthology.orchestra.run.smithi132.stdout:(12/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 24 MB/s | 8.1 MB 00:00 2024-05-08T19:52:49.439 INFO:teuthology.orchestra.run.smithi132.stdout:(13/13): udica-0.2.6-20.module+el8.9.0+21697+6a 191 kB/s | 49 kB 00:00 2024-05-08T19:52:49.440 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:52:49.440 INFO:teuthology.orchestra.run.smithi132.stdout:Total 27 MB/s | 26 MB 00:00 2024-05-08T19:52:49.553 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-08T19:52:49.721 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T19:52:49.743 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T19:52:49.743 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T19:52:49.972 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T19:52:49.980 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T19:52:50.095 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T19:52:50.287 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T19:52:50.486 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T19:52:50.662 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T19:52:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T19:52:50.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T19:52:51.033 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T19:52:51.245 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T19:52:51.294 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T19:52:51.440 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T19:52:51.602 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T19:52:51.795 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T19:52:51.949 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T19:52:52.142 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T19:52:52.180 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T19:52:52.385 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T19:52:52.409 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T19:52:52.519 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-05-08T19:52:52.703 INFO:teuthology.orchestra.run.smithi033.stdout:========================================================================================================== 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout:========================================================================================================== 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout:Installing group/module packages: 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 1.0 M 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout: buildah x86_64 1:1.31.5-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.8 M 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout: cockpit-podman noarch 75-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 739 k 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout: crun x86_64 1.8.7-1.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 239 k 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout: netavark x86_64 2:1.7.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:52:52.704 INFO:teuthology.orchestra.run.smithi033.stdout: python3-podman noarch 4.6.0-2.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 154 k 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: skopeo x86_64 2:1.13.3-3.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 8.1 M 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 2.5 M 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: udica noarch 0.2.6-20.module+el8.9.0+21697+6a5e98e7 rhel-8-for-x86_64-appstream-rpms 49 k 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout:Installing weak dependencies: 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout:Installing module profiles: 2024-05-08T19:52:52.705 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools/common 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling module streams: 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout: container-tools rhel8 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout:========================================================================================================== 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout:Install 13 Packages 2024-05-08T19:52:52.706 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:52:52.707 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 26 M 2024-05-08T19:52:52.707 INFO:teuthology.orchestra.run.smithi033.stdout:Installed size: 87 M 2024-05-08T19:52:52.707 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-05-08T19:52:52.818 INFO:teuthology.orchestra.run.smithi033.stdout:(1/13): criu-libs-3.18-4.module+el8.9.0+20326+3 356 kB/s | 39 kB 00:00 2024-05-08T19:52:52.819 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T19:52:52.851 INFO:teuthology.orchestra.run.smithi033.stdout:(2/13): python3-pyxdg-0.25-16.el8.noarch.rpm 651 kB/s | 94 kB 00:00 2024-05-08T19:52:52.877 INFO:teuthology.orchestra.run.smithi033.stdout:(3/13): python3-pytoml-0.1.14-5.git7dea353.el8. 146 kB/s | 25 kB 00:00 2024-05-08T19:52:52.936 INFO:teuthology.orchestra.run.smithi033.stdout:(4/13): yajl-2.1.0-12.el8.x86_64.rpm 348 kB/s | 41 kB 00:00 2024-05-08T19:52:53.062 INFO:teuthology.orchestra.run.smithi033.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+216 4.8 MB/s | 1.0 MB 00:00 2024-05-08T19:52:53.153 INFO:teuthology.orchestra.run.smithi033.stdout:(6/13): cockpit-podman-75-1.module+el8.9.0+2169 3.3 MB/s | 739 kB 00:00 2024-05-08T19:52:53.254 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T19:52:53.303 INFO:teuthology.orchestra.run.smithi033.stdout:(7/13): buildah-1.31.5-1.module+el8.9.0+21697+6 21 MB/s | 8.8 MB 00:00 2024-05-08T19:52:53.320 INFO:teuthology.orchestra.run.smithi033.stdout:(8/13): crun-1.8.7-1.module+el8.9.0+21697+6a5e9 929 kB/s | 239 kB 00:00 2024-05-08T19:52:53.479 INFO:teuthology.orchestra.run.smithi033.stdout:(9/13): netavark-1.7.0-2.module+el8.9.0+21697+6 11 MB/s | 3.7 MB 00:00 2024-05-08T19:52:53.486 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T19:52:53.504 INFO:teuthology.orchestra.run.smithi033.stdout:(10/13): python3-podman-4.6.0-2.module+el8.9.0+ 766 kB/s | 154 kB 00:00 2024-05-08T19:52:53.604 INFO:teuthology.orchestra.run.smithi033.stdout:(11/13): udica-0.2.6-20.module+el8.9.0+21697+6a 495 kB/s | 49 kB 00:00 2024-05-08T19:52:53.703 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T19:52:53.737 INFO:teuthology.orchestra.run.smithi033.stdout:(12/13): skopeo-1.13.3-3.module+el8.9.0+21697+6 20 MB/s | 8.1 MB 00:00 2024-05-08T19:52:53.797 INFO:teuthology.orchestra.run.smithi033.stdout:(13/13): toolbox-0.0.99.4-5.module+el8.9.0+2169 8.0 MB/s | 2.5 MB 00:00 2024-05-08T19:52:53.798 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:52:53.798 INFO:teuthology.orchestra.run.smithi033.stdout:Total 23 MB/s | 26 MB 00:01 2024-05-08T19:52:53.902 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T19:52:53.914 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T19:52:54.089 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T19:52:54.106 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-05-08T19:52:54.130 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-05-08T19:52:54.130 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-05-08T19:52:54.384 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-05-08T19:52:54.394 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-05-08T19:52:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T19:52:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T19:52:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T19:52:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T19:52:54.507 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T19:52:54.508 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T19:52:54.793 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T19:52:55.047 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T19:52:55.209 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-05-08T19:52:55.239 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T19:52:55.642 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T19:52:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T19:52:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T19:52:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T19:52:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T19:52:55.643 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T19:52:55.738 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 1/13 2024-05-08T19:52:55.935 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 2/13 2024-05-08T19:52:56.069 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : yajl-2.1.0-12.el8.x86_64 3/13 2024-05-08T19:52:56.274 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 4/13 2024-05-08T19:52:56.458 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2024-05-08T19:52:56.684 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2024-05-08T19:52:56.920 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 7/13 2024-05-08T19:52:57.877 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T19:52:58.133 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T19:52:58.568 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 10/13 2024-05-08T19:52:59.563 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 11/13 2024-05-08T19:52:59.777 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 12/13 2024-05-08T19:52:59.972 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T19:53:00.459 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 13/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 3/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 4/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98 5/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x 6/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7. 7/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 8/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x 9/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98 10/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x8 11/13 2024-05-08T19:53:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x 12/13 2024-05-08T19:53:04.186 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T19:53:04.187 INFO:teuthology.orchestra.run.smithi132.stdout:Installed products updated. 2024-05-08T19:53:04.736 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:53:04.736 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T19:53:04.736 INFO:teuthology.orchestra.run.smithi132.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:04.736 INFO:teuthology.orchestra.run.smithi132.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:53:04.737 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T19:53:04.907 DEBUG:teuthology.parallel:result is None 2024-05-08T19:53:05.370 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T19:53:05.370 INFO:teuthology.orchestra.run.smithi082.stdout:Installed products updated. 2024-05-08T19:53:05.917 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:05.918 INFO:teuthology.orchestra.run.smithi082.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T19:53:05.919 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:53:05.919 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-08T19:53:06.084 DEBUG:teuthology.parallel:result is None 2024-05-08T19:53:09.771 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarc 13/13 2024-05-08T19:53:09.772 INFO:teuthology.orchestra.run.smithi033.stdout:Installed products updated. 2024-05-08T19:53:10.390 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:53:10.390 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-05-08T19:53:10.390 INFO:teuthology.orchestra.run.smithi033.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:10.390 INFO:teuthology.orchestra.run.smithi033.stdout: buildah-1:1.31.5-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:10.390 INFO:teuthology.orchestra.run.smithi033.stdout: cockpit-podman-75-1.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:10.390 INFO:teuthology.orchestra.run.smithi033.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: crun-1.8.7-1.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: netavark-2:1.7.0-2.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: python3-podman-4.6.0-2.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: skopeo-2:1.13.3-3.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: toolbox-0.0.99.4-5.module+el8.9.0+21697+6a5e98e7.x86_64 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: udica-0.2.6-20.module+el8.9.0+21697+6a5e98e7.noarch 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: yajl-2.1.0-12.el8.x86_64 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:53:10.391 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-05-08T19:53:10.605 DEBUG:teuthology.parallel:result is None 2024-05-08T19:53:10.605 INFO:teuthology.run_tasks:Running task install... 2024-05-08T19:53:10.619 DEBUG:teuthology.task.install:project ceph 2024-05-08T19:53:10.619 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'}} 2024-05-08T19:53:10.620 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34'} 2024-05-08T19:53:10.620 INFO:teuthology.task.install:Using flavor: default 2024-05-08T19:53:10.633 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T19:53:10.633 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T19:53:10.634 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T19:53:10.634 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:53:10.636 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T19:53:10.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:53:10.638 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'tag': None, 'wait_for_package': False} 2024-05-08T19:53:10.638 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:53:10.788 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T19:53:10.788 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T19:53:10.796 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T19:53:10.797 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T19:53:10.861 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/ 2024-05-08T19:53:10.861 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1322.gd21e4f96 2024-05-08T19:53:11.105 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T19:53:11.105 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:53:11.105 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T19:53:11.116 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T19:53:11.116 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:53:11.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T19:53:11.139 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T19:53:11.140 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T19:53:11.152 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T19:53:11.152 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T19:53:11.213 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T19:53:11.225 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T19:53:11.233 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T19:53:11.233 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:53:11.233 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T19:53:11.269 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T19:53:11.269 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d21e4f961318b56f0d915caa2490c3711bf13c34/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T19:53:11.294 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T19:53:11.309 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T19:53:11.345 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T19:53:11.362 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-05-08T19:53:11.364 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-05-08T19:53:11.379 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-05-08T19:53:11.380 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-05-08T19:53:11.435 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T19:53:11.468 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2024-05-08T19:53:11.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2024-05-08T19:53:11.747 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2024-05-08T19:53:11.762 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2024-05-08T19:53:11.906 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2024-05-08T19:53:12.918 INFO:teuthology.orchestra.run.smithi132.stdout:63 files removed 2024-05-08T19:53:12.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T19:53:13.103 INFO:teuthology.orchestra.run.smithi082.stdout:63 files removed 2024-05-08T19:53:13.161 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T19:53:13.258 INFO:teuthology.orchestra.run.smithi033.stdout:63 files removed 2024-05-08T19:53:13.306 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2024-05-08T19:53:13.317 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T19:53:13.496 INFO:teuthology.orchestra.run.smithi082.stdout:Updating Subscription Management repositories. 2024-05-08T19:53:13.705 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2024-05-08T19:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 91 kB/s | 80 kB 00:00 2024-05-08T19:53:15.758 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 93 kB/s | 80 kB 00:00 2024-05-08T19:53:15.878 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 98 kB/s | 80 kB 00:00 2024-05-08T19:53:16.322 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 20 kB/s | 11 kB 00:00 2024-05-08T19:53:16.433 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 18 kB/s | 11 kB 00:00 2024-05-08T19:53:16.570 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-05-08T19:53:16.972 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 2.4 kB/s | 1.5 kB 00:00 2024-05-08T19:53:17.148 INFO:teuthology.orchestra.run.smithi132.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-05-08T19:53:17.287 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2024-05-08T19:53:17.454 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-05-08T19:53:17.907 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2024-05-08T19:53:18.980 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-05-08T19:53:20.275 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 401 B/s | 1.5 kB 00:03 2024-05-08T19:53:20.459 INFO:teuthology.orchestra.run.smithi082.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-05-08T19:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 243 kB/s | 24 kB 00:00 2024-05-08T19:53:22.295 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 16 MB 00:01 2024-05-08T19:53:23.013 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 423 kB/s | 24 kB 00:00 2024-05-08T19:53:23.168 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 67 MB 00:01 2024-05-08T19:53:23.757 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-05-08T19:53:25.909 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 424 kB/s | 24 kB 00:00 2024-05-08T19:53:26.653 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2024-05-08T19:53:26.972 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 46 MB/s | 67 MB 00:01 2024-05-08T19:53:29.446 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 52 MB/s | 67 MB 00:01 2024-05-08T19:53:33.944 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 50 MB/s | 61 MB 00:01 2024-05-08T19:53:39.309 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 MB/s | 61 MB 00:01 2024-05-08T19:53:40.520 INFO:teuthology.orchestra.run.smithi082.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 61 MB 00:01 2024-05-08T19:53:44.852 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2024-05-08T19:53:52.077 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:53:52.078 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:53:52.097 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T19:53:52.098 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T19:53:52.100 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T19:53:52.102 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T19:53:52.105 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T19:53:52.109 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T19:53:52.111 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T19:53:52.334 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-05-08T19:53:52.348 INFO:teuthology.orchestra.run.smithi132.stdout:=================================================================================================================================== 2024-05-08T19:53:52.348 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout:=================================================================================================================================== 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T19:53:52.349 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T19:53:52.350 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T19:53:52.351 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T19:53:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T19:53:52.353 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T19:53:52.354 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T19:53:52.355 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T19:53:52.356 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T19:53:52.357 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:53:52.358 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T19:53:52.359 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T19:53:52.360 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout:Enabling module streams: 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql 10 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout:=================================================================================================================================== 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout:Install 130 Packages 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 16 Packages 2024-05-08T19:53:52.361 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:53:52.362 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 215 M 2024-05-08T19:53:52.362 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-05-08T19:53:53.011 INFO:teuthology.orchestra.run.smithi132.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 21 kB/s | 6.4 kB 00:00 2024-05-08T19:53:53.736 INFO:teuthology.orchestra.run.smithi132.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.2 MB/s | 860 kB 00:00 2024-05-08T19:53:53.895 INFO:teuthology.orchestra.run.smithi132.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 1.0 MB/s | 166 kB 00:00 2024-05-08T19:53:55.195 INFO:teuthology.orchestra.run.smithi132.stdout:(4/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.7 MB/s | 2.3 MB 00:01 2024-05-08T19:53:55.754 INFO:teuthology.orchestra.run.smithi132.stdout:(5/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 1.8 MB/s | 5.5 MB 00:03 2024-05-08T19:53:56.004 INFO:teuthology.orchestra.run.smithi132.stdout:(6/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 1.9 MB/s | 1.6 MB 00:00 2024-05-08T19:53:56.075 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:53:56.076 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:53:56.095 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T19:53:56.097 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T19:53:56.098 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T19:53:56.100 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T19:53:56.102 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T19:53:56.107 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T19:53:56.108 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T19:53:56.326 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout:=================================================================================================================================== 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout:=================================================================================================================================== 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T19:53:56.340 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T19:53:56.341 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T19:53:56.342 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T19:53:56.343 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T19:53:56.344 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T19:53:56.345 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T19:53:56.346 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T19:53:56.347 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T19:53:56.348 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T19:53:56.349 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T19:53:56.350 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling module streams: 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql 10 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout:=================================================================================================================================== 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout:Install 130 Packages 2024-05-08T19:53:56.351 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 16 Packages 2024-05-08T19:53:56.352 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:53:56.352 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 215 M 2024-05-08T19:53:56.352 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-08T19:53:57.052 INFO:teuthology.orchestra.run.smithi082.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2024-05-08T19:53:57.077 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:53:57.079 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-08T19:53:57.099 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2024-05-08T19:53:57.101 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2024-05-08T19:53:57.102 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2024-05-08T19:53:57.104 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-08T19:53:57.107 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-08T19:53:57.112 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-08T19:53:57.113 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-08T19:53:57.271 INFO:teuthology.orchestra.run.smithi132.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 3.2 MB/s | 4.8 MB 00:01 2024-05-08T19:53:57.371 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2024-05-08T19:53:57.387 INFO:teuthology.orchestra.run.smithi033.stdout:=================================================================================================================================== 2024-05-08T19:53:57.387 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2024-05-08T19:53:57.387 INFO:teuthology.orchestra.run.smithi033.stdout:=================================================================================================================================== 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-15.el8_9 rhel-8-for-x86_64-baseos-rpms 144 k 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.4 k 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 5.5 M 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 860 k 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 166 k 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 1.6 M 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 138 k 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 3.5 M 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 7.4 M 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 49 k 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 13 M 2024-05-08T19:53:57.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 47 M 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 263 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 170 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 261 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 18 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 31 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 782 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 139 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 100 k 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 2.3 M 2024-05-08T19:53:57.389 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 1.5 M 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 812 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server x86_64 10.23-4.module+el8.9.0+21317+d2c6bf8a rhel-8-for-x86_64-appstream-rpms 5.1 M 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 197 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 370 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 365 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 107 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 95 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.5 M 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 181 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2024-05-08T19:53:57.390 INFO:teuthology.orchestra.run.smithi033.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: libblkid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 221 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: libfdisk x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 254 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: libmount x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 237 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.7 M 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 3.6 M 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: libsmartcols x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 180 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 99 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: openssl x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 711 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs x86_64 1:1.1.1k-12.el8_9 rhel-8-for-x86_64-baseos-rpms 1.5 M 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: util-linux x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 2.5 M 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: util-linux-user x86_64 2.32.1-44.el8_9.1 rhel-8-for-x86_64-baseos-rpms 103 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: xfsdump x86_64 3.1.8-7.el8_9 rhel-8-for-x86_64-baseos-rpms 333 k 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2024-05-08T19:53:57.391 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 22 M 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 24 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 2.3 M 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 245 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 4.8 M 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 18 M 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1322.gd21e4f96.el8 ceph-noarch 16 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 24 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2024-05-08T19:53:57.392 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 142 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.9.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 47 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 474 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 6.5 M 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-08T19:53:57.393 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma x86_64 6.8.2-2.1.el8_9 rhel-8-for-x86_64-appstream-rpms 188 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-08T19:53:57.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 45 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:18.2.2-1322.gd21e4f96.el8 ceph 129 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography x86_64 3.2.1-7.el8_9 rhel-8-for-x86_64-baseos-rpms 559 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:53:57.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging noarch 16.8-9.el8 codeready-builder-for-rhel-8-x86_64-rpms 48 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2024-05-08T19:53:57.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-08T19:53:57.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling module streams: 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql 10 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:53:57.398 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2024-05-08T19:53:57.399 INFO:teuthology.orchestra.run.smithi033.stdout:=================================================================================================================================== 2024-05-08T19:53:57.399 INFO:teuthology.orchestra.run.smithi033.stdout:Install 130 Packages 2024-05-08T19:53:57.399 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 16 Packages 2024-05-08T19:53:57.399 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:53:57.399 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 215 M 2024-05-08T19:53:57.399 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2024-05-08T19:53:57.760 INFO:teuthology.orchestra.run.smithi082.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.2 MB/s | 860 kB 00:00 2024-05-08T19:53:57.845 INFO:teuthology.orchestra.run.smithi033.stdout:(1/146): ceph-18.2.2-1322.gd21e4f96.el8.x86_64. 16 kB/s | 6.4 kB 00:00 2024-05-08T19:53:57.869 INFO:teuthology.orchestra.run.smithi082.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 1.5 MB/s | 166 kB 00:00 2024-05-08T19:53:58.727 INFO:teuthology.orchestra.run.smithi082.stdout:(4/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 2.7 MB/s | 5.5 MB 00:02 2024-05-08T19:53:59.044 INFO:teuthology.orchestra.run.smithi082.stdout:(5/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.9 MB/s | 2.3 MB 00:01 2024-05-08T19:53:59.050 INFO:teuthology.orchestra.run.smithi033.stdout:(2/146): ceph-fuse-18.2.2-1322.gd21e4f96.el8.x8 714 kB/s | 860 kB 00:01 2024-05-08T19:53:59.266 INFO:teuthology.orchestra.run.smithi033.stdout:(3/146): ceph-immutable-object-cache-18.2.2-132 766 kB/s | 166 kB 00:00 2024-05-08T19:53:59.294 INFO:teuthology.orchestra.run.smithi082.stdout:(6/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 2.8 MB/s | 1.6 MB 00:00 2024-05-08T19:53:59.392 INFO:teuthology.orchestra.run.smithi033.stdout:(4/146): ceph-base-18.2.2-1322.gd21e4f96.el8.x8 2.8 MB/s | 5.5 MB 00:01 2024-05-08T19:53:59.809 INFO:teuthology.orchestra.run.smithi033.stdout:(5/146): ceph-mgr-18.2.2-1322.gd21e4f96.el8.x86 3.7 MB/s | 1.6 MB 00:00 2024-05-08T19:54:00.693 INFO:teuthology.orchestra.run.smithi033.stdout:(6/146): ceph-mds-18.2.2-1322.gd21e4f96.el8.x86 1.6 MB/s | 2.3 MB 00:01 2024-05-08T19:54:00.951 INFO:teuthology.orchestra.run.smithi033.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 4.2 MB/s | 4.8 MB 00:01 2024-05-08T19:54:01.419 INFO:teuthology.orchestra.run.smithi082.stdout:(7/146): ceph-mon-18.2.2-1322.gd21e4f96.el8.x86 2.0 MB/s | 4.8 MB 00:02 2024-05-08T19:54:05.228 INFO:teuthology.orchestra.run.smithi082.stdout:(8/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x86 3.1 MB/s | 18 MB 00:05 2024-05-08T19:54:05.294 INFO:teuthology.orchestra.run.smithi082.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 367 kB/s | 24 kB 00:00 2024-05-08T19:54:05.342 INFO:teuthology.orchestra.run.smithi033.stdout:(8/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el8 3.0 MB/s | 13 MB 00:04 2024-05-08T19:54:05.370 INFO:teuthology.orchestra.run.smithi132.stdout:(8/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el8 1.6 MB/s | 13 MB 00:08 2024-05-08T19:54:05.426 INFO:teuthology.orchestra.run.smithi033.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 293 kB/s | 24 kB 00:00 2024-05-08T19:54:05.470 INFO:teuthology.orchestra.run.smithi132.stdout:(9/146): ceph-selinux-18.2.2-1322.gd21e4f96.el8 243 kB/s | 24 kB 00:00 2024-05-08T19:54:06.651 INFO:teuthology.orchestra.run.smithi033.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 3.1 MB/s | 18 MB 00:05 2024-05-08T19:54:06.860 INFO:teuthology.orchestra.run.smithi033.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.2 MB/s | 261 kB 00:00 2024-05-08T19:54:06.977 INFO:teuthology.orchestra.run.smithi033.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 266 kB/s | 31 kB 00:00 2024-05-08T19:54:07.402 INFO:teuthology.orchestra.run.smithi033.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 1.8 MB/s | 782 kB 00:00 2024-05-08T19:54:07.521 INFO:teuthology.orchestra.run.smithi132.stdout:(10/146): ceph-osd-18.2.2-1322.gd21e4f96.el8.x8 1.6 MB/s | 18 MB 00:11 2024-05-08T19:54:07.535 INFO:teuthology.orchestra.run.smithi033.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.0 MB/s | 142 kB 00:00 2024-05-08T19:54:07.661 INFO:teuthology.orchestra.run.smithi033.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.1 MB/s | 139 kB 00:00 2024-05-08T19:54:07.721 INFO:teuthology.orchestra.run.smithi132.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 1.3 MB/s | 261 kB 00:00 2024-05-08T19:54:07.796 INFO:teuthology.orchestra.run.smithi132.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 412 kB/s | 31 kB 00:00 2024-05-08T19:54:07.869 INFO:teuthology.orchestra.run.smithi033.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 2.2 MB/s | 474 kB 00:00 2024-05-08T19:54:08.052 INFO:teuthology.orchestra.run.smithi082.stdout:(10/146): ceph-common-18.2.2-1322.gd21e4f96.el8 1.9 MB/s | 22 MB 00:11 2024-05-08T19:54:08.271 INFO:teuthology.orchestra.run.smithi132.stdout:(13/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 1.6 MB/s | 782 kB 00:00 2024-05-08T19:54:08.360 INFO:teuthology.orchestra.run.smithi082.stdout:(11/146): cephfs-mirror-18.2.2-1322.gd21e4f96.e 848 kB/s | 261 kB 00:00 2024-05-08T19:54:08.422 INFO:teuthology.orchestra.run.smithi132.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 946 kB/s | 142 kB 00:00 2024-05-08T19:54:08.477 INFO:teuthology.orchestra.run.smithi082.stdout:(12/146): libcephfs-devel-18.2.2-1322.gd21e4f96 265 kB/s | 31 kB 00:00 2024-05-08T19:54:08.588 INFO:teuthology.orchestra.run.smithi132.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 834 kB/s | 139 kB 00:00 2024-05-08T19:54:08.753 INFO:teuthology.orchestra.run.smithi082.stdout:(13/146): ceph-radosgw-18.2.2-1322.gd21e4f96.el 1.8 MB/s | 13 MB 00:07 2024-05-08T19:54:08.855 INFO:teuthology.orchestra.run.smithi132.stdout:(16/146): libradosstriper1-18.2.2-1322.gd21e4f9 1.7 MB/s | 474 kB 00:00 2024-05-08T19:54:08.869 INFO:teuthology.orchestra.run.smithi082.stdout:(14/146): libcephsqlite-18.2.2-1322.gd21e4f96.e 1.2 MB/s | 142 kB 00:00 2024-05-08T19:54:09.003 INFO:teuthology.orchestra.run.smithi082.stdout:(15/146): librados-devel-18.2.2-1322.gd21e4f96. 1.0 MB/s | 139 kB 00:00 2024-05-08T19:54:09.187 INFO:teuthology.orchestra.run.smithi082.stdout:(16/146): libcephfs2-18.2.2-1322.gd21e4f96.el8. 1.1 MB/s | 782 kB 00:00 2024-05-08T19:54:09.379 INFO:teuthology.orchestra.run.smithi082.stdout:(17/146): libradosstriper1-18.2.2-1322.gd21e4f9 1.2 MB/s | 474 kB 00:00 2024-05-08T19:54:09.488 INFO:teuthology.orchestra.run.smithi082.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 412 kB/s | 45 kB 00:00 2024-05-08T19:54:09.604 INFO:teuthology.orchestra.run.smithi082.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 1.1 MB/s | 129 kB 00:00 2024-05-08T19:54:10.021 INFO:teuthology.orchestra.run.smithi082.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 472 kB/s | 197 kB 00:00 2024-05-08T19:54:10.413 INFO:teuthology.orchestra.run.smithi082.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 946 kB/s | 370 kB 00:00 2024-05-08T19:54:10.631 INFO:teuthology.orchestra.run.smithi132.stdout:(17/146): ceph-common-18.2.2-1322.gd21e4f96.el8 1.2 MB/s | 22 MB 00:17 2024-05-08T19:54:10.717 INFO:teuthology.orchestra.run.smithi082.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 1.2 MB/s | 365 kB 00:00 2024-05-08T19:54:10.731 INFO:teuthology.orchestra.run.smithi132.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 447 kB/s | 45 kB 00:00 2024-05-08T19:54:10.819 INFO:teuthology.orchestra.run.smithi033.stdout:(17/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 2.2 MB/s | 6.5 MB 00:02 2024-05-08T19:54:10.822 INFO:teuthology.orchestra.run.smithi082.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.0 MB/s | 107 kB 00:00 2024-05-08T19:54:10.889 INFO:teuthology.orchestra.run.smithi132.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 815 kB/s | 129 kB 00:00 2024-05-08T19:54:10.920 INFO:teuthology.orchestra.run.smithi033.stdout:(18/146): python3-ceph-argparse-18.2.2-1322.gd2 448 kB/s | 45 kB 00:00 2024-05-08T19:54:10.931 INFO:teuthology.orchestra.run.smithi082.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 879 kB/s | 95 kB 00:00 2024-05-08T19:54:11.056 INFO:teuthology.orchestra.run.smithi132.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.2 MB/s | 197 kB 00:00 2024-05-08T19:54:11.073 INFO:teuthology.orchestra.run.smithi033.stdout:(19/146): python3-ceph-common-18.2.2-1322.gd21e 841 kB/s | 129 kB 00:00 2024-05-08T19:54:11.204 INFO:teuthology.orchestra.run.smithi033.stdout:(20/146): python3-cephfs-18.2.2-1322.gd21e4f96. 1.5 MB/s | 197 kB 00:00 2024-05-08T19:54:11.315 INFO:teuthology.orchestra.run.smithi132.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 1.4 MB/s | 370 kB 00:00 2024-05-08T19:54:11.421 INFO:teuthology.orchestra.run.smithi033.stdout:(21/146): python3-rados-18.2.2-1322.gd21e4f96.e 1.7 MB/s | 370 kB 00:00 2024-05-08T19:54:11.532 INFO:teuthology.orchestra.run.smithi132.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 1.6 MB/s | 365 kB 00:00 2024-05-08T19:54:11.615 INFO:teuthology.orchestra.run.smithi132.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 1.3 MB/s | 107 kB 00:00 2024-05-08T19:54:11.620 INFO:teuthology.orchestra.run.smithi033.stdout:(22/146): python3-rbd-18.2.2-1322.gd21e4f96.el8 1.8 MB/s | 365 kB 00:00 2024-05-08T19:54:11.699 INFO:teuthology.orchestra.run.smithi132.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 1.1 MB/s | 95 kB 00:00 2024-05-08T19:54:11.755 INFO:teuthology.orchestra.run.smithi033.stdout:(23/146): python3-rgw-18.2.2-1322.gd21e4f96.el8 794 kB/s | 107 kB 00:00 2024-05-08T19:54:11.854 INFO:teuthology.orchestra.run.smithi033.stdout:(24/146): rbd-fuse-18.2.2-1322.gd21e4f96.el8.x8 963 kB/s | 95 kB 00:00 2024-05-08T19:54:12.566 INFO:teuthology.orchestra.run.smithi132.stdout:(25/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 1.8 MB/s | 6.5 MB 00:03 2024-05-08T19:54:12.741 INFO:teuthology.orchestra.run.smithi132.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.0 MB/s | 181 kB 00:00 2024-05-08T19:54:12.833 INFO:teuthology.orchestra.run.smithi132.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 265 kB/s | 24 kB 00:00 2024-05-08T19:54:12.942 INFO:teuthology.orchestra.run.smithi132.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.2 MB/s | 138 kB 00:00 2024-05-08T19:54:13.380 INFO:teuthology.orchestra.run.smithi033.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 2.3 MB/s | 3.5 MB 00:01 2024-05-08T19:54:13.397 INFO:teuthology.orchestra.run.smithi082.stdout:(25/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 1.4 MB/s | 3.5 MB 00:02 2024-05-08T19:54:13.488 INFO:teuthology.orchestra.run.smithi033.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 1.6 MB/s | 181 kB 00:00 2024-05-08T19:54:13.581 INFO:teuthology.orchestra.run.smithi082.stdout:(26/146): rbd-nbd-18.2.2-1322.gd21e4f96.el8.x86 990 kB/s | 181 kB 00:00 2024-05-08T19:54:13.584 INFO:teuthology.orchestra.run.smithi132.stdout:(29/146): rbd-mirror-18.2.2-1322.gd21e4f96.el8. 1.8 MB/s | 3.5 MB 00:01 2024-05-08T19:54:13.613 INFO:teuthology.orchestra.run.smithi033.stdout:(27/146): ceph-grafana-dashboards-18.2.2-1322.g 194 kB/s | 24 kB 00:00 2024-05-08T19:54:13.706 INFO:teuthology.orchestra.run.smithi082.stdout:(27/146): librgw2-18.2.2-1322.gd21e4f96.el8.x86 1.4 MB/s | 6.5 MB 00:04 2024-05-08T19:54:13.714 INFO:teuthology.orchestra.run.smithi033.stdout:(28/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.4 MB/s | 138 kB 00:00 2024-05-08T19:54:13.731 INFO:teuthology.orchestra.run.smithi082.stdout:(28/146): ceph-grafana-dashboards-18.2.2-1322.g 162 kB/s | 24 kB 00:00 2024-05-08T19:54:13.815 INFO:teuthology.orchestra.run.smithi082.stdout:(29/146): ceph-mgr-cephadm-18.2.2-1322.gd21e4f9 1.2 MB/s | 138 kB 00:00 2024-05-08T19:54:15.297 INFO:teuthology.orchestra.run.smithi033.stdout:(29/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 2.2 MB/s | 3.5 MB 00:01 2024-05-08T19:54:15.300 INFO:teuthology.orchestra.run.smithi132.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 1.5 MB/s | 3.5 MB 00:02 2024-05-08T19:54:15.726 INFO:teuthology.orchestra.run.smithi132.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 578 kB/s | 245 kB 00:00 2024-05-08T19:54:15.948 INFO:teuthology.orchestra.run.smithi033.stdout:(30/146): ceph-common-18.2.2-1322.gd21e4f96.el8 1.2 MB/s | 22 MB 00:18 2024-05-08T19:54:15.951 INFO:teuthology.orchestra.run.smithi132.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 218 kB/s | 49 kB 00:00 2024-05-08T19:54:16.051 INFO:teuthology.orchestra.run.smithi132.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 163 kB/s | 16 kB 00:00 2024-05-08T19:54:16.306 INFO:teuthology.orchestra.run.smithi033.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 686 kB/s | 245 kB 00:00 2024-05-08T19:54:16.327 INFO:teuthology.orchestra.run.smithi132.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 955 kB/s | 263 kB 00:00 2024-05-08T19:54:16.418 INFO:teuthology.orchestra.run.smithi033.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 453 kB/s | 49 kB 00:00 2024-05-08T19:54:16.502 INFO:teuthology.orchestra.run.smithi132.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 974 kB/s | 170 kB 00:00 2024-05-08T19:54:16.524 INFO:teuthology.orchestra.run.smithi033.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 150 kB/s | 16 kB 00:00 2024-05-08T19:54:16.603 INFO:teuthology.orchestra.run.smithi132.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 181 kB/s | 18 kB 00:00 2024-05-08T19:54:16.706 INFO:teuthology.orchestra.run.smithi082.stdout:(30/146): ceph-mgr-dashboard-18.2.2-1322.gd21e4 1.2 MB/s | 3.5 MB 00:02 2024-05-08T19:54:16.803 INFO:teuthology.orchestra.run.smithi132.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.5 MB/s | 306 kB 00:00 2024-05-08T19:54:16.824 INFO:teuthology.orchestra.run.smithi033.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 877 kB/s | 263 kB 00:00 2024-05-08T19:54:16.853 INFO:teuthology.orchestra.run.smithi132.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2024-05-08T19:54:16.895 INFO:teuthology.orchestra.run.smithi132.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2024-05-08T19:54:16.962 INFO:teuthology.orchestra.run.smithi132.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2024-05-08T19:54:16.981 INFO:teuthology.orchestra.run.smithi082.stdout:(31/146): ceph-mgr-modules-core-18.2.2-1322.gd2 894 kB/s | 245 kB 00:00 2024-05-08T19:54:17.012 INFO:teuthology.orchestra.run.smithi132.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2024-05-08T19:54:17.034 INFO:teuthology.orchestra.run.smithi033.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 817 kB/s | 170 kB 00:00 2024-05-08T19:54:17.054 INFO:teuthology.orchestra.run.smithi132.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2024-05-08T19:54:17.098 INFO:teuthology.orchestra.run.smithi082.stdout:(32/146): ceph-mgr-rook-18.2.2-1322.gd21e4f96.e 421 kB/s | 49 kB 00:00 2024-05-08T19:54:17.105 INFO:teuthology.orchestra.run.smithi132.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 661 kB/s | 33 kB 00:00 2024-05-08T19:54:17.155 INFO:teuthology.orchestra.run.smithi132.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 327 kB/s | 16 kB 00:00 2024-05-08T19:54:17.158 INFO:teuthology.orchestra.run.smithi033.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 145 kB/s | 18 kB 00:00 2024-05-08T19:54:17.207 INFO:teuthology.orchestra.run.smithi082.stdout:(33/146): ceph-prometheus-alerts-18.2.2-1322.gd 150 kB/s | 16 kB 00:00 2024-05-08T19:54:17.297 INFO:teuthology.orchestra.run.smithi132.stdout:(45/146): ceph-mgr-diskprediction-local-18.2.2- 2.0 MB/s | 7.4 MB 00:03 2024-05-08T19:54:17.314 INFO:teuthology.orchestra.run.smithi132.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2024-05-08T19:54:17.316 INFO:teuthology.orchestra.run.smithi033.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2024-05-08T19:54:17.356 INFO:teuthology.orchestra.run.smithi132.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2024-05-08T19:54:17.367 INFO:teuthology.orchestra.run.smithi033.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2024-05-08T19:54:17.406 INFO:teuthology.orchestra.run.smithi132.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 225 kB/s | 11 kB 00:00 2024-05-08T19:54:17.409 INFO:teuthology.orchestra.run.smithi033.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2024-05-08T19:54:17.457 INFO:teuthology.orchestra.run.smithi132.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 352 kB/s | 18 kB 00:00 2024-05-08T19:54:17.474 INFO:teuthology.orchestra.run.smithi082.stdout:(34/146): ceph-volume-18.2.2-1322.gd21e4f96.el8 987 kB/s | 263 kB 00:00 2024-05-08T19:54:17.507 INFO:teuthology.orchestra.run.smithi132.stdout:(50/146): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2024-05-08T19:54:17.534 INFO:teuthology.orchestra.run.smithi033.stdout:(40/146): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2024-05-08T19:54:17.540 INFO:teuthology.orchestra.run.smithi132.stdout:(51/146): python3-kubernetes-11.0.0-6.el8.noarc 14 MB/s | 1.2 MB 00:00 2024-05-08T19:54:17.565 INFO:teuthology.orchestra.run.smithi132.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 832 kB/s | 49 kB 00:00 2024-05-08T19:54:17.599 INFO:teuthology.orchestra.run.smithi132.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2024-05-08T19:54:17.601 INFO:teuthology.orchestra.run.smithi033.stdout:(41/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 655 kB/s | 44 kB 00:00 2024-05-08T19:54:17.625 INFO:teuthology.orchestra.run.smithi132.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2024-05-08T19:54:17.683 INFO:teuthology.orchestra.run.smithi132.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2024-05-08T19:54:17.684 INFO:teuthology.orchestra.run.smithi033.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 2.2 MB/s | 185 kB 00:00 2024-05-08T19:54:17.690 INFO:teuthology.orchestra.run.smithi082.stdout:(35/146): cephadm-18.2.2-1322.gd21e4f96.el8.noa 786 kB/s | 170 kB 00:00 2024-05-08T19:54:17.742 INFO:teuthology.orchestra.run.smithi132.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2024-05-08T19:54:17.743 INFO:teuthology.orchestra.run.smithi033.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 568 kB/s | 33 kB 00:00 2024-05-08T19:54:17.767 INFO:teuthology.orchestra.run.smithi132.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 402 kB/s | 34 kB 00:00 2024-05-08T19:54:17.799 INFO:teuthology.orchestra.run.smithi082.stdout:(36/146): cephfs-top-18.2.2-1322.gd21e4f96.el8. 167 kB/s | 18 kB 00:00 2024-05-08T19:54:17.801 INFO:teuthology.orchestra.run.smithi132.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 3.3 MB/s | 196 kB 00:00 2024-05-08T19:54:17.826 INFO:teuthology.orchestra.run.smithi132.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2024-05-08T19:54:17.829 INFO:teuthology.orchestra.run.smithi033.stdout:(44/146): python3-certifi-2018.10.15-7.el8.noar 191 kB/s | 16 kB 00:00 2024-05-08T19:54:17.860 INFO:teuthology.orchestra.run.smithi132.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2024-05-08T19:54:17.885 INFO:teuthology.orchestra.run.smithi132.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2024-05-08T19:54:17.919 INFO:teuthology.orchestra.run.smithi132.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 499 kB/s | 29 kB 00:00 2024-05-08T19:54:17.919 INFO:teuthology.orchestra.run.smithi033.stdout:(45/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.9 MB/s | 173 kB 00:00 2024-05-08T19:54:17.944 INFO:teuthology.orchestra.run.smithi132.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 470 kB/s | 27 kB 00:00 2024-05-08T19:54:17.978 INFO:teuthology.orchestra.run.smithi132.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 4.2 MB/s | 255 kB 00:00 2024-05-08T19:54:18.012 INFO:teuthology.orchestra.run.smithi132.stdout:(65/146): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2024-05-08T19:54:18.045 INFO:teuthology.orchestra.run.smithi132.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 918 kB/s | 61 kB 00:00 2024-05-08T19:54:18.070 INFO:teuthology.orchestra.run.smithi132.stdout:(67/146): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2024-05-08T19:54:18.104 INFO:teuthology.orchestra.run.smithi132.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 391 kB/s | 23 kB 00:00 2024-05-08T19:54:18.127 INFO:teuthology.orchestra.run.smithi033.stdout:(46/146): python3-cherrypy-18.4.0-1.el8.noarch. 1.8 MB/s | 384 kB 00:00 2024-05-08T19:54:18.129 INFO:teuthology.orchestra.run.smithi132.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T19:54:18.211 INFO:teuthology.orchestra.run.smithi033.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 975 kB/s | 81 kB 00:00 2024-05-08T19:54:18.213 INFO:teuthology.orchestra.run.smithi132.stdout:(70/146): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2024-05-08T19:54:18.233 INFO:teuthology.orchestra.run.smithi082.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 707 kB/s | 306 kB 00:00 2024-05-08T19:54:18.287 INFO:teuthology.orchestra.run.smithi033.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2024-05-08T19:54:18.321 INFO:teuthology.orchestra.run.smithi132.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 93 kB/s | 18 kB 00:00 2024-05-08T19:54:18.324 INFO:teuthology.orchestra.run.smithi082.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 642 kB/s | 59 kB 00:00 2024-05-08T19:54:18.353 INFO:teuthology.orchestra.run.smithi033.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 264 kB/s | 18 kB 00:00 2024-05-08T19:54:18.380 INFO:teuthology.orchestra.run.smithi132.stdout:(72/146): python3-jwt-1.6.1-2.el8.noarch.rpm 255 kB/s | 43 kB 00:00 2024-05-08T19:54:18.408 INFO:teuthology.orchestra.run.smithi082.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 901 kB/s | 75 kB 00:00 2024-05-08T19:54:18.422 INFO:teuthology.orchestra.run.smithi132.stdout:(73/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-05-08T19:54:18.506 INFO:teuthology.orchestra.run.smithi132.stdout:(74/146): python3-pycparser-2.14-14.el8.noarch. 872 kB/s | 109 kB 00:00 2024-05-08T19:54:18.525 INFO:teuthology.orchestra.run.smithi082.stdout:(40/146): ceph-mgr-diskprediction-local-18.2.2- 1.6 MB/s | 7.4 MB 00:04 2024-05-08T19:54:18.581 INFO:teuthology.orchestra.run.smithi132.stdout:(75/146): python3-requests-oauthlib-1.0.0-1.el8 269 kB/s | 43 kB 00:00 2024-05-08T19:54:18.626 INFO:teuthology.orchestra.run.smithi082.stdout:(41/146): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2024-05-08T19:54:18.656 INFO:teuthology.orchestra.run.smithi132.stdout:(76/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 124 kB/s | 19 kB 00:00 2024-05-08T19:54:18.723 INFO:teuthology.orchestra.run.smithi132.stdout:(77/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 309 kB/s | 44 kB 00:00 2024-05-08T19:54:18.745 INFO:teuthology.orchestra.run.smithi033.stdout:(50/146): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2024-05-08T19:54:18.776 INFO:teuthology.orchestra.run.smithi082.stdout:(42/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2024-05-08T19:54:18.782 INFO:teuthology.orchestra.run.smithi132.stdout:(78/146): pcre2-devel-10.32-2.el8.x86_64.rpm 4.7 MB/s | 605 kB 00:00 2024-05-08T19:54:18.812 INFO:teuthology.orchestra.run.smithi033.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 731 kB/s | 49 kB 00:00 2024-05-08T19:54:18.859 INFO:teuthology.orchestra.run.smithi082.stdout:(43/146): python3-cachetools-3.1.1-4.el8.noarch 395 kB/s | 33 kB 00:00 2024-05-08T19:54:18.865 INFO:teuthology.orchestra.run.smithi132.stdout:(79/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2024-05-08T19:54:18.879 INFO:teuthology.orchestra.run.smithi033.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 883 kB/s | 59 kB 00:00 2024-05-08T19:54:18.885 INFO:teuthology.orchestra.run.smithi082.stdout:(44/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 121 kB/s | 44 kB 00:00 2024-05-08T19:54:18.944 INFO:teuthology.orchestra.run.smithi082.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 194 kB/s | 16 kB 00:00 2024-05-08T19:54:18.949 INFO:teuthology.orchestra.run.smithi132.stdout:(80/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.3 MB/s | 220 kB 00:00 2024-05-08T19:54:18.980 INFO:teuthology.orchestra.run.smithi033.stdout:(53/146): ceph-mgr-diskprediction-local-18.2.2- 2.0 MB/s | 7.4 MB 00:03 2024-05-08T19:54:19.005 INFO:teuthology.orchestra.run.smithi033.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2024-05-08T19:54:19.028 INFO:teuthology.orchestra.run.smithi082.stdout:(46/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.2 MB/s | 173 kB 00:00 2024-05-08T19:54:19.058 INFO:teuthology.orchestra.run.smithi132.stdout:(81/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.0 MB/s | 200 kB 00:00 2024-05-08T19:54:19.082 INFO:teuthology.orchestra.run.smithi033.stdout:(55/146): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2024-05-08T19:54:19.108 INFO:teuthology.orchestra.run.smithi132.stdout:(82/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 303 kB/s | 48 kB 00:00 2024-05-08T19:54:19.187 INFO:teuthology.orchestra.run.smithi033.stdout:(56/146): python3-repoze-lru-0.7-6.el8.noarch.r 316 kB/s | 34 kB 00:00 2024-05-08T19:54:19.217 INFO:teuthology.orchestra.run.smithi132.stdout:(83/146): libsepol-devel-2.9-3.el8.x86_64.rpm 548 kB/s | 87 kB 00:00 2024-05-08T19:54:19.231 INFO:teuthology.orchestra.run.smithi082.stdout:(47/146): python3-google-auth-1.1.1-10.el8.noar 400 kB/s | 81 kB 00:00 2024-05-08T19:54:19.267 INFO:teuthology.orchestra.run.smithi132.stdout:(84/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 363 kB/s | 58 kB 00:00 2024-05-08T19:54:19.319 INFO:teuthology.orchestra.run.smithi082.stdout:(48/146): python3-jaraco-6.2-6.el8.noarch.rpm 126 kB/s | 11 kB 00:00 2024-05-08T19:54:19.322 INFO:teuthology.orchestra.run.smithi033.stdout:(57/146): python3-routes-2.4.1-12.el8.noarch.rp 1.4 MB/s | 196 kB 00:00 2024-05-08T19:54:19.367 INFO:teuthology.orchestra.run.smithi132.stdout:(85/146): fuse-2.9.7-17.el8.x86_64.rpm 831 kB/s | 83 kB 00:00 2024-05-08T19:54:19.394 INFO:teuthology.orchestra.run.smithi082.stdout:(49/146): python3-jaraco-functools-2.0-4.el8.no 234 kB/s | 18 kB 00:00 2024-05-08T19:54:19.401 INFO:teuthology.orchestra.run.smithi132.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 210 kB/s | 39 kB 00:00 2024-05-08T19:54:19.431 INFO:teuthology.orchestra.run.smithi033.stdout:(58/146): python3-rsa-4.9-2.el8.noarch.rpm 593 kB/s | 64 kB 00:00 2024-05-08T19:54:19.490 INFO:teuthology.orchestra.run.smithi033.stdout:(59/146): python3-simplegeneric-0.8.1-17.el8.no 319 kB/s | 19 kB 00:00 2024-05-08T19:54:19.553 INFO:teuthology.orchestra.run.smithi082.stdout:(50/146): python3-cherrypy-18.4.0-1.el8.noarch. 631 kB/s | 384 kB 00:00 2024-05-08T19:54:19.554 INFO:teuthology.orchestra.run.smithi132.stdout:(87/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.4 MB/s | 645 kB 00:00 2024-05-08T19:54:19.585 INFO:teuthology.orchestra.run.smithi132.stdout:(88/146): libquadmath-8.5.0-20.el8.x86_64.rpm 938 kB/s | 172 kB 00:00 2024-05-08T19:54:19.628 INFO:teuthology.orchestra.run.smithi082.stdout:(51/146): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2024-05-08T19:54:19.657 INFO:teuthology.orchestra.run.smithi033.stdout:(60/146): python3-singledispatch-3.4.0.3-18.el8 144 kB/s | 24 kB 00:00 2024-05-08T19:54:19.682 INFO:teuthology.orchestra.run.smithi033.stdout:(61/146): python3-pecan-1.3.2-9.el8.noarch.rpm 403 kB/s | 283 kB 00:00 2024-05-08T19:54:19.702 INFO:teuthology.orchestra.run.smithi132.stdout:(89/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2024-05-08T19:54:19.719 INFO:teuthology.orchestra.run.smithi132.stdout:(90/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 544 kB/s | 73 kB 00:00 2024-05-08T19:54:19.720 INFO:teuthology.orchestra.run.smithi082.stdout:(52/146): python3-more-itertools-7.2.0-3.el8.no 641 kB/s | 59 kB 00:00 2024-05-08T19:54:19.824 INFO:teuthology.orchestra.run.smithi033.stdout:(62/146): python3-trustme-0.6.0-4.el8.noarch.rp 195 kB/s | 27 kB 00:00 2024-05-08T19:54:19.877 INFO:teuthology.orchestra.run.smithi132.stdout:(91/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.5 MB/s | 562 kB 00:00 2024-05-08T19:54:19.903 INFO:teuthology.orchestra.run.smithi132.stdout:(92/146): elfutils-libelf-devel-0.189-3.el8.x86 308 kB/s | 62 kB 00:00 2024-05-08T19:54:20.099 INFO:teuthology.orchestra.run.smithi033.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 66 kB/s | 29 kB 00:00 2024-05-08T19:54:20.162 INFO:teuthology.orchestra.run.smithi082.stdout:(53/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 3.2 MB/s | 47 MB 00:14 2024-05-08T19:54:20.179 INFO:teuthology.orchestra.run.smithi082.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 131 kB/s | 60 kB 00:00 2024-05-08T19:54:20.199 INFO:teuthology.orchestra.run.smithi033.stdout:(64/146): python3-waitress-1.4.3-1.el8.noarch.r 681 kB/s | 255 kB 00:00 2024-05-08T19:54:20.213 INFO:teuthology.orchestra.run.smithi082.stdout:(55/146): python3-kubernetes-11.0.0-6.el8.noarc 1.4 MB/s | 1.2 MB 00:00 2024-05-08T19:54:20.246 INFO:teuthology.orchestra.run.smithi082.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2024-05-08T19:54:20.288 INFO:teuthology.orchestra.run.smithi082.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 476 kB/s | 34 kB 00:00 2024-05-08T19:54:20.299 INFO:teuthology.orchestra.run.smithi033.stdout:(65/146): python3-websocket-client-0.56.0-5.el8 610 kB/s | 61 kB 00:00 2024-05-08T19:54:20.325 INFO:teuthology.orchestra.run.smithi033.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.1 MB/s | 251 kB 00:00 2024-05-08T19:54:20.353 INFO:teuthology.orchestra.run.smithi132.stdout:(93/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 3.2 MB/s | 47 MB 00:14 2024-05-08T19:54:20.372 INFO:teuthology.orchestra.run.smithi082.stdout:(58/146): python3-rsa-4.9-2.el8.noarch.rpm 772 kB/s | 64 kB 00:00 2024-05-08T19:54:20.375 INFO:teuthology.orchestra.run.smithi033.stdout:(67/146): python3-zc-lockfile-2.0-2.el8.noarch. 461 kB/s | 23 kB 00:00 2024-05-08T19:54:20.378 INFO:teuthology.orchestra.run.smithi132.stdout:(94/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 99 kB/s | 47 kB 00:00 2024-05-08T19:54:20.397 INFO:teuthology.orchestra.run.smithi082.stdout:(59/146): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2024-05-08T19:54:20.434 INFO:teuthology.orchestra.run.smithi033.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 637 kB/s | 85 kB 00:00 2024-05-08T19:54:20.439 INFO:teuthology.orchestra.run.smithi082.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 280 kB/s | 19 kB 00:00 2024-05-08T19:54:20.459 INFO:teuthology.orchestra.run.smithi033.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T19:54:20.473 INFO:teuthology.orchestra.run.smithi082.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 319 kB/s | 24 kB 00:00 2024-05-08T19:54:20.486 INFO:teuthology.orchestra.run.smithi132.stdout:(95/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 3.8 MB/s | 2.3 MB 00:00 2024-05-08T19:54:20.521 INFO:teuthology.orchestra.run.smithi132.stdout:(96/146): NetworkManager-initscripts-updown-1.4 1.0 MB/s | 144 kB 00:00 2024-05-08T19:54:20.554 INFO:teuthology.orchestra.run.smithi132.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 2.7 MB/s | 559 kB 00:00 2024-05-08T19:54:20.559 INFO:teuthology.orchestra.run.smithi033.stdout:(70/146): python3-packaging-16.8-9.el8.noarch.r 483 kB/s | 48 kB 00:00 2024-05-08T19:54:20.588 INFO:teuthology.orchestra.run.smithi132.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 983 kB/s | 100 kB 00:00 2024-05-08T19:54:20.688 INFO:teuthology.orchestra.run.smithi132.stdout:(99/146): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2024-05-08T19:54:20.701 INFO:teuthology.orchestra.run.smithi033.stdout:(71/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 126 kB/s | 18 kB 00:00 2024-05-08T19:54:20.714 INFO:teuthology.orchestra.run.smithi132.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 104 kB/s | 20 kB 00:00 2024-05-08T19:54:20.739 INFO:teuthology.orchestra.run.smithi132.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 239 kB/s | 44 kB 00:00 2024-05-08T19:54:20.748 INFO:teuthology.orchestra.run.smithi082.stdout:(62/146): python3-tempora-1.14.1-5.el8.noarch.r 95 kB/s | 29 kB 00:00 2024-05-08T19:54:20.798 INFO:teuthology.orchestra.run.smithi082.stdout:(63/146): python3-trustme-0.6.0-4.el8.noarch.rp 84 kB/s | 27 kB 00:00 2024-05-08T19:54:20.823 INFO:teuthology.orchestra.run.smithi082.stdout:(64/146): python3-pecan-1.3.2-9.el8.noarch.rpm 428 kB/s | 283 kB 00:00 2024-05-08T19:54:20.872 INFO:teuthology.orchestra.run.smithi132.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 144 kB/s | 27 kB 00:00 2024-05-08T19:54:20.893 INFO:teuthology.orchestra.run.smithi033.stdout:(72/146): python3-jwt-1.6.1-2.el8.noarch.rpm 222 kB/s | 43 kB 00:00 2024-05-08T19:54:20.897 INFO:teuthology.orchestra.run.smithi132.stdout:(103/146): python3-werkzeug-0.12.2-4.el8.noarch 2.8 MB/s | 457 kB 00:00 2024-05-08T19:54:20.915 INFO:teuthology.orchestra.run.smithi082.stdout:(65/146): python3-websocket-client-0.56.0-5.el8 669 kB/s | 61 kB 00:00 2024-05-08T19:54:20.965 INFO:teuthology.orchestra.run.smithi132.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 504 kB/s | 126 kB 00:00 2024-05-08T19:54:20.974 INFO:teuthology.orchestra.run.smithi082.stdout:(66/146): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2024-05-08T19:54:20.998 INFO:teuthology.orchestra.run.smithi132.stdout:(105/146): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2024-05-08T19:54:20.999 INFO:teuthology.orchestra.run.smithi082.stdout:(67/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2024-05-08T19:54:21.010 INFO:teuthology.orchestra.run.smithi033.stdout:(73/146): thrift-0.13.0-2.el8.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2024-05-08T19:54:21.016 INFO:teuthology.orchestra.run.smithi082.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 851 kB/s | 85 kB 00:00 2024-05-08T19:54:21.031 INFO:teuthology.orchestra.run.smithi132.stdout:(106/146): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2024-05-08T19:54:21.041 INFO:teuthology.orchestra.run.smithi082.stdout:(69/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2024-05-08T19:54:21.044 INFO:teuthology.orchestra.run.smithi033.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2024-05-08T19:54:21.075 INFO:teuthology.orchestra.run.smithi082.stdout:(70/146): python3-zc-lockfile-2.0-2.el8.noarch. 228 kB/s | 23 kB 00:00 2024-05-08T19:54:21.099 INFO:teuthology.orchestra.run.smithi132.stdout:(107/146): libtool-2.4.6-25.el8.x86_64.rpm 5.2 MB/s | 709 kB 00:00 2024-05-08T19:54:21.183 INFO:teuthology.orchestra.run.smithi132.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 211 kB/s | 39 kB 00:00 2024-05-08T19:54:21.208 INFO:teuthology.orchestra.run.smithi132.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.4 MB/s | 259 kB 00:00 2024-05-08T19:54:21.225 INFO:teuthology.orchestra.run.smithi132.stdout:(110/146): uuid-1.6.2-43.el8.x86_64.rpm 509 kB/s | 64 kB 00:00 2024-05-08T19:54:21.225 INFO:teuthology.orchestra.run.smithi082.stdout:(71/146): python3-packaging-16.8-9.el8.noarch.r 263 kB/s | 48 kB 00:00 2024-05-08T19:54:21.227 INFO:teuthology.orchestra.run.smithi033.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 503 kB/s | 109 kB 00:00 2024-05-08T19:54:21.250 INFO:teuthology.orchestra.run.smithi082.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 102 kB/s | 18 kB 00:00 2024-05-08T19:54:21.253 INFO:teuthology.orchestra.run.smithi033.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 214 kB/s | 43 kB 00:00 2024-05-08T19:54:21.275 INFO:teuthology.orchestra.run.smithi132.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.1 MB/s | 103 kB 00:00 2024-05-08T19:54:21.317 INFO:teuthology.orchestra.run.smithi082.stdout:(73/146): python3-jwt-1.6.1-2.el8.noarch.rpm 464 kB/s | 43 kB 00:00 2024-05-08T19:54:21.351 INFO:teuthology.orchestra.run.smithi082.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.5 MB/s | 155 kB 00:00 2024-05-08T19:54:21.410 INFO:teuthology.orchestra.run.smithi082.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 1.2 MB/s | 109 kB 00:00 2024-05-08T19:54:21.417 INFO:teuthology.orchestra.run.smithi132.stdout:(112/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.7 MB/s | 538 kB 00:00 2024-05-08T19:54:21.485 INFO:teuthology.orchestra.run.smithi082.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 320 kB/s | 43 kB 00:00 2024-05-08T19:54:21.542 INFO:teuthology.orchestra.run.smithi132.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2024-05-08T19:54:21.543 INFO:teuthology.orchestra.run.smithi082.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2024-05-08T19:54:21.576 INFO:teuthology.orchestra.run.smithi132.stdout:(114/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2024-05-08T19:54:21.627 INFO:teuthology.orchestra.run.smithi082.stdout:(78/146): thrift-0.13.0-2.el8.x86_64.rpm 2.8 MB/s | 1.7 MB 00:00 2024-05-08T19:54:21.634 INFO:teuthology.orchestra.run.smithi132.stdout:(115/146): python3-numpy-1.14.3-10.el8.x86_64.r 10 MB/s | 3.7 MB 00:00 2024-05-08T19:54:21.652 INFO:teuthology.orchestra.run.smithi082.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 262 kB/s | 44 kB 00:00 2024-05-08T19:54:21.660 INFO:teuthology.orchestra.run.smithi132.stdout:(116/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.9 MB/s | 225 kB 00:00 2024-05-08T19:54:21.711 INFO:teuthology.orchestra.run.smithi033.stdout:(77/146): ceph-test-18.2.2-1322.gd21e4f96.el8.x 2.9 MB/s | 47 MB 00:16 2024-05-08T19:54:21.719 INFO:teuthology.orchestra.run.smithi082.stdout:(80/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2024-05-08T19:54:21.726 INFO:teuthology.orchestra.run.smithi132.stdout:(117/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2024-05-08T19:54:21.728 INFO:teuthology.orchestra.run.smithi033.stdout:(78/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 37 kB/s | 19 kB 00:00 2024-05-08T19:54:21.745 INFO:teuthology.orchestra.run.smithi033.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 89 kB/s | 44 kB 00:00 2024-05-08T19:54:21.770 INFO:teuthology.orchestra.run.smithi082.stdout:(81/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.6 MB/s | 229 kB 00:00 2024-05-08T19:54:21.812 INFO:teuthology.orchestra.run.smithi082.stdout:(82/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2024-05-08T19:54:21.819 INFO:teuthology.orchestra.run.smithi132.stdout:(118/146): python3-mako-1.0.6-14.el8.noarch.rpm 990 kB/s | 157 kB 00:00 2024-05-08T19:54:21.895 INFO:teuthology.orchestra.run.smithi082.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 384 kB/s | 48 kB 00:00 2024-05-08T19:54:21.896 INFO:teuthology.orchestra.run.smithi033.stdout:(80/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2024-05-08T19:54:21.910 INFO:teuthology.orchestra.run.smithi132.stdout:(119/146): openblas-threads-0.3.15-6.el8.x86_64 19 MB/s | 5.2 MB 00:00 2024-05-08T19:54:21.929 INFO:teuthology.orchestra.run.smithi033.stdout:(81/146): pcre2-devel-10.32-2.el8.x86_64.rpm 2.7 MB/s | 605 kB 00:00 2024-05-08T19:54:21.954 INFO:teuthology.orchestra.run.smithi033.stdout:(82/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.0 MB/s | 229 kB 00:00 2024-05-08T19:54:21.979 INFO:teuthology.orchestra.run.smithi082.stdout:(84/146): libselinux-devel-2.9-5.el8.x86_64.rpm 772 kB/s | 200 kB 00:00 2024-05-08T19:54:22.019 INFO:teuthology.orchestra.run.smithi132.stdout:(120/146): openblas-0.3.15-6.el8.x86_64.rpm 17 MB/s | 5.0 MB 00:00 2024-05-08T19:54:22.061 INFO:teuthology.orchestra.run.smithi132.stdout:(121/146): libpq-13.11-1.el8.x86_64.rpm 1.3 MB/s | 198 kB 00:00 2024-05-08T19:54:22.080 INFO:teuthology.orchestra.run.smithi033.stdout:(83/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.1 MB/s | 200 kB 00:00 2024-05-08T19:54:22.096 INFO:teuthology.orchestra.run.smithi082.stdout:(85/146): libsepol-devel-2.9-3.el8.x86_64.rpm 307 kB/s | 87 kB 00:00 2024-05-08T19:54:22.170 INFO:teuthology.orchestra.run.smithi132.stdout:(122/146): automake-1.16.1-8.el8.noarch.rpm 2.0 MB/s | 714 kB 00:00 2024-05-08T19:54:22.180 INFO:teuthology.orchestra.run.smithi033.stdout:(84/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 192 kB/s | 48 kB 00:00 2024-05-08T19:54:22.221 INFO:teuthology.orchestra.run.smithi082.stdout:(86/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 177 kB/s | 58 kB 00:00 2024-05-08T19:54:22.228 INFO:teuthology.orchestra.run.smithi132.stdout:(123/146): python3-pytz-2017.2-11.el8.noarch.rp 325 kB/s | 54 kB 00:00 2024-05-08T19:54:22.246 INFO:teuthology.orchestra.run.smithi082.stdout:(87/146): libcom_err-devel-1.45.6-4.el8.x86_64. 144 kB/s | 39 kB 00:00 2024-05-08T19:54:22.272 INFO:teuthology.orchestra.run.smithi082.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 473 kB/s | 83 kB 00:00 2024-05-08T19:54:22.322 INFO:teuthology.orchestra.run.smithi082.stdout:(89/146): libgfortran-8.5.0-20.el8.x86_64.rpm 6.3 MB/s | 645 kB 00:00 2024-05-08T19:54:22.337 INFO:teuthology.orchestra.run.smithi132.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 638 kB/s | 202 kB 00:00 2024-05-08T19:54:22.371 INFO:teuthology.orchestra.run.smithi132.stdout:(125/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-05-08T19:54:22.380 INFO:teuthology.orchestra.run.smithi082.stdout:(90/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 172 kB 00:00 2024-05-08T19:54:22.431 INFO:teuthology.orchestra.run.smithi082.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.5 MB/s | 238 kB 00:00 2024-05-08T19:54:22.492 INFO:teuthology.orchestra.run.smithi033.stdout:(85/146): libsepol-devel-2.9-3.el8.x86_64.rpm 162 kB/s | 87 kB 00:00 2024-05-08T19:54:22.497 INFO:teuthology.orchestra.run.smithi082.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 413 kB/s | 73 kB 00:00 2024-05-08T19:54:22.522 INFO:teuthology.orchestra.run.smithi082.stdout:(93/146): elfutils-libelf-devel-0.189-3.el8.x86 435 kB/s | 62 kB 00:00 2024-05-08T19:54:22.539 INFO:teuthology.orchestra.run.smithi033.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 108 kB/s | 39 kB 00:00 2024-05-08T19:54:22.565 INFO:teuthology.orchestra.run.smithi033.stdout:(87/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 119 kB/s | 58 kB 00:00 2024-05-08T19:54:22.573 INFO:teuthology.orchestra.run.smithi082.stdout:(94/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.9 MB/s | 562 kB 00:00 2024-05-08T19:54:22.579 INFO:teuthology.orchestra.run.smithi132.stdout:(126/146): python3-scipy-1.0.0-21.module+el8.9. 33 MB/s | 14 MB 00:00 2024-05-08T19:54:22.613 INFO:teuthology.orchestra.run.smithi132.stdout:(127/146): postgresql-contrib-10.23-4.module+el 3.3 MB/s | 812 kB 00:00 2024-05-08T19:54:22.615 INFO:teuthology.orchestra.run.smithi033.stdout:(88/146): fuse-2.9.7-17.el8.x86_64.rpm 676 kB/s | 83 kB 00:00 2024-05-08T19:54:22.655 INFO:teuthology.orchestra.run.smithi132.stdout:(128/146): postgresql-10.23-4.module+el8.9.0+21 4.7 MB/s | 1.5 MB 00:00 2024-05-08T19:54:22.656 INFO:teuthology.orchestra.run.smithi082.stdout:(95/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-05-08T19:54:22.665 INFO:teuthology.orchestra.run.smithi033.stdout:(89/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.7 MB/s | 172 kB 00:00 2024-05-08T19:54:22.682 INFO:teuthology.orchestra.run.smithi082.stdout:(96/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 296 kB/s | 47 kB 00:00 2024-05-08T19:54:22.698 INFO:teuthology.orchestra.run.smithi033.stdout:(90/146): libgfortran-8.5.0-20.el8.x86_64.rpm 4.0 MB/s | 645 kB 00:00 2024-05-08T19:54:22.732 INFO:teuthology.orchestra.run.smithi082.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 3.4 MB/s | 559 kB 00:00 2024-05-08T19:54:22.740 INFO:teuthology.orchestra.run.smithi033.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2024-05-08T19:54:22.813 INFO:teuthology.orchestra.run.smithi132.stdout:(129/146): postgresql-server-10.23-4.module+el8 22 MB/s | 5.1 MB 00:00 2024-05-08T19:54:22.832 INFO:teuthology.orchestra.run.smithi033.stdout:(92/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 434 kB/s | 73 kB 00:00 2024-05-08T19:54:22.838 INFO:teuthology.orchestra.run.smithi132.stdout:(130/146): python3-packaging-16.8-9.el8.noarch. 214 kB/s | 48 kB 00:00 2024-05-08T19:54:22.865 INFO:teuthology.orchestra.run.smithi082.stdout:(98/146): NetworkManager-initscripts-updown-1.4 691 kB/s | 144 kB 00:00 2024-05-08T19:54:22.874 INFO:teuthology.orchestra.run.smithi033.stdout:(93/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 4.1 MB/s | 562 kB 00:00 2024-05-08T19:54:22.891 INFO:teuthology.orchestra.run.smithi082.stdout:(99/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 478 kB/s | 100 kB 00:00 2024-05-08T19:54:22.900 INFO:teuthology.orchestra.run.smithi033.stdout:(94/146): elfutils-libelf-devel-0.189-3.el8.x86 307 kB/s | 62 kB 00:00 2024-05-08T19:54:22.925 INFO:teuthology.orchestra.run.smithi082.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 104 kB/s | 20 kB 00:00 2024-05-08T19:54:22.964 INFO:teuthology.orchestra.run.smithi132.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.8 MB/s | 232 kB 00:00 2024-05-08T19:54:23.033 INFO:teuthology.orchestra.run.smithi082.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 263 kB/s | 44 kB 00:00 2024-05-08T19:54:23.033 INFO:teuthology.orchestra.run.smithi033.stdout:(95/146): openssl-devel-1.1.1k-12.el8_9.x86_64. 12 MB/s | 2.3 MB 00:00 2024-05-08T19:54:23.050 INFO:teuthology.orchestra.run.smithi082.stdout:(102/146): python3-jsonpatch-1.21-2.el8.noarch. 212 kB/s | 27 kB 00:00 2024-05-08T19:54:23.058 INFO:teuthology.orchestra.run.smithi033.stdout:(96/146): librabbitmq-0.9.0-5.el8_9.x86_64.rpm 256 kB/s | 47 kB 00:00 2024-05-08T19:54:23.075 INFO:teuthology.orchestra.run.smithi082.stdout:(103/146): python3-pyasn1-modules-0.3.7-6.el8.n 598 kB/s | 110 kB 00:00 2024-05-08T19:54:23.081 INFO:teuthology.orchestra.run.smithi132.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 2.5 MB/s | 303 kB 00:00 2024-05-08T19:54:23.092 INFO:teuthology.orchestra.run.smithi033.stdout:(97/146): python3-cryptography-3.2.1-7.el8_9.x8 2.8 MB/s | 559 kB 00:00 2024-05-08T19:54:23.151 INFO:teuthology.orchestra.run.smithi082.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.1 MB/s | 126 kB 00:00 2024-05-08T19:54:23.184 INFO:teuthology.orchestra.run.smithi033.stdout:(98/146): libuuid-devel-2.32.1-44.el8_9.1.x86_6 798 kB/s | 100 kB 00:00 2024-05-08T19:54:23.201 INFO:teuthology.orchestra.run.smithi082.stdout:(105/146): python3-werkzeug-0.12.2-4.el8.noarch 3.0 MB/s | 457 kB 00:00 2024-05-08T19:54:23.209 INFO:teuthology.orchestra.run.smithi033.stdout:(99/146): NetworkManager-initscripts-updown-1.4 821 kB/s | 144 kB 00:00 2024-05-08T19:54:23.234 INFO:teuthology.orchestra.run.smithi033.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 141 kB/s | 20 kB 00:00 2024-05-08T19:54:23.239 INFO:teuthology.orchestra.run.smithi132.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.3 MB/s | 854 kB 00:00 2024-05-08T19:54:23.243 INFO:teuthology.orchestra.run.smithi082.stdout:(106/146): bison-3.0.4-10.el8.x86_64.rpm 4.0 MB/s | 688 kB 00:00 2024-05-08T19:54:23.293 INFO:teuthology.orchestra.run.smithi033.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 404 kB/s | 44 kB 00:00 2024-05-08T19:54:23.293 INFO:teuthology.orchestra.run.smithi082.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2024-05-08T19:54:23.343 INFO:teuthology.orchestra.run.smithi082.stdout:(108/146): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2024-05-08T19:54:23.352 INFO:teuthology.orchestra.run.smithi033.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 775 kB/s | 110 kB 00:00 2024-05-08T19:54:23.368 INFO:teuthology.orchestra.run.smithi082.stdout:(109/146): python3-markupsafe-0.23-19.el8.x86_6 309 kB/s | 39 kB 00:00 2024-05-08T19:54:23.394 INFO:teuthology.orchestra.run.smithi082.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2024-05-08T19:54:23.410 INFO:teuthology.orchestra.run.smithi033.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 151 kB/s | 27 kB 00:00 2024-05-08T19:54:23.436 INFO:teuthology.orchestra.run.smithi033.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 888 kB/s | 126 kB 00:00 2024-05-08T19:54:23.465 INFO:teuthology.orchestra.run.smithi132.stdout:(134/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.1 MB/s | 711 kB 00:00 2024-05-08T19:54:23.511 INFO:teuthology.orchestra.run.smithi082.stdout:(111/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 730 kB/s | 103 kB 00:00 2024-05-08T19:54:23.527 INFO:teuthology.orchestra.run.smithi033.stdout:(105/146): bison-3.0.4-10.el8.x86_64.rpm 5.8 MB/s | 688 kB 00:00 2024-05-08T19:54:23.536 INFO:teuthology.orchestra.run.smithi082.stdout:(112/146): uuid-1.6.2-43.el8.x86_64.rpm 333 kB/s | 64 kB 00:00 2024-05-08T19:54:23.561 INFO:teuthology.orchestra.run.smithi033.stdout:(106/146): flex-2.6.1-9.el8.x86_64.rpm 2.5 MB/s | 320 kB 00:00 2024-05-08T19:54:23.587 INFO:teuthology.orchestra.run.smithi033.stdout:(107/146): python3-werkzeug-0.12.2-4.el8.noarch 1.9 MB/s | 457 kB 00:00 2024-05-08T19:54:23.589 INFO:teuthology.orchestra.run.smithi132.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 12 MB/s | 1.5 MB 00:00 2024-05-08T19:54:23.645 INFO:teuthology.orchestra.run.smithi082.stdout:(113/146): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2024-05-08T19:54:23.661 INFO:teuthology.orchestra.run.smithi033.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 387 kB/s | 39 kB 00:00 2024-05-08T19:54:23.678 INFO:teuthology.orchestra.run.smithi082.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.1 MB/s | 538 kB 00:00 2024-05-08T19:54:23.703 INFO:teuthology.orchestra.run.smithi033.stdout:(109/146): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2024-05-08T19:54:23.723 INFO:teuthology.orchestra.run.smithi132.stdout:(136/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.5 MB/s | 333 kB 00:00 2024-05-08T19:54:23.729 INFO:teuthology.orchestra.run.smithi033.stdout:(110/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.8 MB/s | 259 kB 00:00 2024-05-08T19:54:23.737 INFO:teuthology.orchestra.run.smithi082.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 3.4 MB/s | 323 kB 00:00 2024-05-08T19:54:23.774 INFO:teuthology.orchestra.run.smithi132.stdout:(137/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 3.7 MB/s | 3.6 MB 00:00 2024-05-08T19:54:23.804 INFO:teuthology.orchestra.run.smithi082.stdout:(116/146): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2024-05-08T19:54:23.829 INFO:teuthology.orchestra.run.smithi082.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2024-05-08T19:54:23.837 INFO:teuthology.orchestra.run.smithi033.stdout:(111/146): uuid-1.6.2-43.el8.x86_64.rpm 364 kB/s | 64 kB 00:00 2024-05-08T19:54:23.862 INFO:teuthology.orchestra.run.smithi033.stdout:(112/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 652 kB/s | 103 kB 00:00 2024-05-08T19:54:23.879 INFO:teuthology.orchestra.run.smithi082.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.4 MB/s | 354 kB 00:00 2024-05-08T19:54:23.907 INFO:teuthology.orchestra.run.smithi132.stdout:(138/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 221 kB 00:00 2024-05-08T19:54:23.938 INFO:teuthology.orchestra.run.smithi082.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2024-05-08T19:54:23.954 INFO:teuthology.orchestra.run.smithi033.stdout:(113/146): python3-jinja2-2.10.1-3.el8.noarch.r 4.5 MB/s | 538 kB 00:00 2024-05-08T19:54:23.999 INFO:teuthology.orchestra.run.smithi132.stdout:(139/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 3.9 MB/s | 1.1 MB 00:00 2024-05-08T19:54:24.013 INFO:teuthology.orchestra.run.smithi082.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 25 MB/s | 5.2 MB 00:00 2024-05-08T19:54:24.050 INFO:teuthology.orchestra.run.smithi132.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.7 MB/s | 254 kB 00:00 2024-05-08T19:54:24.072 INFO:teuthology.orchestra.run.smithi033.stdout:(114/146): python3-numpy-1.14.3-10.el8.x86_64.r 18 MB/s | 3.7 MB 00:00 2024-05-08T19:54:24.105 INFO:teuthology.orchestra.run.smithi033.stdout:(115/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.1 MB/s | 323 kB 00:00 2024-05-08T19:54:24.113 INFO:teuthology.orchestra.run.smithi082.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2024-05-08T19:54:24.139 INFO:teuthology.orchestra.run.smithi082.stdout:(122/146): libpq-13.11-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2024-05-08T19:54:24.161 INFO:teuthology.orchestra.run.smithi132.stdout:(141/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 237 kB 00:00 2024-05-08T19:54:24.197 INFO:teuthology.orchestra.run.smithi033.stdout:(116/146): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2024-05-08T19:54:24.214 INFO:teuthology.orchestra.run.smithi082.stdout:(123/146): openblas-0.3.15-6.el8.x86_64.rpm 15 MB/s | 5.0 MB 00:00 2024-05-08T19:54:24.222 INFO:teuthology.orchestra.run.smithi033.stdout:(117/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2024-05-08T19:54:24.225 INFO:teuthology.orchestra.run.smithi132.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.0 MB/s | 180 kB 00:00 2024-05-08T19:54:24.256 INFO:teuthology.orchestra.run.smithi082.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2024-05-08T19:54:24.257 INFO:teuthology.orchestra.run.smithi033.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2024-05-08T19:54:24.281 INFO:teuthology.orchestra.run.smithi082.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 381 kB/s | 54 kB 00:00 2024-05-08T19:54:24.334 INFO:teuthology.orchestra.run.smithi132.stdout:(143/146): librados2-18.2.2-1322.gd21e4f96.el8. 2.2 MB/s | 3.7 MB 00:01 2024-05-08T19:54:24.348 INFO:teuthology.orchestra.run.smithi082.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-05-08T19:54:24.348 INFO:teuthology.orchestra.run.smithi033.stdout:(119/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-05-08T19:54:24.359 INFO:teuthology.orchestra.run.smithi132.stdout:(144/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 500 kB/s | 99 kB 00:00 2024-05-08T19:54:24.423 INFO:teuthology.orchestra.run.smithi082.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 11 MB/s | 1.5 MB 00:00 2024-05-08T19:54:24.434 INFO:teuthology.orchestra.run.smithi132.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-05-08T19:54:24.498 INFO:teuthology.orchestra.run.smithi082.stdout:(128/146): postgresql-contrib-10.23-4.module+el 5.3 MB/s | 812 kB 00:00 2024-05-08T19:54:24.515 INFO:teuthology.orchestra.run.smithi033.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 16 MB/s | 5.2 MB 00:00 2024-05-08T19:54:24.534 INFO:teuthology.orchestra.run.smithi132.stdout:(146/146): util-linux-user-2.32.1-44.el8_9.1.x8 513 kB/s | 103 kB 00:00 2024-05-08T19:54:24.537 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:54:24.537 INFO:teuthology.orchestra.run.smithi132.stdout:Total 6.7 MB/s | 215 MB 00:32 2024-05-08T19:54:24.557 INFO:teuthology.orchestra.run.smithi033.stdout:(121/146): automake-1.16.1-8.el8.noarch.rpm 3.3 MB/s | 714 kB 00:00 2024-05-08T19:54:24.674 INFO:teuthology.orchestra.run.smithi033.stdout:(122/146): openblas-0.3.15-6.el8.x86_64.rpm 12 MB/s | 5.0 MB 00:00 2024-05-08T19:54:24.682 INFO:teuthology.orchestra.run.smithi082.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 29 MB/s | 14 MB 00:00 2024-05-08T19:54:24.699 INFO:teuthology.orchestra.run.smithi033.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2024-05-08T19:54:24.724 INFO:teuthology.orchestra.run.smithi033.stdout:(124/146): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2024-05-08T19:54:24.783 INFO:teuthology.orchestra.run.smithi033.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 499 kB/s | 54 kB 00:00 2024-05-08T19:54:24.824 INFO:teuthology.orchestra.run.smithi082.stdout:(130/146): postgresql-server-10.23-4.module+el8 13 MB/s | 5.1 MB 00:00 2024-05-08T19:54:24.867 INFO:teuthology.orchestra.run.smithi033.stdout:(126/146): oniguruma-6.8.2-2.1.el8_9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-05-08T19:54:24.941 INFO:teuthology.orchestra.run.smithi082.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.9 MB/s | 232 kB 00:00 2024-05-08T19:54:24.959 INFO:teuthology.orchestra.run.smithi033.stdout:(127/146): postgresql-10.23-4.module+el8.9.0+21 8.6 MB/s | 1.5 MB 00:00 2024-05-08T19:54:25.050 INFO:teuthology.orchestra.run.smithi033.stdout:(128/146): postgresql-contrib-10.23-4.module+el 4.3 MB/s | 812 kB 00:00 2024-05-08T19:54:25.166 INFO:teuthology.orchestra.run.smithi082.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.3 MB/s | 303 kB 00:00 2024-05-08T19:54:25.276 INFO:teuthology.orchestra.run.smithi033.stdout:(129/146): python3-scipy-1.0.0-21.module+el8.9. 24 MB/s | 14 MB 00:00 2024-05-08T19:54:25.308 INFO:teuthology.orchestra.run.smithi082.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.9 MB/s | 854 kB 00:00 2024-05-08T19:54:25.359 INFO:teuthology.orchestra.run.smithi033.stdout:(130/146): postgresql-server-10.23-4.module+el8 13 MB/s | 5.1 MB 00:00 2024-05-08T19:54:25.458 INFO:teuthology.orchestra.run.smithi082.stdout:(134/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 4.6 MB/s | 711 kB 00:00 2024-05-08T19:54:25.543 INFO:teuthology.orchestra.run.smithi033.stdout:(131/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.2 MB/s | 232 kB 00:00 2024-05-08T19:54:25.550 INFO:teuthology.orchestra.run.smithi082.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 16 MB/s | 1.5 MB 00:00 2024-05-08T19:54:25.585 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-05-08T19:54:25.684 INFO:teuthology.orchestra.run.smithi082.stdout:(136/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 2.4 MB/s | 333 kB 00:00 2024-05-08T19:54:25.718 INFO:teuthology.orchestra.run.smithi033.stdout:(132/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.7 MB/s | 303 kB 00:00 2024-05-08T19:54:25.877 INFO:teuthology.orchestra.run.smithi033.stdout:(133/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.3 MB/s | 854 kB 00:00 2024-05-08T19:54:25.892 INFO:teuthology.orchestra.run.smithi082.stdout:(137/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.1 MB/s | 1.1 MB 00:00 2024-05-08T19:54:25.980 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-05-08T19:54:25.980 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-05-08T19:54:26.010 INFO:teuthology.orchestra.run.smithi082.stdout:(138/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 2.7 MB/s | 3.6 MB 00:01 2024-05-08T19:54:26.060 INFO:teuthology.orchestra.run.smithi033.stdout:(134/146): openssl-1.1.1k-12.el8_9.x86_64.rpm 3.8 MB/s | 711 kB 00:00 2024-05-08T19:54:26.085 INFO:teuthology.orchestra.run.smithi082.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.1 MB/s | 221 kB 00:00 2024-05-08T19:54:26.185 INFO:teuthology.orchestra.run.smithi082.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.4 MB/s | 254 kB 00:00 2024-05-08T19:54:26.211 INFO:teuthology.orchestra.run.smithi082.stdout:(141/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 1.8 MB/s | 237 kB 00:00 2024-05-08T19:54:26.227 INFO:teuthology.orchestra.run.smithi033.stdout:(135/146): openssl-libs-1.1.1k-12.el8_9.x86_64. 8.8 MB/s | 1.5 MB 00:00 2024-05-08T19:54:26.319 INFO:teuthology.orchestra.run.smithi082.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.3 MB/s | 180 kB 00:00 2024-05-08T19:54:26.336 INFO:teuthology.orchestra.run.smithi033.stdout:(136/146): xfsdump-3.1.8-7.el8_9.x86_64.rpm 3.0 MB/s | 333 kB 00:00 2024-05-08T19:54:26.361 INFO:teuthology.orchestra.run.smithi082.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 660 kB/s | 99 kB 00:00 2024-05-08T19:54:26.520 INFO:teuthology.orchestra.run.smithi082.stdout:(144/146): util-linux-2.32.1-44.el8_9.1.x86_64. 12 MB/s | 2.5 MB 00:00 2024-05-08T19:54:26.536 INFO:teuthology.orchestra.run.smithi082.stdout:(145/146): util-linux-user-2.32.1-44.el8_9.1.x8 587 kB/s | 103 kB 00:00 2024-05-08T19:54:26.553 INFO:teuthology.orchestra.run.smithi033.stdout:(137/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 4.9 MB/s | 1.1 MB 00:00 2024-05-08T19:54:26.611 INFO:teuthology.orchestra.run.smithi033.stdout:(138/146): librbd1-18.2.2-1322.gd21e4f96.el8.x8 2.7 MB/s | 3.6 MB 00:01 2024-05-08T19:54:26.728 INFO:teuthology.orchestra.run.smithi033.stdout:(139/146): libblkid-2.32.1-44.el8_9.1.x86_64.rp 1.2 MB/s | 221 kB 00:00 2024-05-08T19:54:26.770 INFO:teuthology.orchestra.run.smithi033.stdout:(140/146): libfdisk-2.32.1-44.el8_9.1.x86_64.rp 1.6 MB/s | 254 kB 00:00 2024-05-08T19:54:26.829 INFO:teuthology.orchestra.run.smithi033.stdout:(141/146): libmount-2.32.1-44.el8_9.1.x86_64.rp 2.3 MB/s | 237 kB 00:00 2024-05-08T19:54:26.896 INFO:teuthology.orchestra.run.smithi033.stdout:(142/146): libsmartcols-2.32.1-44.el8_9.1.x86_6 1.4 MB/s | 180 kB 00:00 2024-05-08T19:54:26.971 INFO:teuthology.orchestra.run.smithi033.stdout:(143/146): libuuid-2.32.1-44.el8_9.1.x86_64.rpm 697 kB/s | 99 kB 00:00 2024-05-08T19:54:27.113 INFO:teuthology.orchestra.run.smithi033.stdout:(144/146): util-linux-user-2.32.1-44.el8_9.1.x8 726 kB/s | 103 kB 00:00 2024-05-08T19:54:27.155 INFO:teuthology.orchestra.run.smithi033.stdout:(145/146): util-linux-2.32.1-44.el8_9.1.x86_64. 9.6 MB/s | 2.5 MB 00:00 2024-05-08T19:54:27.186 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-05-08T19:54:27.197 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-05-08T19:54:27.561 INFO:teuthology.orchestra.run.smithi082.stdout:(146/146): librados2-18.2.2-1322.gd21e4f96.el8. 1.2 MB/s | 3.7 MB 00:03 2024-05-08T19:54:27.566 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:54:27.567 INFO:teuthology.orchestra.run.smithi082.stdout:Total 6.9 MB/s | 215 MB 00:31 2024-05-08T19:54:28.621 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-08T19:54:29.015 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-08T19:54:29.016 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-08T19:54:29.830 INFO:teuthology.orchestra.run.smithi033.stdout:(146/146): librados2-18.2.2-1322.gd21e4f96.el8. 793 kB/s | 3.7 MB 00:04 2024-05-08T19:54:29.833 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:54:29.833 INFO:teuthology.orchestra.run.smithi033.stdout:Total 6.6 MB/s | 215 MB 00:32 2024-05-08T19:54:30.217 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-08T19:54:30.228 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-08T19:54:30.965 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2024-05-08T19:54:31.414 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2024-05-08T19:54:31.414 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2024-05-08T19:54:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-05-08T19:54:32.743 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2024-05-08T19:54:32.755 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2024-05-08T19:54:32.840 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T19:54:33.108 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:54:33.324 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:54:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T19:54:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:54:33.769 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:54:33.958 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:54:34.030 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:54:34.237 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T19:54:34.457 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T19:54:34.641 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:54:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:54:34.966 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:54:35.357 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:54:35.549 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:54:35.645 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-08T19:54:35.780 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T19:54:35.935 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:54:36.023 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:54:36.107 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:54:36.230 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:54:36.242 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:54:36.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T19:54:36.439 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:54:36.658 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:54:36.710 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:54:36.728 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:54:36.918 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:54:36.989 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:54:37.086 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:54:37.196 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T19:54:37.365 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:54:37.423 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T19:54:37.451 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:54:37.625 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:54:37.672 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T19:54:37.720 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:54:37.891 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:54:37.928 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T19:54:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T19:54:38.296 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:54:38.487 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T19:54:38.500 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:54:38.567 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2024-05-08T19:54:38.716 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/1 2024-05-08T19:54:38.744 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T19:54:38.893 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:54:38.907 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:54:38.967 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:54:39.012 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:54:39.100 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:54:39.190 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:54:39.204 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8_9.x86_64 1/162 2024-05-08T19:54:39.231 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:54:39.267 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:54:39.360 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2024-05-08T19:54:39.444 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T19:54:39.473 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:54:39.560 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:54:39.572 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:54:39.633 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libuuid-2.32.1-44.el8_9.1.x86_64 3/162 2024-05-08T19:54:39.724 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T19:54:39.822 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:54:39.886 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libblkid-2.32.1-44.el8_9.1.x86_64 4/162 2024-05-08T19:54:39.943 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:54:39.962 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T19:54:40.078 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2024-05-08T19:54:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:54:40.216 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:54:40.269 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:54:40.292 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.9.0-5.el8_9.x86_64 6/162 2024-05-08T19:54:40.300 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:54:40.440 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:54:40.497 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T19:54:40.497 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:54:40.604 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2024-05-08T19:54:40.772 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:54:40.802 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T19:54:40.994 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T19:54:41.063 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:54:41.239 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2024-05-08T19:54:41.248 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:54:41.372 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T19:54:41.439 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:54:41.869 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:54:41.886 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T19:54:41.892 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:54:42.066 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:54:42.072 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:54:42.073 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:54:42.186 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:54:42.192 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:54:42.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:54:42.392 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:54:42.466 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:54:42.493 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:54:42.619 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T19:54:42.755 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:54:42.829 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:54:42.875 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T19:54:43.021 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T19:54:43.105 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:54:43.137 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T19:54:43.225 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/162 2024-05-08T19:54:43.253 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T19:54:43.307 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:54:43.426 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:54:43.449 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libpq-13.11-1.el8.x86_64 14/162 2024-05-08T19:54:43.491 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T19:54:43.582 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:54:43.687 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T19:54:43.753 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 15/162 2024-05-08T19:54:43.842 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T19:54:43.953 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/162 2024-05-08T19:54:44.102 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T19:54:44.193 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:54:44.299 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:54:44.357 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 17/162 2024-05-08T19:54:44.390 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:54:44.611 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 18/162 2024-05-08T19:54:44.763 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:54:44.878 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:54:44.983 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:54:45.038 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:54:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 20/162 2024-05-08T19:54:45.190 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:54:45.303 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 21/162 2024-05-08T19:54:45.571 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 22/162 2024-05-08T19:54:45.787 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/162 2024-05-08T19:54:45.902 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:54:45.963 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:54:46.042 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:54:46.112 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 24/162 2024-05-08T19:54:46.188 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T19:54:46.304 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:54:46.370 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T19:54:46.396 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T19:54:46.650 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T19:54:46.830 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T19:54:46.992 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T19:54:46.995 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 25/162 2024-05-08T19:54:47.154 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:54:47.269 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T19:54:47.310 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T19:54:47.513 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:54:47.636 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T19:54:47.808 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 26/162 2024-05-08T19:54:47.907 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T19:54:48.013 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:54:48.125 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T19:54:48.366 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T19:54:48.561 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T19:54:48.763 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T19:54:48.786 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 27/162 2024-05-08T19:54:48.964 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:54:49.026 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:54:49.070 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 28/162 2024-05-08T19:54:49.239 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:54:49.255 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:54:49.280 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 29/162 2024-05-08T19:54:49.295 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:54:49.509 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T19:54:49.574 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 30/162 2024-05-08T19:54:49.642 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T19:54:49.757 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T19:54:49.778 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 31/162 2024-05-08T19:54:49.926 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 32/162 2024-05-08T19:54:49.964 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:54:50.238 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 33/162 2024-05-08T19:54:50.432 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:54:50.459 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:54:50.602 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T19:54:50.764 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:54:50.789 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:54:50.969 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T19:54:51.025 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-16.8-9.el8.noarch 49/162 2024-05-08T19:54:51.205 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 50/162 2024-05-08T19:54:51.228 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T19:54:51.276 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 50/162 2024-05-08T19:54:51.450 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T19:54:51.576 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-7.el8.x86_64 51/162 2024-05-08T19:54:51.692 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T19:54:51.839 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.1-8.el8.noarch 52/162 2024-05-08T19:54:51.910 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T19:54:52.030 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-43.el8.x86_64 53/162 2024-05-08T19:54:52.096 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T19:54:52.103 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 53/162 2024-05-08T19:54:52.278 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 54/162 2024-05-08T19:54:52.280 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:54:52.355 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:54:52.424 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 34/162 2024-05-08T19:54:52.495 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 55/162 2024-05-08T19:54:52.605 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:54:52.664 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 56/162 2024-05-08T19:54:52.674 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:54:52.785 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 35/162 2024-05-08T19:54:52.876 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.7-17.el8.x86_64 57/162 2024-05-08T19:54:52.918 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T19:54:53.060 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 58/162 2024-05-08T19:54:53.175 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T19:54:53.234 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 59/162 2024-05-08T19:54:53.380 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:54:53.441 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 60/162 2024-05-08T19:54:53.634 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 61/162 2024-05-08T19:54:53.810 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:54:53.849 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 36/162 2024-05-08T19:54:53.942 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 62/162 2024-05-08T19:54:54.172 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:54:54.197 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 37/162 2024-05-08T19:54:54.199 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:54:54.200 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/162 2024-05-08T19:54:54.405 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T19:54:54.440 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 38/162 2024-05-08T19:54:54.443 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 64/162 2024-05-08T19:54:54.486 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T19:54:54.584 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 65/162 2024-05-08T19:54:54.666 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/162 2024-05-08T19:54:54.750 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T19:54:54.833 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 66/162 2024-05-08T19:54:54.911 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 40/162 2024-05-08T19:54:55.005 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T19:54:55.078 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 41/162 2024-05-08T19:54:55.178 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 67/162 2024-05-08T19:54:55.196 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T19:54:55.246 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T19:54:55.263 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 42/162 2024-05-08T19:54:55.429 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T19:54:55.458 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 68/162 2024-05-08T19:54:55.483 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:54:55.571 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libfdisk-2.32.1-44.el8_9.1.x86_64 43/162 2024-05-08T19:54:55.620 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T19:54:55.745 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:54:55.760 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 69/162 2024-05-08T19:54:55.822 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T19:54:55.847 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libmount-2.32.1-44.el8_9.1.x86_64 44/162 2024-05-08T19:54:55.954 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/162 2024-05-08T19:54:56.016 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-08T19:54:56.055 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.32.1-44.el8_9.1.x86_64 45/162 2024-05-08T19:54:56.156 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/162 2024-05-08T19:54:56.226 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-08T19:54:56.274 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 46/162 2024-05-08T19:54:56.392 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 72/162 2024-05-08T19:54:56.445 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:54:56.451 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-08T19:54:56.624 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-08T19:54:56.675 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 73/162 2024-05-08T19:54:56.841 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-08T19:54:56.880 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/162 2024-05-08T19:54:56.962 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libsmartcols-2.32.1-44.el8_9.1.x86_64 47/162 2024-05-08T19:54:57.090 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 75/162 2024-05-08T19:54:57.152 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-08T19:54:57.277 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 76/162 2024-05-08T19:54:57.304 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:54:57.336 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: util-linux-2.32.1-44.el8_9.1.x86_64 48/162 2024-05-08T19:54:57.459 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-08T19:54:57.503 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T19:54:57.589 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 77/162 2024-05-08T19:54:57.615 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: oniguruma-6.8.2-2.1.el8_9.x86_64 49/162 2024-05-08T19:54:57.684 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-08T19:54:57.737 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T19:54:57.841 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-08T19:54:57.881 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jq-1.6-7.el8.x86_64 50/162 2024-05-08T19:54:57.920 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T19:54:58.097 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-08T19:54:58.106 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2024-05-08T19:54:58.216 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T19:54:58.286 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T19:54:58.366 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2024-05-08T19:54:58.436 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-08T19:54:58.486 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T19:54:58.586 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 53/162 2024-05-08T19:54:58.675 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T19:54:58.732 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-08T19:54:58.753 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 54/162 2024-05-08T19:54:58.840 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T19:54:58.989 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 55/162 2024-05-08T19:54:59.030 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-08T19:54:59.081 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T19:54:59.174 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.7-17.el8.x86_64 56/162 2024-05-08T19:54:59.236 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-08T19:54:59.276 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T19:54:59.413 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 57/162 2024-05-08T19:54:59.422 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-08T19:54:59.517 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T19:54:59.618 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/162 2024-05-08T19:54:59.636 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-08T19:54:59.707 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T19:54:59.783 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/162 2024-05-08T19:54:59.883 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-08T19:54:59.884 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T19:54:59.992 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/162 2024-05-08T19:55:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T19:55:00.120 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-08T19:55:00.332 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-08T19:55:00.348 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T19:55:00.463 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 61/162 2024-05-08T19:55:00.493 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T19:55:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-08T19:55:00.749 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T19:55:00.757 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 62/162 2024-05-08T19:55:00.831 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-08T19:55:00.995 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T19:55:01.000 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 63/162 2024-05-08T19:55:01.012 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T19:55:01.169 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T19:55:01.170 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T19:55:01.180 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 64/162 2024-05-08T19:55:01.397 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T19:55:01.422 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 65/162 2024-05-08T19:55:01.427 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T19:55:01.691 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T19:55:01.796 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 66/162 2024-05-08T19:55:01.918 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T19:55:02.068 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cryptography-3.2.1-7.el8_9.x86_64 67/162 2024-05-08T19:55:02.126 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T19:55:02.273 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T19:55:02.373 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 68/162 2024-05-08T19:55:02.470 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T19:55:02.542 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T19:55:02.579 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 69/162 2024-05-08T19:55:02.699 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T19:55:02.784 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/162 2024-05-08T19:55:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T19:55:02.976 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T19:55:03.028 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 71/162 2024-05-08T19:55:03.102 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T19:55:03.141 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T19:55:03.279 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2024-05-08T19:55:03.292 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T19:55:03.394 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T19:55:03.515 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T19:55:03.530 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2024-05-08T19:55:03.679 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T19:55:03.756 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T19:55:03.886 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T19:55:03.925 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T19:55:04.182 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T19:55:04.347 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/162 2024-05-08T19:55:04.410 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T19:55:04.575 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 75/162 2024-05-08T19:55:04.609 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T19:55:04.673 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T19:55:04.827 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T19:55:04.828 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:55:04.849 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 76/162 2024-05-08T19:55:04.938 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:55:05.022 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/162 2024-05-08T19:55:05.112 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T19:55:05.211 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 78/162 2024-05-08T19:55:05.412 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 79/162 2024-05-08T19:55:05.740 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 80/162 2024-05-08T19:55:05.906 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T19:55:05.985 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 81/162 2024-05-08T19:55:06.182 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 82/162 2024-05-08T19:55:06.257 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T19:55:06.339 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 83/162 2024-05-08T19:55:06.477 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T19:55:06.582 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 84/162 2024-05-08T19:55:06.767 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 85/162 2024-05-08T19:55:06.787 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T19:55:06.998 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 86/162 2024-05-08T19:55:07.021 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T19:55:07.164 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 87/162 2024-05-08T19:55:07.218 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T19:55:07.366 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 88/162 2024-05-08T19:55:07.636 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 89/162 2024-05-08T19:55:07.831 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 90/162 2024-05-08T19:55:07.980 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T19:55:08.024 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 91/162 2024-05-08T19:55:08.151 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:55:08.226 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:55:08.289 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-2.6-1.el8.noarch 92/162 2024-05-08T19:55:08.452 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T19:55:08.502 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 93/162 2024-05-08T19:55:08.702 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 94/162 2024-05-08T19:55:08.930 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 95/162 2024-05-08T19:55:08.992 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:09.269 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:09.891 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:10.116 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 96/162 2024-05-08T19:55:10.211 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:55:10.291 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:55:10.410 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:55:10.436 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 97/162 2024-05-08T19:55:10.681 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/162 2024-05-08T19:55:10.999 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 99/162 2024-05-08T19:55:11.412 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 100/162 2024-05-08T19:55:11.623 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 101/162 2024-05-08T19:55:12.138 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:12.409 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:12.478 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 102/162 2024-05-08T19:55:12.709 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:55:12.776 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 103/162 2024-05-08T19:55:12.959 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 104/162 2024-05-08T19:55:13.024 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:13.898 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:55:13.988 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:55:14.125 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:55:17.795 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:18.191 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:18.848 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 105/162 2024-05-08T19:55:19.153 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:55:19.249 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 106/162 2024-05-08T19:55:19.399 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:55:30.839 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:55:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-05-08T19:55:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-05-08T19:55:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /dev 2024-05-08T19:55:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /run 2024-05-08T19:55:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-05-08T19:55:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-05-08T19:55:30.840 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-05-08T19:55:30.840 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-05-08T19:55:30.840 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /dev 2024-05-08T19:55:30.840 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:55:31.225 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:55:32.865 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:55:33.057 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:55:33.276 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:55:33.465 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /run 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /dev 2024-05-08T19:55:33.639 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:55:33.940 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:55:33.990 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:55:34.115 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:55:34.132 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:55:35.622 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:55:35.834 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:55:35.952 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:55:36.052 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:55:36.126 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:55:36.237 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:55:36.271 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T19:55:36.475 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T19:55:36.711 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:55:36.737 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:55:36.878 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:55:36.896 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:55:37.765 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:55:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:55:38.636 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:55:38.836 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:55:38.970 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T19:55:39.010 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:55:39.181 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:55:39.220 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T19:55:39.273 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:55:39.475 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:55:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T19:55:39.856 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:55:39.895 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:55:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:55:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:55:40.498 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:55:40.741 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 107/162 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /run 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2024-05-08T19:55:41.416 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2024-05-08T19:55:41.417 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:55:41.463 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T19:55:41.679 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:55:41.702 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:55:41.713 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:55:41.813 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:55:41.902 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:55:41.956 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:55:41.995 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:55:41.998 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:55:42.214 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:55:42.328 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T19:55:42.492 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:55:42.530 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:55:42.560 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:55:42.720 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:55:42.732 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:55:42.781 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:55:43.625 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 108/162 2024-05-08T19:55:43.849 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:55:43.978 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T19:55:44.092 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 109/162 2024-05-08T19:55:44.199 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:55:44.234 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:55:44.253 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:55:44.444 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:55:44.486 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:55:44.669 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:55:44.779 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 110/162 2024-05-08T19:55:44.954 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:55:44.975 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 111/162 2024-05-08T19:55:45.014 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:55:45.210 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:55:47.044 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:55:47.222 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:55:47.227 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 112/162 2024-05-08T19:55:47.353 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 113/162 2024-05-08T19:55:47.582 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 114/162 2024-05-08T19:55:47.843 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:55:48.171 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T19:55:48.493 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T19:55:48.795 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T19:55:48.984 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 115/162 2024-05-08T19:55:49.238 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T19:55:49.264 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:55:49.572 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T19:55:49.647 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:55:49.802 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:55:49.816 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:55:50.048 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T19:55:50.209 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T19:55:50.339 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 116/162 2024-05-08T19:55:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T19:55:50.544 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:55:50.585 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T19:55:50.656 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 117/162 2024-05-08T19:55:50.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T19:55:51.159 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T19:55:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 118/162 2024-05-08T19:55:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:55:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 119/162 2024-05-08T19:55:51.542 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T19:55:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:55:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 120/162 2024-05-08T19:55:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T19:55:52.095 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:55:52.108 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:55:52.343 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T19:55:52.512 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T19:55:52.578 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:55:52.718 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T19:55:52.904 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:55:52.942 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:55:53.087 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 121/162 2024-05-08T19:55:53.322 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:55:53.364 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 122/162 2024-05-08T19:55:53.416 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T19:55:53.544 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:55:53.595 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 123/162 2024-05-08T19:55:53.769 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T19:55:53.811 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:55:53.957 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T19:55:54.162 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T19:55:54.199 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 124/162 2024-05-08T19:55:54.369 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T19:55:54.427 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:55:54.690 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T19:55:55.005 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T19:55:55.037 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:55:55.253 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:55:55.329 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:55:55.334 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:55:55.372 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:55:55.586 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:55:55.600 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:55:55.745 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:55:55.754 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:55:55.783 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T19:55:55.905 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T19:55:56.099 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T19:55:56.141 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T19:55:56.280 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T19:55:56.336 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T19:55:56.473 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T19:55:56.474 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:55:56.516 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T19:55:56.723 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:55:56.723 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:55:56.757 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T19:55:56.982 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:55:56.982 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:55:57.050 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T19:55:57.209 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:55:57.393 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T19:55:57.447 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T19:55:57.615 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:55:57.621 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:55:57.691 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:55:57.880 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T19:55:57.880 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:55:57.908 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:55:57.921 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:55:58.065 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:55:58.074 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:55:58.122 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:55:58.123 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:55:58.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T19:55:58.372 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:55:58.372 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:55:58.433 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T19:55:58.589 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:55:58.589 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:55:58.625 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T19:55:58.803 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T19:55:58.804 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:55:58.855 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:55:58.855 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:55:59.055 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:55:59.120 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:55:59.120 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:55:59.230 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T19:55:59.230 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:55:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:55:59.344 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:55:59.360 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 125/162 2024-05-08T19:55:59.596 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:55:59.825 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T19:56:00.026 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:56:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:56:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T19:56:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T19:56:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T19:56:00.095 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T19:56:00.096 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T19:56:00.097 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T19:56:00.114 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T19:56:00.114 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T19:56:00.114 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T19:56:00.115 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T19:56:00.116 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T19:56:00.117 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 75/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 77/162 2024-05-08T19:56:00.118 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 78/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 79/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 81/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 82/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 84/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 86/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 87/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 88/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 89/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 90/162 2024-05-08T19:56:00.119 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 91/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 92/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 93/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 94/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 95/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 96/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 97/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 98/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 99/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 100/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 101/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 102/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 103/162 2024-05-08T19:56:00.120 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.0.4-10.el8.x86_64 105/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.1-9.el8.x86_64 106/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 107/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 108/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 109/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 110/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 111/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 113/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 114/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 115/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 116/162 2024-05-08T19:56:00.121 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 117/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 118/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 119/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 120/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.1-8.el8.noarch 121/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpq-13.11-1.el8.x86_64 122/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-7.el8.x86_64 123/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 124/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 125/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 126/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 127/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 128/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 129/162 2024-05-08T19:56:00.122 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 130/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T19:56:00.123 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:56:00.124 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T19:56:00.125 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:56:00.125 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T19:56:00.125 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:56:00.125 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T19:56:00.277 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T19:56:00.277 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:56:00.460 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 126/162 2024-05-08T19:56:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:56:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:56:00.767 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:56:00.767 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:56:00.782 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:1.1.1k-12.el8_9.x86_64 127/162 2024-05-08T19:56:00.992 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:56:00.992 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:56:01.051 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2024-05-08T19:56:01.233 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:56:01.234 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:56:01.500 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:56:01.512 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 129/162 2024-05-08T19:56:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T19:56:01.684 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:56:01.862 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 130/162 2024-05-08T19:56:02.216 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:56:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2024-05-08T19:56:02.498 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : util-linux-user-2.32.1-44.el8_9.1.x86_64 132/162 2024-05-08T19:56:02.606 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:56:02.607 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:56:02.608 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T19:56:02.609 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T19:56:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T19:56:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T19:56:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T19:56:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T19:56:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T19:56:02.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T19:56:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T19:56:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T19:56:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T19:56:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T19:56:02.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T19:56:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T19:56:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T19:56:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T19:56:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T19:56:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T19:56:02.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T19:56:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T19:56:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T19:56:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T19:56:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T19:56:02.613 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T19:56:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T19:56:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T19:56:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T19:56:02.614 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T19:56:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T19:56:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T19:56:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T19:56:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T19:56:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T19:56:02.615 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T19:56:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T19:56:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T19:56:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T19:56:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T19:56:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T19:56:02.616 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T19:56:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T19:56:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T19:56:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T19:56:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T19:56:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T19:56:02.617 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-08T19:56:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-08T19:56:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-08T19:56:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-08T19:56:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-08T19:56:02.618 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-08T19:56:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-08T19:56:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-08T19:56:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-08T19:56:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-08T19:56:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-08T19:56:02.619 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-08T19:56:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-08T19:56:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-08T19:56:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-08T19:56:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-08T19:56:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-08T19:56:02.620 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-08T19:56:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-08T19:56:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-08T19:56:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-08T19:56:02.621 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-08T19:56:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-08T19:56:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-08T19:56:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-08T19:56:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-08T19:56:02.622 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-08T19:56:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T19:56:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T19:56:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T19:56:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T19:56:02.623 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T19:56:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T19:56:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T19:56:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T19:56:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T19:56:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T19:56:02.624 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T19:56:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T19:56:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T19:56:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T19:56:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T19:56:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T19:56:02.625 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T19:56:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T19:56:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T19:56:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T19:56:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T19:56:02.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T19:56:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T19:56:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T19:56:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T19:56:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T19:56:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T19:56:02.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T19:56:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T19:56:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T19:56:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T19:56:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T19:56:02.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T19:56:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T19:56:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T19:56:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T19:56:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T19:56:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T19:56:02.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T19:56:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T19:56:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T19:56:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T19:56:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T19:56:02.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T19:56:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T19:56:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T19:56:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T19:56:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T19:56:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T19:56:02.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T19:56:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T19:56:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T19:56:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T19:56:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T19:56:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:56:02.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T19:56:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:56:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T19:56:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:56:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T19:56:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:56:02.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T19:56:02.672 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2024-05-08T19:56:02.868 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 134/162 2024-05-08T19:56:05.537 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:56:05.867 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:56:05.911 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: postgresql-server-10.23-4.module+el8.9.0+21317+d 135/162 2024-05-08T19:56:06.506 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2024-05-08T19:56:06.887 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2024-05-08T19:56:07.130 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : xfsdump-3.1.8-7.el8_9.x86_64 138/162 2024-05-08T19:56:07.334 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 139/162 2024-05-08T19:56:07.526 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 140/162 2024-05-08T19:56:07.862 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 141/162 2024-05-08T19:56:08.199 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : openssl-1:1.1.1k-12.el8_9.x86_64 142/162 2024-05-08T19:56:08.424 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:56:08.510 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2024-05-08T19:56:08.750 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:56:08.765 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2024-05-08T19:56:08.916 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:56:08.927 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-15.e 145/162 2024-05-08T19:56:09.111 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2024-05-08T19:56:09.300 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2024-05-08T19:56:09.527 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2024-05-08T19:56:09.687 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2024-05-08T19:56:09.688 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:56:09.961 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2024-05-08T19:56:09.961 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:56:10.177 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T19:56:10.177 INFO:teuthology.orchestra.run.smithi132.stdout:Installed products updated. 2024-05-08T19:56:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2024-05-08T19:56:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:56:10.498 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2024-05-08T19:56:10.701 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.799 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.800 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.801 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-7.el8.x86_64 2024-05-08T19:56:10.802 INFO:teuthology.orchestra.run.smithi132.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.803 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:10.804 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T19:56:10.805 INFO:teuthology.orchestra.run.smithi132.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T19:56:10.806 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T19:56:10.807 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.808 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.809 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.810 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:10.810 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T19:56:10.810 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T19:56:10.810 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T19:56:10.810 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T19:56:10.810 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T19:56:10.811 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T19:56:10.811 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:56:10.811 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-05-08T19:56:10.921 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:56:11.014 DEBUG:teuthology.parallel:result is None 2024-05-08T19:56:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2024-05-08T19:56:11.151 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:56:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:56:11.619 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:56:11.893 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2024-05-08T19:56:11.894 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:56:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:56:12.119 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:56:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2024-05-08T19:56:12.385 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:56:12.643 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:56:12.818 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2024-05-08T19:56:12.819 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:56:13.103 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T19:56:13.103 INFO:teuthology.orchestra.run.smithi082.stdout:Installed products updated. 2024-05-08T19:56:13.724 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:56:13.724 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-05-08T19:56:13.724 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T19:56:13.724 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T19:56:13.724 INFO:teuthology.orchestra.run.smithi082.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T19:56:13.724 INFO:teuthology.orchestra.run.smithi082.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:13.725 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.726 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.727 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: jq-1.6-7.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T19:56:13.728 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T19:56:13.729 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:13.730 INFO:teuthology.orchestra.run.smithi082.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T19:56:13.731 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T19:56:13.732 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T19:56:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T19:56:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T19:56:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T19:56:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T19:56:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T19:56:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T19:56:13.733 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T19:56:13.734 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T19:56:13.735 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.736 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.737 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:13.737 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T19:56:13.737 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T19:56:13.737 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T19:56:13.737 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T19:56:13.737 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T19:56:13.738 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T19:56:13.738 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T19:56:13.738 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-08T19:56:13.840 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2024-05-08T19:56:13.840 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 1/162 2024-05-08T19:56:13.840 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2/162 2024-05-08T19:56:13.840 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 3/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 4/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1322.gd21e4 5/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 6/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 7/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 8/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 9/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 10/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 11/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 12/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 13/162 2024-05-08T19:56:13.841 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_ 14/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 15/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 16/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_6 17/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86 18/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 19/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el 20/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8. 21/162 2024-05-08T19:56:13.842 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_6 22/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 23/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 24/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 25/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 26/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 27/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 28/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96. 29/162 2024-05-08T19:56:13.843 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noa 30/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.n 31/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21 32/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el 33/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 34/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.e 35/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 36/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 37/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 38/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2024-05-08T19:56:13.844 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/162 2024-05-08T19:56:13.845 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/162 2024-05-08T19:56:13.846 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 72/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2024-05-08T19:56:13.847 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2024-05-08T19:56:13.848 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 88/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 89/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 90/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 91/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 92/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 93/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 94/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8_9.x86_64 95/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.9.0-5.el8_9.x86_64 96/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cryptography-3.2.1-7.el8_9.x86_64 97/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-15.e 98/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.32.1-44.el8_9.1.x86_64 99/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2024-05-08T19:56:13.849 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 111/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 112/162 2024-05-08T19:56:13.850 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 113/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 114/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 115/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 116/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 117/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 118/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 119/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 120/162 2024-05-08T19:56:13.851 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 121/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.1-8.el8.noarch 122/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libpq-13.11-1.el8.x86_64 123/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jq-1.6-7.el8.x86_64 124/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 125/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 126/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : oniguruma-6.8.2-2.1.el8_9.x86_64 127/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a 128/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-contrib-10.23-4.module+el8.9.0+21317+ 129/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : postgresql-server-10.23-4.module+el8.9.0+21317+d 130/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 131/162 2024-05-08T19:56:13.852 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 133/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 135/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 136/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 137/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 138/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 139/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 140/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:1.1.1k-12.el8_9.x86_64 141/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 142/162 2024-05-08T19:56:13.853 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8_9.x86_64 143/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 144/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsdump-3.1.8-7.el8_9.x86_64 145/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 146/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 147/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 148/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libblkid-2.32.1-44.el8_9.1.x86_64 149/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 150/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libfdisk-2.32.1-44.el8_9.1.x86_64 151/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 152/162 2024-05-08T19:56:13.854 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libmount-2.32.1-44.el8_9.1.x86_64 153/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 154/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsmartcols-2.32.1-44.el8_9.1.x86_64 155/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 156/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-2.32.1-44.el8_9.1.x86_64 157/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 158/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : util-linux-2.32.1-44.el8_9.1.x86_64 159/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 160/162 2024-05-08T19:56:13.855 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : util-linux-user-2.32.1-44.el8_9.1.x86_64 161/162 2024-05-08T19:56:13.954 DEBUG:teuthology.parallel:result is None 2024-05-08T19:56:25.685 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 162/162 2024-05-08T19:56:25.685 INFO:teuthology.orchestra.run.smithi033.stdout:Installed products updated. 2024-05-08T19:56:26.384 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:56:26.384 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2024-05-08T19:56:26.384 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-0.189-3.el8.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libs-0.189-3.el8.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: iproute-6.2.0-5.el8_9.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: libblkid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: libfdisk-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: libmount-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: libsmartcols-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-libs-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:26.385 INFO:teuthology.orchestra.run.smithi033.stdout: util-linux-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: util-linux-user-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: xfsdump-3.1.8-7.el8_9.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: NetworkManager-initscripts-updown-1:1.40.16-15.el8_9.noarch 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.1-8.el8.noarch 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.0.4-10.el8.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.386 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.387 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:18.2.2-1322.gd21e4f96.el8.noarch 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.1-9.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.7-17.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-08T19:56:26.388 INFO:teuthology.orchestra.run.smithi033.stdout: jq-1.6-7.el8.x86_64 2024-05-08T19:56:26.389 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-08T19:56:26.389 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2024-05-08T19:56:26.389 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-08T19:56:26.389 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.389 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.389 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.389 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2024-05-08T19:56:26.390 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-8.5.0-20.el8.x86_64 2024-05-08T19:56:26.390 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-08T19:56:26.390 INFO:teuthology.orchestra.run.smithi033.stdout: libpq-13.11-1.el8.x86_64 2024-05-08T19:56:26.390 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-8.5.0-20.el8.x86_64 2024-05-08T19:56:26.390 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.9.0-5.el8_9.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-0.11.4-3.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel-2.9-5.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-08T19:56:26.391 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.32.1-44.el8_9.1.x86_64 2024-05-08T19:56:26.392 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel-0.3.0-5.el8.x86_64 2024-05-08T19:56:26.392 INFO:teuthology.orchestra.run.smithi033.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-08T19:56:26.392 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-08T19:56:26.392 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma-6.8.2-2.1.el8_9.x86_64 2024-05-08T19:56:26.392 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.15-6.el8.x86_64 2024-05-08T19:56:26.392 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads-0.3.15-6.el8.x86_64 2024-05-08T19:56:26.392 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:1.1.1k-12.el8_9.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel-10.32-2.el8.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16-10.32-2.el8.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32-10.32-2.el8.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-contrib-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: postgresql-server-10.23-4.module+el8.9.0+21317+d2c6bf8a.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-08T19:56:26.393 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-3.2.1-7.el8_9.x86_64 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-08T19:56:26.394 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.10.1-3.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-08T19:56:26.395 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-2.6-1.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.396 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-08T19:56:26.397 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:18.2.2-1322.gd21e4f96.el8.x86_64 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-08T19:56:26.398 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-08T19:56:26.399 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2024-05-08T19:56:26.399 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:56:26.399 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2024-05-08T19:56:26.625 DEBUG:teuthology.parallel:result is None 2024-05-08T19:56:26.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:56:26.771 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T19:56:26.799 INFO:teuthology.orchestra.run.smithi033.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T19:56:26.799 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T19:56:26.799 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T19:56:26.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:56:27.017 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T19:56:27.047 INFO:teuthology.orchestra.run.smithi082.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T19:56:27.047 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T19:56:27.047 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T19:56:27.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:56:27.188 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T19:56:27.218 INFO:teuthology.orchestra.run.smithi132.stdout:18.2.2-1322.gd21e4f96.el8 2024-05-08T19:56:27.218 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1322.gd21e4f96.el8 2024-05-08T19:56:27.218 INFO:teuthology.task.install:The correct ceph version 18.2.2-1322.gd21e4f96 is installed. 2024-05-08T19:56:27.220 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T19:56:27.221 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:56:27.221 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T19:56:27.274 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:56:27.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T19:56:27.323 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:56:27.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T19:56:27.374 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T19:56:27.374 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:56:27.374 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T19:56:27.409 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T19:56:27.484 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:56:27.484 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T19:56:27.516 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T19:56:27.586 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:56:27.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T19:56:27.618 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T19:56:27.688 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T19:56:27.688 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:56:27.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T19:56:27.723 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T19:56:27.798 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:56:27.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T19:56:27.828 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T19:56:27.897 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:56:27.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T19:56:27.927 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T19:56:27.996 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T19:56:27.996 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:56:27.996 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T19:56:28.031 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T19:56:28.105 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:56:28.105 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T19:56:28.135 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T19:56:28.204 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:56:28.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T19:56:28.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T19:56:28.302 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-08T19:56:28.406 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-08T19:56:28.406 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:56:28.407 INFO:tasks.cephadm:Cluster fsid is 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:56:28.407 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-08T19:56:28.407 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.33', 'mon.b': '172.21.15.82', 'mon.c': '172.21.15.132'} 2024-05-08T19:56:28.407 INFO:tasks.cephadm:First mon is mon.a on smithi033 2024-05-08T19:56:28.407 INFO:tasks.cephadm:First mgr is x 2024-05-08T19:56:28.408 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-08T19:56:28.408 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2024-05-08T19:56:28.444 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-05-08T19:56:28.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname $(hostname -s) 2024-05-08T19:56:28.504 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-08T19:56:28.504 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:56:28.721 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/79222/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1322-gd21e4f96', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1322.gd21e4f96'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 19:11:17.581213', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.150423-reef', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'archs': ['arm64', 'source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'd21e4f961318b56f0d915caa2490c3711bf13c34', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/79220/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.2-1322-gd21e4f96', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.2-1322.gd21e4f96'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2024-05-08 18:26:58.979379', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240508.150423-reef', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-08T19:56:28.938 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20240508.150423-reef, sha1 d21e4f961318b56f0d915caa2490c3711bf13c34 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T19:56:28.939 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm 2024-05-08T19:56:28.939 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:29.455 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 19:56 /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:29.455 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:30.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 19:56 /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:30.122 DEBUG:teuthology.orchestra.run.smithi132:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240508.150423-reef/d21e4f961318b56f0d915caa2490c3711bf13c34/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:30.591 INFO:teuthology.orchestra.run.smithi132.stdout:-rw-rw-r--. 1 ubuntu ubuntu 703022 May 8 19:56 /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:30.592 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:30.615 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:30.637 DEBUG:teuthology.orchestra.run.smithi132:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T19:56:30.675 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 on all hosts... 2024-05-08T19:56:30.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T19:56:30.678 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T19:56:30.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 pull 2024-05-08T19:56:31.627 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T19:56:31.643 INFO:teuthology.orchestra.run.smithi132.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T19:56:32.621 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T19:57:04.157 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T19:57:04.157 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T19:57:04.157 INFO:teuthology.orchestra.run.smithi033.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T19:57:04.158 INFO:teuthology.orchestra.run.smithi033.stdout: "repo_digests": [ 2024-05-08T19:57:04.158 INFO:teuthology.orchestra.run.smithi033.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T19:57:04.158 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T19:57:04.158 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T19:57:19.270 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-05-08T19:57:19.270 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T19:57:19.270 INFO:teuthology.orchestra.run.smithi132.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T19:57:19.270 INFO:teuthology.orchestra.run.smithi132.stdout: "repo_digests": [ 2024-05-08T19:57:19.271 INFO:teuthology.orchestra.run.smithi132.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T19:57:19.271 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2024-05-08T19:57:19.271 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-05-08T19:57:24.923 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T19:57:24.923 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable)", 2024-05-08T19:57:24.923 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c", 2024-05-08T19:57:24.924 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-05-08T19:57:24.924 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e8ec72da4fcdc307fe9b94614a1c07d7ebae386ad20c4998c8d80e9b80a48985" 2024-05-08T19:57:24.924 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T19:57:24.924 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T19:57:24.946 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2024-05-08T19:57:24.988 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-05-08T19:57:25.018 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph 2024-05-08T19:57:25.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2024-05-08T19:57:25.091 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-05-08T19:57:25.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /etc/ceph 2024-05-08T19:57:25.150 INFO:tasks.cephadm:Writing seed config... 2024-05-08T19:57:25.151 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-05-08T19:57:25.151 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-08T19:57:25.151 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-08T19:57:25.151 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-08T19:57:25.151 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-08T19:57:25.151 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-08T19:57:25.151 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-08T19:57:25.152 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-08T19:57:25.153 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-08T19:57:25.154 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-08T19:57:25.155 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:57:25.155 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-08T19:57:25.177 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0ee61dd4-0d75-11ef-bc97-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-08T19:57:25.177 DEBUG:teuthology.orchestra.run.smithi033:mon.a> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a.service 2024-05-08T19:57:25.219 DEBUG:teuthology.orchestra.run.smithi033:mgr.x> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.x.service 2024-05-08T19:57:25.253 INFO:journalctl@ceph.mon.a.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T19:57:25.254 INFO:tasks.cephadm:Bootstrapping... 2024-05-08T19:57:25.255 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 -v bootstrap --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.33 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-08T19:57:25.286 INFO:journalctl@ceph.mgr.x.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T19:57:25.442 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2024-05-08T19:57:25.443 INFO:teuthology.orchestra.run.smithi033.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34', '-v', 'bootstrap', '--fsid', '0ee61dd4-0d75-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.33', '--skip-admin-label'] 2024-05-08T19:57:25.490 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 4.6.1 2024-05-08T19:57:25.491 INFO:teuthology.orchestra.run.smithi033.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-08T19:57:25.491 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying podman|docker is present... 2024-05-08T19:57:25.526 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 4.6.1 2024-05-08T19:57:25.526 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying lvm2 is present... 2024-05-08T19:57:25.526 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying time synchronization is in place... 2024-05-08T19:57:25.534 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T19:57:25.534 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T19:57:25.541 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T19:57:25.541 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-05-08T19:57:25.548 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-05-08T19:57:25.554 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-05-08T19:57:25.555 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-05-08T19:57:25.555 INFO:teuthology.orchestra.run.smithi033.stdout:Repeating the final host check... 2024-05-08T19:57:25.588 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout 4.6.1 2024-05-08T19:57:25.588 INFO:teuthology.orchestra.run.smithi033.stdout:podman (/bin/podman) version 4.6.1 is present 2024-05-08T19:57:25.588 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl is present 2024-05-08T19:57:25.589 INFO:teuthology.orchestra.run.smithi033.stdout:lvcreate is present 2024-05-08T19:57:25.595 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T19:57:25.595 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T19:57:25.602 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T19:57:25.602 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-05-08T19:57:25.608 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout enabled 2024-05-08T19:57:25.615 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout active 2024-05-08T19:57:25.615 INFO:teuthology.orchestra.run.smithi033.stdout:Unit chronyd.service is enabled and running 2024-05-08T19:57:25.615 INFO:teuthology.orchestra.run.smithi033.stdout:Host looks OK 2024-05-08T19:57:25.615 INFO:teuthology.orchestra.run.smithi033.stdout:Cluster fsid: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:25.616 INFO:teuthology.orchestra.run.smithi033.stdout:Acquiring lock 140616644807144 on /run/cephadm/0ee61dd4-0d75-11ef-bc97-c7b262605968.lock 2024-05-08T19:57:25.616 INFO:teuthology.orchestra.run.smithi033.stdout:Lock 140616644807144 acquired on /run/cephadm/0ee61dd4-0d75-11ef-bc97-c7b262605968.lock 2024-05-08T19:57:25.616 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 3300 ... 2024-05-08T19:57:25.617 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying IP 172.21.15.33 port 6789 ... 2024-05-08T19:57:25.617 INFO:teuthology.orchestra.run.smithi033.stdout:Base mon IP(s) is [172.21.15.33:3300, 172.21.15.33:6789], mon addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-05-08T19:57:25.621 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2024-05-08T19:57:25.621 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 metric 100 2024-05-08T19:57:25.624 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-08T19:57:25.624 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-05-08T19:57:25.624 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1780sec hoplimit 64 pref medium 2024-05-08T19:57:25.627 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-08T19:57:25.627 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-08T19:57:25.628 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T19:57:25.628 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout 3: ens1f0: mtu 1500 state UP qlen 1000 2024-05-08T19:57:25.628 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-05-08T19:57:25.628 INFO:teuthology.orchestra.run.smithi033.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T19:57:25.628 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-05-08T19:57:25.628 INFO:teuthology.orchestra.run.smithi033.stdout:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2024-05-08T19:57:25.628 INFO:teuthology.orchestra.run.smithi033.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-08T19:57:25.629 INFO:teuthology.orchestra.run.smithi033.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-08T19:57:25.630 INFO:teuthology.orchestra.run.smithi033.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T19:57:27.198 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stdout af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c 2024-05-08T19:57:27.198 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34... 2024-05-08T19:57:27.198 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Getting image source signatures 2024-05-08T19:57:27.198 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:7850648fa4707607dddc5eec7674b8c9296086cf87f20a8b1acf1b014b952e9f 2024-05-08T19:57:27.198 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-08T19:57:27.199 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Copying config sha256:af23193ff691dd58bee78ea954b569105e41c41def20b81a25baa1d30500ad1c 2024-05-08T19:57:27.199 INFO:teuthology.orchestra.run.smithi033.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-08T19:57:29.423 INFO:teuthology.orchestra.run.smithi033.stdout:ceph: stdout ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T19:57:29.423 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph version: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T19:57:29.423 INFO:teuthology.orchestra.run.smithi033.stdout:Extracting ceph user uid/gid from container image... 2024-05-08T19:57:32.303 INFO:teuthology.orchestra.run.smithi033.stdout:stat: stdout 167 167 2024-05-08T19:57:32.303 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial keys... 2024-05-08T19:57:35.340 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQAt2Ttm6Y3aHBAAG7D3mF2WeO4Kpa030bFAXw== 2024-05-08T19:57:36.447 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQAw2TtmaCrGBRAAlUC1HVZ3zUmKBklAkq8qGw== 2024-05-08T19:57:37.061 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph-authtool: stdout AQAw2TtmFjp6KxAAa+Yokb+J8S3wq9aKn50Fcw== 2024-05-08T19:57:37.062 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial monmap... 2024-05-08T19:57:37.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T19:57:37.730 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool for a [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = pacific 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: set fsid to 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:57:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mon... 2024-05-08T19:57:38.406 INFO:teuthology.orchestra.run.smithi033.stdout:create mon.a on 2024-05-08T19:57:38.549 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-05-08T19:57:38.651 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-08T19:57:38.789 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968.target. 2024-05-08T19:57:38.789 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968.target. 2024-05-08T19:57:38.990 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a 2024-05-08T19:57:38.990 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-08T19:57:39.091 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968.target.wants/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@.service. 2024-05-08T19:57:39.528 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T19:57:39.529 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-05-08T19:57:39.537 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T19:57:39.537 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-05-08T19:57:39.538 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-05-08T19:57:39.538 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T19:57:39.538 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon to start... 2024-05-08T19:57:39.538 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mon... 2024-05-08T19:57:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:39 smithi033 systemd[1]: Started Ceph mon.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:57:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:39 smithi033 ceph-mon[42009]: mkfs 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:39 smithi033 ceph-mon[42009]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T19:57:40.587 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout cluster: 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout id: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout services: 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.669034s) 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-08T19:57:40.594 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout data: 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout pgs: 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.143+0000 7f156ac5f700 1 Processor -- start 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.143+0000 7f156ac5f700 1 -- start start 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.144+0000 7f156ac5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564109740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.144+0000 7f156ac5f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1564079e90 con 0x7f1564107350 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.144+0000 7f15689fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.144+0000 7f15689fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564109740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47546/0 (socket says 172.21.15.33:47546) 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.144+0000 7f15689fb700 1 -- 172.21.15.33:0/962142871 learned_addr learned my addr 172.21.15.33:0/962142871 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:40.595 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.144+0000 7f15689fb700 1 -- 172.21.15.33:0/962142871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1564109c80 con 0x7f1564107350 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.145+0000 7f15689fb700 1 --2- 172.21.15.33:0/962142871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564109740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f15580098a0 tx=0x7f1558009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0fe9e03548916b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.145+0000 7f15637fe700 1 -- 172.21.15.33:0/962142871 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1558004160 con 0x7f1564107350 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.145+0000 7f15637fe700 1 -- 172.21.15.33:0/962142871 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15580042c0 con 0x7f1564107350 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.145+0000 7f15637fe700 1 -- 172.21.15.33:0/962142871 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f15580045a0 con 0x7f1564107350 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.145+0000 7f156ac5f700 1 -- 172.21.15.33:0/962142871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 msgr2=0x7f1564109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.145+0000 7f156ac5f700 1 --2- 172.21.15.33:0/962142871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564109740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f15580098a0 tx=0x7f1558009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.146+0000 7f156ac5f700 1 -- 172.21.15.33:0/962142871 shutdown_connections 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.146+0000 7f156ac5f700 1 --2- 172.21.15.33:0/962142871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564109740 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.146+0000 7f156ac5f700 1 -- 172.21.15.33:0/962142871 >> 172.21.15.33:0/962142871 conn(0x7f1564100e00 msgr2=0x7f1564103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.146+0000 7f156ac5f700 1 -- 172.21.15.33:0/962142871 shutdown_connections 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.146+0000 7f156ac5f700 1 -- 172.21.15.33:0/962142871 wait complete. 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.146+0000 7f156ac5f700 1 Processor -- start 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f156ac5f700 1 -- start start 2024-05-08T19:57:40.596 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f156ac5f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564199d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f156ac5f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156419a290 con 0x7f1564107350 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f15689fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564199d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f15689fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564199d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47550/0 (socket says 172.21.15.33:47550) 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f15689fb700 1 -- 172.21.15.33:0/2256598874 learned_addr learned my addr 172.21.15.33:0/2256598874 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f15689fb700 1 -- 172.21.15.33:0/2256598874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558009550 con 0x7f1564107350 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.147+0000 7f15689fb700 1 --2- 172.21.15.33:0/2256598874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564199d50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f15640792d0 tx=0x7f1558004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.148+0000 7f1561ffb700 1 -- 172.21.15.33:0/2256598874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1558011630 con 0x7f1564107350 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.148+0000 7f1561ffb700 1 -- 172.21.15.33:0/2256598874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1558011790 con 0x7f1564107350 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.148+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156419a490 con 0x7f1564107350 2024-05-08T19:57:40.597 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.148+0000 7f1561ffb700 1 -- 172.21.15.33:0/2256598874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1558011a30 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.148+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156419a930 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.148+0000 7f1561ffb700 1 -- 172.21.15.33:0/2256598874 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f1558022070 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.148+0000 7f1561ffb700 1 -- 172.21.15.33:0/2256598874 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f155801c450 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.149+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1564193bc0 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.151+0000 7f1561ffb700 1 -- 172.21.15.33:0/2256598874 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f155801b450 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.228+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f156410a1e0 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.228+0000 7f1561ffb700 1 -- 172.21.15.33:0/2256598874 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f155801b5f0 con 0x7f1564107350 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.229+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 msgr2=0x7f1564199d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.229+0000 7f156ac5f700 1 --2- 172.21.15.33:0/2256598874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564199d50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f15640792d0 tx=0x7f1558004750 comp rx=0 tx=0).stop 2024-05-08T19:57:40.598 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.229+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 shutdown_connections 2024-05-08T19:57:40.599 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.229+0000 7f156ac5f700 1 --2- 172.21.15.33:0/2256598874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1564107350 0x7f1564199d50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:40.599 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.229+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 >> 172.21.15.33:0/2256598874 conn(0x7f1564100e00 msgr2=0x7f1564103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:40.599 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.229+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 shutdown_connections 2024-05-08T19:57:40.599 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:40.229+0000 7f156ac5f700 1 -- 172.21.15.33:0/2256598874 wait complete. 2024-05-08T19:57:40.599 INFO:teuthology.orchestra.run.smithi033.stdout:mon is available 2024-05-08T19:57:40.599 INFO:teuthology.orchestra.run.smithi033.stdout:Assimilating anything we can from ceph.conf... 2024-05-08T19:57:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:40 smithi033 ceph-mon[42009]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T19:57:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:40 smithi033 ceph-mon[42009]: monmap e1: 1 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:57:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:40 smithi033 ceph-mon[42009]: fsmap 2024-05-08T19:57:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:40 smithi033 ceph-mon[42009]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T19:57:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:40 smithi033 ceph-mon[42009]: mgrmap e1: no daemons active 2024-05-08T19:57:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:40 smithi033 ceph-mon[42009]: from='client.? 172.21.15.33:0/2256598874' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-08T19:57:41.484 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:41.484 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T19:57:41.485 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.012+0000 7f717a9e7700 1 Processor -- start 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.012+0000 7f717a9e7700 1 -- start start 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.012+0000 7f717a9e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f7174105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.012+0000 7f717a9e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71741061b0 con 0x7f71741057c0 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7173fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f7174105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7173fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f7174105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47554/0 (socket says 172.21.15.33:47554) 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7173fff700 1 -- 172.21.15.33:0/949072706 learned_addr learned my addr 172.21.15.33:0/949072706 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7173fff700 1 -- 172.21.15.33:0/949072706 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71741069c0 con 0x7f71741057c0 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7173fff700 1 --2- 172.21.15.33:0/949072706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f7174105be0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f716400bb40 tx=0x7f716400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5822648115c970 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7172ffd700 1 -- 172.21.15.33:0/949072706 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f716400dbe0 con 0x7f71741057c0 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7172ffd700 1 -- 172.21.15.33:0/949072706 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400dd40 con 0x7f71741057c0 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.013+0000 7f7172ffd700 1 -- 172.21.15.33:0/949072706 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7164004030 con 0x7f71741057c0 2024-05-08T19:57:41.486 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.014+0000 7f717a9e7700 1 -- 172.21.15.33:0/949072706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 msgr2=0x7f7174105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.014+0000 7f717a9e7700 1 --2- 172.21.15.33:0/949072706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f7174105be0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f716400bb40 tx=0x7f716400be50 comp rx=0 tx=0).stop 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.014+0000 7f717a9e7700 1 -- 172.21.15.33:0/949072706 shutdown_connections 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.014+0000 7f717a9e7700 1 --2- 172.21.15.33:0/949072706 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f7174105be0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.014+0000 7f717a9e7700 1 -- 172.21.15.33:0/949072706 >> 172.21.15.33:0/949072706 conn(0x7f7174100dc0 msgr2=0x7f71741031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.014+0000 7f717a9e7700 1 -- 172.21.15.33:0/949072706 shutdown_connections 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.014+0000 7f717a9e7700 1 -- 172.21.15.33:0/949072706 wait complete. 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f717a9e7700 1 Processor -- start 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f717a9e7700 1 -- start start 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f717a9e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f717419bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f717a9e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717419c530 con 0x7f71741057c0 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f7173fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f717419bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f7173fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f717419bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47556/0 (socket says 172.21.15.33:47556) 2024-05-08T19:57:41.487 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f7173fff700 1 -- 172.21.15.33:0/3155860824 learned_addr learned my addr 172.21.15.33:0/3155860824 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.015+0000 7f7173fff700 1 -- 172.21.15.33:0/3155860824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716400b7f0 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f7173fff700 1 --2- 172.21.15.33:0/3155860824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f717419bff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f716400b340 tx=0x7f7164004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7164003d80 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164010470 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7164010750 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717419c730 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717419cbd0 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7164010c00 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.016+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f716402c3f0 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.017+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7174195ca0 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.019+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7164023440 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.093+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f7174106f20 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.097+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f71640235e0 con 0x7f71741057c0 2024-05-08T19:57:41.488 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.097+0000 7f71717fa700 1 -- 172.21.15.33:0/3155860824 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f716402c600 con 0x7f71741057c0 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.098+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 msgr2=0x7f717419bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.098+0000 7f717a9e7700 1 --2- 172.21.15.33:0/3155860824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f717419bff0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f716400b340 tx=0x7f7164004750 comp rx=0 tx=0).stop 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.098+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 shutdown_connections 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.098+0000 7f717a9e7700 1 --2- 172.21.15.33:0/3155860824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71741057c0 0x7f717419bff0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.098+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 >> 172.21.15.33:0/3155860824 conn(0x7f7174100dc0 msgr2=0x7f7174192de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.098+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 shutdown_connections 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.098+0000 7f717a9e7700 1 -- 172.21.15.33:0/3155860824 wait complete. 2024-05-08T19:57:41.489 INFO:teuthology.orchestra.run.smithi033.stdout:Generating new minimal ceph.conf... 2024-05-08T19:57:41.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:41 smithi033 ceph-mon[42009]: from='client.? 172.21.15.33:0/3155860824' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T19:57:41.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:41 smithi033 ceph-mon[42009]: from='client.? 172.21.15.33:0/3155860824' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.915+0000 7f080fe55700 1 Processor -- start 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.915+0000 7f080fe55700 1 -- start start 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.915+0000 7f080fe55700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080807a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.915+0000 7f080fe55700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080807a8d0 con 0x7f080807be50 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.916+0000 7f080dbf1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080807a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.916+0000 7f080dbf1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080807a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47572/0 (socket says 172.21.15.33:47572) 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.916+0000 7f080dbf1700 1 -- 172.21.15.33:0/619548183 learned_addr learned my addr 172.21.15.33:0/619548183 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.916+0000 7f080dbf1700 1 -- 172.21.15.33:0/619548183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080807aa10 con 0x7f080807be50 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.916+0000 7f080dbf1700 1 --2- 172.21.15.33:0/619548183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080807a300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f08040098a0 tx=0x7f0804009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4dd2cfa161dc69 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.916+0000 7f080cbef700 1 -- 172.21.15.33:0/619548183 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0804004160 con 0x7f080807be50 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.917+0000 7f080cbef700 1 -- 172.21.15.33:0/619548183 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f08040042c0 con 0x7f080807be50 2024-05-08T19:57:42.351 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.917+0000 7f080cbef700 1 -- 172.21.15.33:0/619548183 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0804011ac0 con 0x7f080807be50 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.917+0000 7f080fe55700 1 -- 172.21.15.33:0/619548183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 msgr2=0x7f080807a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.917+0000 7f080fe55700 1 --2- 172.21.15.33:0/619548183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080807a300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f08040098a0 tx=0x7f0804009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.917+0000 7f080fe55700 1 -- 172.21.15.33:0/619548183 shutdown_connections 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.917+0000 7f080fe55700 1 --2- 172.21.15.33:0/619548183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080807a300 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.917+0000 7f080fe55700 1 -- 172.21.15.33:0/619548183 >> 172.21.15.33:0/619548183 conn(0x7f0808101f10 msgr2=0x7f0808104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.918+0000 7f080fe55700 1 -- 172.21.15.33:0/619548183 shutdown_connections 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.918+0000 7f080fe55700 1 -- 172.21.15.33:0/619548183 wait complete. 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.918+0000 7f080fe55700 1 Processor -- start 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.918+0000 7f080fe55700 1 -- start start 2024-05-08T19:57:42.352 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f080fe55700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f080fe55700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080819cdf0 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f080dbf1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f080dbf1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080819c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47574/0 (socket says 172.21.15.33:47574) 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f080dbf1700 1 -- 172.21.15.33:0/227061883 learned_addr learned my addr 172.21.15.33:0/227061883 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f080dbf1700 1 -- 172.21.15.33:0/227061883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804009550 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f080dbf1700 1 --2- 172.21.15.33:0/227061883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080819c8b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fb0 tx=0x7f0804011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f07feffd700 1 -- 172.21.15.33:0/227061883 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08040038b0 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.919+0000 7f07feffd700 1 -- 172.21.15.33:0/227061883 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0804003a10 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.920+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080819cff0 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.920+0000 7f07feffd700 1 -- 172.21.15.33:0/227061883 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08040195e0 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.920+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080819d490 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.920+0000 7f07feffd700 1 -- 172.21.15.33:0/227061883 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0804019b70 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.920+0000 7f07feffd700 1 -- 172.21.15.33:0/227061883 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0804024730 con 0x7f080807be50 2024-05-08T19:57:42.353 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.921+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080810ccc0 con 0x7f080807be50 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.923+0000 7f07feffd700 1 -- 172.21.15.33:0/227061883 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0804003b80 con 0x7f080807be50 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.997+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f080810ce80 con 0x7f080807be50 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.997+0000 7f07feffd700 1 -- 172.21.15.33:0/227061883 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f080401a9f0 con 0x7f080807be50 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.998+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 msgr2=0x7f080819c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.998+0000 7f080fe55700 1 --2- 172.21.15.33:0/227061883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080819c8b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fb0 tx=0x7f0804011b20 comp rx=0 tx=0).stop 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.998+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 shutdown_connections 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.998+0000 7f080fe55700 1 --2- 172.21.15.33:0/227061883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f080807be50 0x7f080819c8b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.998+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 >> 172.21.15.33:0/227061883 conn(0x7f0808101f10 msgr2=0x7f0808102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.998+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 shutdown_connections 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:41.998+0000 7f080fe55700 1 -- 172.21.15.33:0/227061883 wait complete. 2024-05-08T19:57:42.354 INFO:teuthology.orchestra.run.smithi033.stdout:Restarting the monitor... 2024-05-08T19:57:42.566 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:42 smithi033 systemd[1]: Stopping Ceph mon.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T19:57:42.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:42 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-a[41986]: 2024-05-08T19:57:42.577+0000 7f6f3af16700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T19:57:42.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:42 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-a[41986]: 2024-05-08T19:57:42.577+0000 7f6f3af16700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-08T19:57:43.154 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:42 smithi033 bash[42333]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-a 2024-05-08T19:57:43.448 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a.service: Succeeded. 2024-05-08T19:57:43.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 systemd[1]: Stopped Ceph mon.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:57:43.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 systemd[1]: Starting Ceph mon.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T19:57:43.512 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 bash[42451]: 32d7ae85931a465cdb1c6780636d9355b9fe49cfd5d869bbbd81ac41133ee737 2024-05-08T19:57:43.512 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T19:57:43.514 INFO:teuthology.orchestra.run.smithi033.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-08T19:57:43.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-08T19:57:43.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: pidfile_write: ignore empty --pid-file 2024-05-08T19:57:43.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 systemd[1]: Started Ceph mon.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:57:43.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: load: jerasure load: lrc 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: RocksDB version: 7.9.2 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Git sha 0 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: DB SUMMARY 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: DB Session ID: 2WMU8A7P8PAOW01ZFZA8 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: CURRENT file: CURRENT 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98569 ; 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.error_if_exists: 0 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.create_if_missing: 0 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.paranoid_checks: 1 2024-05-08T19:57:43.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.env: 0x56313c12c820 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.info_log: 0x56313de43520 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.statistics: (nil) 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.use_fsync: 0 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_log_file_size: 0 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.allow_fallocate: 1 2024-05-08T19:57:43.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.use_direct_reads: 0 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.db_log_dir: 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.wal_dir: 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T19:57:43.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.write_buffer_manager: 0x56313d0d8320 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.unordered_write: 0 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T19:57:43.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.row_cache: None 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.wal_filter: None 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.two_write_queues: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.wal_compression: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.atomic_flush: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.log_readahead_size: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T19:57:43.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_background_jobs: 2 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_background_compactions: -1 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_subcompactions: 1 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T19:57:43.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_open_files: -1 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_background_flushes: -1 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Compression algorithms supported: 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kZSTD supported: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kXpressCompression supported: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kZlibCompression supported: 1 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kSnappyCompression supported: 1 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kLZ4Compression supported: 1 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: kBZip2Compression supported: 0 2024-05-08T19:57:43.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.merge_operator: 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_filter: None 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56313de43620) 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks: 1 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout: pin_top_level_index_and_filter: 1 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_type: 0 2024-05-08T19:57:43.831 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_index_type: 0 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_shortening: 1 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: checksum: 4 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: no_block_cache: 0 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache: 0x56313d15b1f0 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_name: BinnedLRUCache 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_options: 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: capacity : 536870912 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_shard_bits : 4 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: strict_capacity_limit : 0 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: high_pri_pool_ratio: 0.000 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_cache_compressed: (nil) 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: persistent_cache: (nil) 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size: 4096 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_size_deviation: 10 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_restart_interval: 16 2024-05-08T19:57:43.832 INFO:journalctl@ceph.mon.a.smithi033.stdout: index_block_restart_interval: 1 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: metadata_block_size: 4096 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: partition_filters: 0 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: use_delta_encoding: 1 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: filter_policy: bloomfilter 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: whole_key_filtering: 1 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: verify_compression: 0 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: read_amp_bytes_per_bit: 0 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: format_version: 5 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_index_compression: 1 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: block_align: 0 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: max_auto_readahead_size: 262144 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: prepopulate_block_cache: 0 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: initial_auto_readahead_size: 8192 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T19:57:43.833 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression: NoCompression 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.num_levels: 7 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T19:57:43.834 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T19:57:43.835 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T19:57:43.836 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T19:57:43.837 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.table_properties_collectors: 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.inplace_update_support: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.bloom_locality: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.max_successive_merges: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.ttl: 2592000 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T19:57:43.838 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.enable_blob_files: false 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.min_blob_size: 0 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cc319c9a-0190-4ae0-b71e-d75d543a4058 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198263530466, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-08T19:57:43.839 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198263531725, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93849, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 311, "table_properties": {"data_size": 91840, "index_size": 291, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13852, "raw_average_key_size": 50, "raw_value_size": 84328, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 274, "num_filter_entries": 274, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715198263, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cc319c9a-0190-4ae0-b71e-d75d543a4058", "db_session_id": "2WMU8A7P8PAOW01ZFZA8", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198263531813, "job": 1, "event": "recovery_finished"} 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56313d1f8000 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: DB pointer 0x56313d1e6000 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** DB Stats ** 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T19:57:43.840 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: L0 2/0 93.48 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 112.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: Sum 2/0 93.48 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 112.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 112.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** Compaction Stats [default] ** 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 112.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-05-08T19:57:43.841 INFO:journalctl@ceph.mon.a.smithi033.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: Cumulative compaction: 0.00 GB write, 22.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: Interval compaction: 0.00 GB write, 22.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache BinnedLRUCache@0x56313d15b1f0#7 capacity: 512.00 MB usage: 1.39 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.3e-05 secs_since: 0 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: starting mon.a rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:43.842 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???) e1 preinit fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???).mds e1 new map 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???).mds e1 print_map 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout: e1 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout: legacy client fscid: -1 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout: 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout: No filesystems configured 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: monmap e1: 1 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:57:43.843 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: fsmap 2024-05-08T19:57:43.844 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T19:57:43.844 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:43 smithi033 ceph-mon[42490]: mgrmap e1: no daemons active 2024-05-08T19:57:44.383 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.953+0000 7fea57dd4700 1 Processor -- start 2024-05-08T19:57:44.383 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.953+0000 7fea57dd4700 1 -- start start 2024-05-08T19:57:44.383 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.954+0000 7fea57dd4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea50105c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:44.383 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.954+0000 7fea57dd4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501061f0 con 0x7fea50105800 2024-05-08T19:57:44.383 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.954+0000 7fea55b70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea50105c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.954+0000 7fea55b70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea50105c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41354/0 (socket says 172.21.15.33:41354) 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.954+0000 7fea55b70700 1 -- 172.21.15.33:0/1810731772 learned_addr learned my addr 172.21.15.33:0/1810731772 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.955+0000 7fea55b70700 1 -- 172.21.15.33:0/1810731772 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea50106a00 con 0x7fea50105800 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.955+0000 7fea55b70700 1 --2- 172.21.15.33:0/1810731772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea50105c20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fea440098a0 tx=0x7fea44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e120305b0c10445d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.955+0000 7fea54b6e700 1 -- 172.21.15.33:0/1810731772 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea44004160 con 0x7fea50105800 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.955+0000 7fea54b6e700 1 -- 172.21.15.33:0/1810731772 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fea440042c0 con 0x7fea50105800 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.955+0000 7fea54b6e700 1 -- 172.21.15.33:0/1810731772 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea44011ac0 con 0x7fea50105800 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 -- 172.21.15.33:0/1810731772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 msgr2=0x7fea50105c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 --2- 172.21.15.33:0/1810731772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea50105c20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fea440098a0 tx=0x7fea44009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 -- 172.21.15.33:0/1810731772 shutdown_connections 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 --2- 172.21.15.33:0/1810731772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea50105c20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 -- 172.21.15.33:0/1810731772 >> 172.21.15.33:0/1810731772 conn(0x7fea50100e40 msgr2=0x7fea50103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 -- 172.21.15.33:0/1810731772 shutdown_connections 2024-05-08T19:57:44.384 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 -- 172.21.15.33:0/1810731772 wait complete. 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 Processor -- start 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.956+0000 7fea57dd4700 1 -- start start 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea57dd4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea5019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea57dd4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5019abe0 con 0x7fea50105800 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea55b70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea5019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea55b70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea5019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41370/0 (socket says 172.21.15.33:41370) 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea55b70700 1 -- 172.21.15.33:0/3129337895 learned_addr learned my addr 172.21.15.33:0/3129337895 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea55b70700 1 -- 172.21.15.33:0/3129337895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea44009550 con 0x7fea50105800 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea55b70700 1 --2- 172.21.15.33:0/3129337895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea5019a6a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fea44000c00 tx=0x7fea44011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea42ffd700 1 -- 172.21.15.33:0/3129337895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea44003aa0 con 0x7fea50105800 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea42ffd700 1 -- 172.21.15.33:0/3129337895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fea44003c00 con 0x7fea50105800 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.957+0000 7fea42ffd700 1 -- 172.21.15.33:0/3129337895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fea440248a0 con 0x7fea50105800 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.958+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5019ade0 con 0x7fea50105800 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.958+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5019b280 con 0x7fea50105800 2024-05-08T19:57:44.385 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.958+0000 7fea42ffd700 1 -- 172.21.15.33:0/3129337895 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fea4402d3f0 con 0x7fea50105800 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.958+0000 7fea42ffd700 1 -- 172.21.15.33:0/3129337895 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fea44019400 con 0x7fea50105800 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.959+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea501947d0 con 0x7fea50105800 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:43.961+0000 7fea42ffd700 1 -- 172.21.15.33:0/3129337895 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fea4401ac60 con 0x7fea50105800 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.034+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fea500625d0 con 0x7fea50105800 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.039+0000 7fea42ffd700 1 -- 172.21.15.33:0/3129337895 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fea4401ae00 con 0x7fea50105800 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.040+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 msgr2=0x7fea5019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.040+0000 7fea57dd4700 1 --2- 172.21.15.33:0/3129337895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea5019a6a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fea44000c00 tx=0x7fea44011b40 comp rx=0 tx=0).stop 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.040+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 shutdown_connections 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.040+0000 7fea57dd4700 1 --2- 172.21.15.33:0/3129337895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea50105800 0x7fea5019a6a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.040+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 >> 172.21.15.33:0/3129337895 conn(0x7fea50100e40 msgr2=0x7fea50101d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.040+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 shutdown_connections 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:44.040+0000 7fea57dd4700 1 -- 172.21.15.33:0/3129337895 wait complete. 2024-05-08T19:57:44.386 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-08T19:57:44.405 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-08T19:57:44.405 INFO:teuthology.orchestra.run.smithi033.stdout:Creating mgr... 2024-05-08T19:57:44.406 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-08T19:57:44.406 INFO:teuthology.orchestra.run.smithi033.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-08T19:57:44.628 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.x 2024-05-08T19:57:44.628 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-08T19:57:44.733 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968.target.wants/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@.service. 2024-05-08T19:57:45.010 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:44 smithi033 systemd[1]: Starting Ceph mgr.x for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T19:57:45.184 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T19:57:45.184 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-05-08T19:57:45.193 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T19:57:45.193 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-05-08T19:57:45.193 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-05-08T19:57:45.193 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T19:57:45.203 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T19:57:45.203 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-05-08T19:57:45.212 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T19:57:45.213 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-05-08T19:57:45.213 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-05-08T19:57:45.213 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-08T19:57:45.213 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr to start... 2024-05-08T19:57:45.213 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr... 2024-05-08T19:57:45.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:45 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3129337895' entity='client.admin' 2024-05-08T19:57:45.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:45 smithi033 bash[42728]: c8a66ac8654dbf2fed0b3439f74b0923971a775e987cecabffcb6c8840933a0f 2024-05-08T19:57:45.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:45 smithi033 systemd[1]: Started Ceph mgr.x for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:57:45.885 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:45.643+0000 7fdca4f2f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T19:57:45.885 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:45.750+0000 7fdca4f2f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T19:57:45.886 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:45.850+0000 7fdca4f2f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T19:57:46.070 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-05-08T19:57:46.073 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T19:57:46.074 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T19:57:46.082 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T19:57:46.083 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T19:57:46.084 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T19:57:39.573393+0000", 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.635+0000 7f3cc8aab700 1 Processor -- start 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.636+0000 7f3cc8aab700 1 -- start start 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.636+0000 7f3cc8aab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4109720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.636+0000 7f3cc8aab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4079eb0 con 0x7f3cc4107330 2024-05-08T19:57:46.085 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.636+0000 7f3cc259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4109720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.636+0000 7f3cc259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4109720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41396/0 (socket says 172.21.15.33:41396) 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.636+0000 7f3cc259c700 1 -- 172.21.15.33:0/2148818684 learned_addr learned my addr 172.21.15.33:0/2148818684 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.637+0000 7f3cc259c700 1 -- 172.21.15.33:0/2148818684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc4109c60 con 0x7f3cc4107330 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.637+0000 7f3cc259c700 1 --2- 172.21.15.33:0/2148818684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4109720 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40098a0 tx=0x7f3cb4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67a3bfdcc0c2062 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.637+0000 7f3cc159a700 1 -- 172.21.15.33:0/2148818684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb4004160 con 0x7f3cc4107330 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.637+0000 7f3cc159a700 1 -- 172.21.15.33:0/2148818684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3cb40042c0 con 0x7f3cc4107330 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.637+0000 7f3cc159a700 1 -- 172.21.15.33:0/2148818684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb4011ac0 con 0x7f3cc4107330 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.638+0000 7f3cc8aab700 1 -- 172.21.15.33:0/2148818684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 msgr2=0x7f3cc4109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.638+0000 7f3cc8aab700 1 --2- 172.21.15.33:0/2148818684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4109720 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40098a0 tx=0x7f3cb4009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.638+0000 7f3cc8aab700 1 -- 172.21.15.33:0/2148818684 shutdown_connections 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.638+0000 7f3cc8aab700 1 --2- 172.21.15.33:0/2148818684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4109720 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.638+0000 7f3cc8aab700 1 -- 172.21.15.33:0/2148818684 >> 172.21.15.33:0/2148818684 conn(0x7f3cc4100e00 msgr2=0x7f3cc4103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:46.086 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.638+0000 7f3cc8aab700 1 -- 172.21.15.33:0/2148818684 shutdown_connections 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.638+0000 7f3cc8aab700 1 -- 172.21.15.33:0/2148818684 wait complete. 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.639+0000 7f3cc8aab700 1 Processor -- start 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.639+0000 7f3cc8aab700 1 -- start start 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.639+0000 7f3cc8aab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4106b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.639+0000 7f3cc8aab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc41070a0 con 0x7f3cc4107330 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.639+0000 7f3cc259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4106b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.639+0000 7f3cc259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4106b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41408/0 (socket says 172.21.15.33:41408) 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.639+0000 7f3cc259c700 1 -- 172.21.15.33:0/3283277793 learned_addr learned my addr 172.21.15.33:0/3283277793 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cc259c700 1 -- 172.21.15.33:0/3283277793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4009550 con 0x7f3cc4107330 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cc259c700 1 --2- 172.21.15.33:0/3283277793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4106b60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009130 tx=0x7f3cb4011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cb37fe700 1 -- 172.21.15.33:0/3283277793 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb4003aa0 con 0x7f3cc4107330 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cb37fe700 1 -- 172.21.15.33:0/3283277793 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3cb4003c00 con 0x7f3cc4107330 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc41052e0 con 0x7f3cc4107330 2024-05-08T19:57:46.087 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cb37fe700 1 -- 172.21.15.33:0/3283277793 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cb4024800 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc4105780 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cb37fe700 1 -- 172.21.15.33:0/3283277793 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3cb402d3f0 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.640+0000 7f3cb37fe700 1 -- 172.21.15.33:0/3283277793 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3cb4019400 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.641+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca4005320 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.643+0000 7f3cb37fe700 1 -- 172.21.15.33:0/3283277793 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f3cb401abd0 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.722+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f3ca40058a0 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.722+0000 7f3cb37fe700 1 -- 172.21.15.33:0/3283277793 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f3cb401a430 con 0x7f3cc4107330 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.723+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 msgr2=0x7f3cc4106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.723+0000 7f3cc8aab700 1 --2- 172.21.15.33:0/3283277793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4106b60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009130 tx=0x7f3cb4011b40 comp rx=0 tx=0).stop 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.723+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 shutdown_connections 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.723+0000 7f3cc8aab700 1 --2- 172.21.15.33:0/3283277793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3cc4107330 0x7f3cc4106b60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.723+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 >> 172.21.15.33:0/3283277793 conn(0x7f3cc4100e00 msgr2=0x7f3cc4101910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.723+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 shutdown_connections 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:45.723+0000 7f3cc8aab700 1 -- 172.21.15.33:0/3283277793 wait complete. 2024-05-08T19:57:46.088 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (1/15)... 2024-05-08T19:57:46.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:46 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3283277793' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T19:57:46.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:45.946+0000 7fdca4f2f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T19:57:46.955 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:46.683+0000 7fdca4f2f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:57:47.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:46.966+0000 7fdca4f2f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T19:57:47.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:47 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:47.063+0000 7fdca4f2f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T19:57:47.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:47 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:47.185+0000 7fdca4f2f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T19:57:47.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:47 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:47.365+0000 7fdca4f2f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T19:57:47.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:47 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:47.510+0000 7fdca4f2f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T19:57:47.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:47 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:47.606+0000 7fdca4f2f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T19:57:48.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:48 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:48.029+0000 7fdca4f2f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T19:57:48.803 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:48 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3426685850' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T19:57:48.804 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:48 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:48.485+0000 7fdca4f2f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T19:57:48.804 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:48 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:48.709+0000 7fdca4f2f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T19:57:48.896 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T19:57:48.897 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:48.898 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T19:57:48.906 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T19:57:48.907 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T19:57:39.573393+0000", 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:57:48.908 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.459+0000 7f2a80c42700 1 Processor -- start 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.459+0000 7f2a80c42700 1 -- start start 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a80c42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c109780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a80c42700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c079e50 con 0x7f2a7c107390 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a7a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c109780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a7a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c109780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41414/0 (socket says 172.21.15.33:41414) 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a7a59c700 1 -- 172.21.15.33:0/534402533 learned_addr learned my addr 172.21.15.33:0/534402533 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a7a59c700 1 -- 172.21.15.33:0/534402533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c109cc0 con 0x7f2a7c107390 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a7a59c700 1 --2- 172.21.15.33:0/534402533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c109780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0098a0 tx=0x7f2a6c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5854c62a69ea68fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.460+0000 7f2a7959a700 1 -- 172.21.15.33:0/534402533 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a6c004160 con 0x7f2a7c107390 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a7959a700 1 -- 172.21.15.33:0/534402533 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2a6c0042c0 con 0x7f2a7c107390 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a7959a700 1 -- 172.21.15.33:0/534402533 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a6c011ac0 con 0x7f2a7c107390 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a80c42700 1 -- 172.21.15.33:0/534402533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 msgr2=0x7f2a7c109780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a80c42700 1 --2- 172.21.15.33:0/534402533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c109780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0098a0 tx=0x7f2a6c009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:48.909 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a80c42700 1 -- 172.21.15.33:0/534402533 shutdown_connections 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a80c42700 1 --2- 172.21.15.33:0/534402533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c109780 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a80c42700 1 -- 172.21.15.33:0/534402533 >> 172.21.15.33:0/534402533 conn(0x7f2a7c100e00 msgr2=0x7f2a7c103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a80c42700 1 -- 172.21.15.33:0/534402533 shutdown_connections 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.461+0000 7f2a80c42700 1 -- 172.21.15.33:0/534402533 wait complete. 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.462+0000 7f2a80c42700 1 Processor -- start 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.462+0000 7f2a80c42700 1 -- start start 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a80c42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c106b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a80c42700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c1070b0 con 0x7f2a7c107390 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a7a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c106b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a7a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c106b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41426/0 (socket says 172.21.15.33:41426) 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a7a59c700 1 -- 172.21.15.33:0/3426685850 learned_addr learned my addr 172.21.15.33:0/3426685850 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a7a59c700 1 -- 172.21.15.33:0/3426685850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c009550 con 0x7f2a7c107390 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a7a59c700 1 --2- 172.21.15.33:0/3426685850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c106b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009130 tx=0x7f2a6c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a6b7fe700 1 -- 172.21.15.33:0/3426685850 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a6c003aa0 con 0x7f2a7c107390 2024-05-08T19:57:48.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.463+0000 7f2a6b7fe700 1 -- 172.21.15.33:0/3426685850 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2a6c003c00 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.464+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a7c105340 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.464+0000 7f2a6b7fe700 1 -- 172.21.15.33:0/3426685850 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2a6c024800 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.464+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7c1057e0 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.464+0000 7f2a6b7fe700 1 -- 172.21.15.33:0/3426685850 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2a6c024ac0 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.464+0000 7f2a6b7fe700 1 -- 172.21.15.33:0/3426685850 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2a6c02dba0 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.464+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a7c068030 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.467+0000 7f2a6b7fe700 1 -- 172.21.15.33:0/3426685850 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f2a6c02de00 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.544+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2a7c10acd0 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.545+0000 7f2a6b7fe700 1 -- 172.21.15.33:0/3426685850 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f2a6c01abd0 con 0x7f2a7c107390 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.546+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 msgr2=0x7f2a7c106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.546+0000 7f2a80c42700 1 --2- 172.21.15.33:0/3426685850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c106b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c009130 tx=0x7f2a6c011b40 comp rx=0 tx=0).stop 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.546+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 shutdown_connections 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.546+0000 7f2a80c42700 1 --2- 172.21.15.33:0/3426685850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a7c107390 0x7f2a7c106b70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:48.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.546+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 >> 172.21.15.33:0/3426685850 conn(0x7f2a7c100e00 msgr2=0x7f2a7c1019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:48.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.546+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 shutdown_connections 2024-05-08T19:57:48.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:48.546+0000 7f2a80c42700 1 -- 172.21.15.33:0/3426685850 wait complete. 2024-05-08T19:57:48.912 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (2/15)... 2024-05-08T19:57:49.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:48 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:48.813+0000 7fdca4f2f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T19:57:49.947 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:49 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:49.684+0000 7fdca4f2f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T19:57:49.948 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:49 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:49.791+0000 7fdca4f2f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T19:57:50.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:49 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:49.958+0000 7fdca4f2f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T19:57:51.009 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:50 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:50.676+0000 7fdca4f2f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T19:57:51.009 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:50 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:50.881+0000 7fdca4f2f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T19:57:51.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:51 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:51.116+0000 7fdca4f2f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T19:57:51.808 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:51 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/689539534' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T19:57:51.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:51.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T19:57:51.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:51.940 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T19:57:51.940 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T19:57:51.940 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T19:57:51.940 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T19:57:51.941 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T19:57:51.942 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T19:57:39.573393+0000", 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.273+0000 7fb07f526700 1 Processor -- start 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.273+0000 7fb07f526700 1 -- start start 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb07f526700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb078109760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb07f526700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb078079e70 con 0x7fb078107370 2024-05-08T19:57:51.943 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb07d2c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb078109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:51.944 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb07d2c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb078109760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41438/0 (socket says 172.21.15.33:41438) 2024-05-08T19:57:51.944 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb07d2c2700 1 -- 172.21.15.33:0/2269282354 learned_addr learned my addr 172.21.15.33:0/2269282354 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:51.944 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb07d2c2700 1 -- 172.21.15.33:0/2269282354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078109ca0 con 0x7fb078107370 2024-05-08T19:57:51.944 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb07d2c2700 1 --2- 172.21.15.33:0/2269282354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb078109760 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0740098a0 tx=0x7fb074009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406339746316402c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:51.944 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb06ffff700 1 -- 172.21.15.33:0/2269282354 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb074004160 con 0x7fb078107370 2024-05-08T19:57:51.944 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.274+0000 7fb06ffff700 1 -- 172.21.15.33:0/2269282354 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb0740042c0 con 0x7fb078107370 2024-05-08T19:57:51.945 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb06ffff700 1 -- 172.21.15.33:0/2269282354 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb074011ac0 con 0x7fb078107370 2024-05-08T19:57:51.945 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb07f526700 1 -- 172.21.15.33:0/2269282354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 msgr2=0x7fb078109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:51.945 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb07f526700 1 --2- 172.21.15.33:0/2269282354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb078109760 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb0740098a0 tx=0x7fb074009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:51.945 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb07f526700 1 -- 172.21.15.33:0/2269282354 shutdown_connections 2024-05-08T19:57:51.945 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb07f526700 1 --2- 172.21.15.33:0/2269282354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb078109760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:51.945 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb07f526700 1 -- 172.21.15.33:0/2269282354 >> 172.21.15.33:0/2269282354 conn(0x7fb078100e00 msgr2=0x7fb078103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:51.945 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb07f526700 1 -- 172.21.15.33:0/2269282354 shutdown_connections 2024-05-08T19:57:51.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.275+0000 7fb07f526700 1 -- 172.21.15.33:0/2269282354 wait complete. 2024-05-08T19:57:51.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.276+0000 7fb07f526700 1 Processor -- start 2024-05-08T19:57:51.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.276+0000 7fb07f526700 1 -- start start 2024-05-08T19:57:51.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.276+0000 7fb07f526700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb07819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:51.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.276+0000 7fb07f526700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07819abc0 con 0x7fb078107370 2024-05-08T19:57:51.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.276+0000 7fb07d2c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb07819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:51.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.276+0000 7fb07d2c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb07819a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41442/0 (socket says 172.21.15.33:41442) 2024-05-08T19:57:51.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.276+0000 7fb07d2c2700 1 -- 172.21.15.33:0/689539534 learned_addr learned my addr 172.21.15.33:0/689539534 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:51.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb07d2c2700 1 -- 172.21.15.33:0/689539534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009550 con 0x7fb078107370 2024-05-08T19:57:51.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb07d2c2700 1 --2- 172.21.15.33:0/689539534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb07819a680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb074003f70 tx=0x7fb074011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:51.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb06e7fc700 1 -- 172.21.15.33:0/689539534 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0740039f0 con 0x7fb078107370 2024-05-08T19:57:51.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb06e7fc700 1 -- 172.21.15.33:0/689539534 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb074003b50 con 0x7fb078107370 2024-05-08T19:57:51.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07819adc0 con 0x7fb078107370 2024-05-08T19:57:51.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb06e7fc700 1 -- 172.21.15.33:0/689539534 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb07401a760 con 0x7fb078107370 2024-05-08T19:57:51.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07819b260 con 0x7fb078107370 2024-05-08T19:57:51.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb06e7fc700 1 -- 172.21.15.33:0/689539534 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb07401abe0 con 0x7fb078107370 2024-05-08T19:57:51.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.277+0000 7fb06e7fc700 1 -- 172.21.15.33:0/689539534 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb074019700 con 0x7fb078107370 2024-05-08T19:57:51.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.278+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07810aaa0 con 0x7fb078107370 2024-05-08T19:57:51.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.280+0000 7fb06e7fc700 1 -- 172.21.15.33:0/689539534 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb0740249f0 con 0x7fb078107370 2024-05-08T19:57:51.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.358+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fb07810acd0 con 0x7fb078107370 2024-05-08T19:57:51.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.358+0000 7fb06e7fc700 1 -- 172.21.15.33:0/689539534 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fb074024430 con 0x7fb078107370 2024-05-08T19:57:51.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.360+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 msgr2=0x7fb07819a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:51.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.360+0000 7fb07f526700 1 --2- 172.21.15.33:0/689539534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb07819a680 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb074003f70 tx=0x7fb074011b40 comp rx=0 tx=0).stop 2024-05-08T19:57:51.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.360+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 shutdown_connections 2024-05-08T19:57:51.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.360+0000 7fb07f526700 1 --2- 172.21.15.33:0/689539534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb078107370 0x7fb07819a680 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:51.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.360+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 >> 172.21.15.33:0/689539534 conn(0x7fb078100e00 msgr2=0x7fb0781019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:51.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.360+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 shutdown_connections 2024-05-08T19:57:51.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:51.360+0000 7fb07f526700 1 -- 172.21.15.33:0/689539534 wait complete. 2024-05-08T19:57:51.950 INFO:teuthology.orchestra.run.smithi033.stdout:mgr not available, waiting (3/15)... 2024-05-08T19:57:52.499 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:52 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:52.189+0000 7fdca4f2f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T19:57:52.815 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:52 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:52.509+0000 7fdca4f2f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:57:52.816 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:52 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:52.609+0000 7fdca4f2f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T19:57:53.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:52 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:52.826+0000 7fdca4f2f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T19:57:53.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: Activating manager daemon x 2024-05-08T19:57:53.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: mgrmap e2: x(active, starting, since 0.00344222s) 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: Manager daemon x is now available 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' 2024-05-08T19:57:53.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:52 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' 2024-05-08T19:57:54.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:53 smithi033 ceph-mon[42490]: from='mgr.14100 172.21.15.33:0/2338667081' entity='mgr.x' 2024-05-08T19:57:54.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:53 smithi033 ceph-mon[42490]: mgrmap e3: x(active, since 1.00759s) 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T19:57:54.971 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 0 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T19:57:54.972 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:54.973 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T19:57:54.973 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T19:57:54.973 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T19:57:54.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T19:57:54.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T19:57:54.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T19:57:54.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:54.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T19:57:54.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T19:57:54.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T19:57:54.977 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:54 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/234541540' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T19:57:54.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T19:57:54.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ], 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T19:57:39.573393+0000", 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout }, 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T19:57:54.984 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.346+0000 7ffbc58a0700 1 Processor -- start 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.346+0000 7ffbc58a0700 1 -- start start 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.346+0000 7ffbc58a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc01071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.346+0000 7ffbc58a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0107780 con 0x7ffbc0106d90 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc01071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc01071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38038/0 (socket says 172.21.15.33:38038) 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbeffd700 1 -- 172.21.15.33:0/2218366437 learned_addr learned my addr 172.21.15.33:0/2218366437 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbeffd700 1 -- 172.21.15.33:0/2218366437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc01059f0 con 0x7ffbc0106d90 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbeffd700 1 --2- 172.21.15.33:0/2218366437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc01071b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40098a0 tx=0x7ffbb4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8e71af3b5ccadf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbdffb700 1 -- 172.21.15.33:0/2218366437 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbb4004160 con 0x7ffbc0106d90 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbdffb700 1 -- 172.21.15.33:0/2218366437 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ffbb40042c0 con 0x7ffbc0106d90 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.347+0000 7ffbbdffb700 1 -- 172.21.15.33:0/2218366437 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbb4011ac0 con 0x7ffbc0106d90 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.348+0000 7ffbc58a0700 1 -- 172.21.15.33:0/2218366437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 msgr2=0x7ffbc01071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:54.985 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.348+0000 7ffbc58a0700 1 --2- 172.21.15.33:0/2218366437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc01071b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40098a0 tx=0x7ffbb4009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.348+0000 7ffbc58a0700 1 -- 172.21.15.33:0/2218366437 shutdown_connections 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.348+0000 7ffbc58a0700 1 --2- 172.21.15.33:0/2218366437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc01071b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.348+0000 7ffbc58a0700 1 -- 172.21.15.33:0/2218366437 >> 172.21.15.33:0/2218366437 conn(0x7ffbc0100520 msgr2=0x7ffbc0102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.348+0000 7ffbc58a0700 1 -- 172.21.15.33:0/2218366437 shutdown_connections 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.348+0000 7ffbc58a0700 1 -- 172.21.15.33:0/2218366437 wait complete. 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.349+0000 7ffbc58a0700 1 Processor -- start 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.349+0000 7ffbc58a0700 1 -- start start 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.349+0000 7ffbc58a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc0105370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.349+0000 7ffbc58a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc01058b0 con 0x7ffbc0106d90 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.349+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc0105370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.349+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc0105370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38040/0 (socket says 172.21.15.33:38040) 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.349+0000 7ffbbeffd700 1 -- 172.21.15.33:0/234541540 learned_addr learned my addr 172.21.15.33:0/234541540 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.350+0000 7ffbbeffd700 1 -- 172.21.15.33:0/234541540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb4009550 con 0x7ffbc0106d90 2024-05-08T19:57:54.986 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.350+0000 7ffbbeffd700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc0105370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4011a70 tx=0x7ffbb4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.350+0000 7ffbc489e700 1 -- 172.21.15.33:0/234541540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbb40039c0 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.350+0000 7ffbc489e700 1 -- 172.21.15.33:0/234541540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ffbb4003b20 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.350+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc019b1d0 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.350+0000 7ffbc489e700 1 -- 172.21.15.33:0/234541540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ffbb4024610 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.350+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc019fa90 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.351+0000 7ffbc489e700 1 -- 172.21.15.33:0/234541540 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 3) v1 ==== 45424+0+0 (secure 0 0 0) 0x7ffbb402d3f0 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.351+0000 7ffbc489e700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ffba8038580 0x7ffba803aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.351+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc0109c30 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.351+0000 7ffbc489e700 1 -- 172.21.15.33:0/234541540 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ffbb404c470 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.351+0000 7ffbbe7fc700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ffba8038580 0x7ffba803aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.352+0000 7ffbbe7fc700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ffba8038580 0x7ffba803aa40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006fd0 tx=0x7ffbb0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.357+0000 7ffbc489e700 1 -- 172.21.15.33:0/234541540 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ffbb400d1c0 con 0x7ffbc0106d90 2024-05-08T19:57:54.987 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.652+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ffbc0109e70 con 0x7ffbc0106d90 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.653+0000 7ffbc489e700 1 -- 172.21.15.33:0/234541540 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ffbb4027e50 con 0x7ffbc0106d90 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ffba8038580 msgr2=0x7ffba803aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ffba8038580 0x7ffba803aa40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0006fd0 tx=0x7ffbb0006e40 comp rx=0 tx=0).stop 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 msgr2=0x7ffbc0105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc0105370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4011a70 tx=0x7ffbb4011b50 comp rx=0 tx=0).stop 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 shutdown_connections 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ffba8038580 0x7ffba803aa40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 --2- 172.21.15.33:0/234541540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffbc0106d90 0x7ffbc0105370 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 >> 172.21.15.33:0/234541540 conn(0x7ffbc0100520 msgr2=0x7ffbc0101150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.655+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 shutdown_connections 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:54.656+0000 7ffbc58a0700 1 -- 172.21.15.33:0/234541540 wait complete. 2024-05-08T19:57:54.988 INFO:teuthology.orchestra.run.smithi033.stdout:mgr is available 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout fsid = 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:55.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.346+0000 7fa7f6c5a700 1 Processor -- start 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.346+0000 7fa7f6c5a700 1 -- start start 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.346+0000 7fa7f6c5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f0105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.346+0000 7fa7f6c5a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f01061b0 con 0x7fa7f01057c0 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.346+0000 7fa7f49f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f0105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:55.926 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.346+0000 7fa7f49f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f0105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38050/0 (socket says 172.21.15.33:38050) 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.346+0000 7fa7f49f6700 1 -- 172.21.15.33:0/433595736 learned_addr learned my addr 172.21.15.33:0/433595736 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.347+0000 7fa7f49f6700 1 -- 172.21.15.33:0/433595736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f01069c0 con 0x7fa7f01057c0 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.347+0000 7fa7f49f6700 1 --2- 172.21.15.33:0/433595736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f0105be0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40098a0 tx=0x7fa7e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f10e293fed4927b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.347+0000 7fa7ef7fe700 1 -- 172.21.15.33:0/433595736 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e4004160 con 0x7fa7f01057c0 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.347+0000 7fa7ef7fe700 1 -- 172.21.15.33:0/433595736 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa7e40042c0 con 0x7fa7f01057c0 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.347+0000 7fa7ef7fe700 1 -- 172.21.15.33:0/433595736 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e4011ac0 con 0x7fa7f01057c0 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/433595736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 msgr2=0x7fa7f0105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 --2- 172.21.15.33:0/433595736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f0105be0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa7e40098a0 tx=0x7fa7e4009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/433595736 shutdown_connections 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 --2- 172.21.15.33:0/433595736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f0105be0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/433595736 >> 172.21.15.33:0/433595736 conn(0x7fa7f0100e00 msgr2=0x7fa7f0103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/433595736 shutdown_connections 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/433595736 wait complete. 2024-05-08T19:57:55.927 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.348+0000 7fa7f6c5a700 1 Processor -- start 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f6c5a700 1 -- start start 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f6c5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f01908e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f6c5a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0190e20 con 0x7fa7f01057c0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f49f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f01908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f49f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f01908e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38064/0 (socket says 172.21.15.33:38064) 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f49f6700 1 -- 172.21.15.33:0/2248559794 learned_addr learned my addr 172.21.15.33:0/2248559794 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f49f6700 1 -- 172.21.15.33:0/2248559794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e4009550 con 0x7fa7f01057c0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7f49f6700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f01908e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4003f70 tx=0x7fa7e4011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.349+0000 7fa7edffb700 1 -- 172.21.15.33:0/2248559794 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e40039f0 con 0x7fa7f01057c0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.350+0000 7fa7edffb700 1 -- 172.21.15.33:0/2248559794 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa7e4003b50 con 0x7fa7f01057c0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.350+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f018f060 con 0x7fa7f01057c0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.350+0000 7fa7edffb700 1 -- 172.21.15.33:0/2248559794 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa7e401a690 con 0x7fa7f01057c0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.350+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f018f500 con 0x7fa7f01057c0 2024-05-08T19:57:55.928 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.351+0000 7fa7edffb700 1 -- 172.21.15.33:0/2248559794 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7fa7e4024430 con 0x7fa7f01057c0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.351+0000 7fa7edffb700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fa7e0038660 0x7fa7e003ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.351+0000 7fa7edffb700 1 -- 172.21.15.33:0/2248559794 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa7e404c820 con 0x7fa7f01057c0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.351+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f0068030 con 0x7fa7f01057c0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.351+0000 7fa7effff700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fa7e0038660 0x7fa7e003ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.351+0000 7fa7effff700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fa7e0038660 0x7fa7e003ab20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc006fd0 tx=0x7fa7dc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.356+0000 7fa7edffb700 1 -- 172.21.15.33:0/2248559794 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa7e40189a0 con 0x7fa7f01057c0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.565+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fa7f0109bf0 con 0x7fa7f01057c0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.566+0000 7fa7edffb700 1 -- 172.21.15.33:0/2248559794 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fa7e4018350 con 0x7fa7f01057c0 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fa7e0038660 msgr2=0x7fa7e003ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fa7e0038660 0x7fa7e003ab20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc006fd0 tx=0x7fa7dc006e40 comp rx=0 tx=0).stop 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 msgr2=0x7fa7f01908e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f01908e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4003f70 tx=0x7fa7e4011b40 comp rx=0 tx=0).stop 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 shutdown_connections 2024-05-08T19:57:55.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fa7e0038660 0x7fa7e003ab20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:55.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 --2- 172.21.15.33:0/2248559794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7f01057c0 0x7fa7f01908e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:55.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 >> 172.21.15.33:0/2248559794 conn(0x7fa7f0100e00 msgr2=0x7fa7f0101cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:55.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 shutdown_connections 2024-05-08T19:57:55.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:55.569+0000 7fa7f6c5a700 1 -- 172.21.15.33:0/2248559794 wait complete. 2024-05-08T19:57:55.930 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling cephadm module... 2024-05-08T19:57:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:55 smithi033 ceph-mon[42490]: mgrmap e4: x(active, since 2s) 2024-05-08T19:57:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:55 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2248559794' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T19:57:57.238 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:56 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/527932960' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-08T19:57:57.238 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:56 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: ignoring --setuser ceph since I am not root 2024-05-08T19:57:57.238 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:56 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: ignoring --setgroup ceph since I am not root 2024-05-08T19:57:57.285 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.334+0000 7ff4572df700 1 Processor -- start 2024-05-08T19:57:57.285 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.334+0000 7ff4572df700 1 -- start start 2024-05-08T19:57:57.285 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.334+0000 7ff4572df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff450109770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:57.285 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff4572df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff450079e50 con 0x7ff450107380 2024-05-08T19:57:57.285 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff45507b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff450109770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:57.285 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff45507b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff450109770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38074/0 (socket says 172.21.15.33:38074) 2024-05-08T19:57:57.285 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff45507b700 1 -- 172.21.15.33:0/426270859 learned_addr learned my addr 172.21.15.33:0/426270859 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:57.286 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff45507b700 1 -- 172.21.15.33:0/426270859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450109cb0 con 0x7ff450107380 2024-05-08T19:57:57.291 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff45507b700 1 --2- 172.21.15.33:0/426270859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff450109770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0098a0 tx=0x7ff44c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba4ab97416a8b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:57.291 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff447fff700 1 -- 172.21.15.33:0/426270859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff44c004160 con 0x7ff450107380 2024-05-08T19:57:57.291 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff447fff700 1 -- 172.21.15.33:0/426270859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff44c0042c0 con 0x7ff450107380 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.335+0000 7ff447fff700 1 -- 172.21.15.33:0/426270859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff44c011ac0 con 0x7ff450107380 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.336+0000 7ff4572df700 1 -- 172.21.15.33:0/426270859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 msgr2=0x7ff450109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.336+0000 7ff4572df700 1 --2- 172.21.15.33:0/426270859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff450109770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7ff44c0098a0 tx=0x7ff44c009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.336+0000 7ff4572df700 1 -- 172.21.15.33:0/426270859 shutdown_connections 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.336+0000 7ff4572df700 1 --2- 172.21.15.33:0/426270859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff450109770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.336+0000 7ff4572df700 1 -- 172.21.15.33:0/426270859 >> 172.21.15.33:0/426270859 conn(0x7ff450100e30 msgr2=0x7ff450103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.336+0000 7ff4572df700 1 -- 172.21.15.33:0/426270859 shutdown_connections 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.336+0000 7ff4572df700 1 -- 172.21.15.33:0/426270859 wait complete. 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.337+0000 7ff4572df700 1 Processor -- start 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.337+0000 7ff4572df700 1 -- start start 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.337+0000 7ff4572df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff45019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:57.292 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.337+0000 7ff4572df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45019ab60 con 0x7ff450107380 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.337+0000 7ff45507b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff45019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.337+0000 7ff45507b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff45019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38080/0 (socket says 172.21.15.33:38080) 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.337+0000 7ff45507b700 1 -- 172.21.15.33:0/527932960 learned_addr learned my addr 172.21.15.33:0/527932960 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.338+0000 7ff45507b700 1 -- 172.21.15.33:0/527932960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff44c009550 con 0x7ff450107380 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.338+0000 7ff45507b700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff45019a620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009130 tx=0x7ff44c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.338+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff44c003aa0 con 0x7ff450107380 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.338+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff44c003c00 con 0x7ff450107380 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.338+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff45019ad60 con 0x7ff450107380 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.338+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff44c024800 con 0x7ff450107380 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.338+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45019b200 con 0x7ff450107380 2024-05-08T19:57:57.293 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.339+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 45530+0+0 (secure 0 0 0) 0x7ff44c024ac0 con 0x7ff450107380 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.339+0000 7ff4467fc700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ff43c0386b0 0x7ff43c03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.339+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff44c04c540 con 0x7ff450107380 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.339+0000 7ff45487a700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ff43c0386b0 0x7ff43c03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.339+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4500625d0 con 0x7ff450107380 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.340+0000 7ff45487a700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ff43c0386b0 0x7ff43c03ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff440006fd0 tx=0x7ff440006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.344+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff44c024d70 con 0x7ff450107380 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.617+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7ff45019dcb0 con 0x7ff450107380 2024-05-08T19:57:57.294 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.913+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ff44c018350 con 0x7ff450107380 2024-05-08T19:57:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.914+0000 7ff4467fc700 1 -- 172.21.15.33:0/527932960 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7ff44c024d70 con 0x7ff450107380 2024-05-08T19:57:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ff43c0386b0 msgr2=0x7ff43c03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ff43c0386b0 0x7ff43c03ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff440006fd0 tx=0x7ff440006e40 comp rx=0 tx=0).stop 2024-05-08T19:57:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 msgr2=0x7ff45019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff45019a620 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff44c009130 tx=0x7ff44c011b40 comp rx=0 tx=0).stop 2024-05-08T19:57:57.295 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 shutdown_connections 2024-05-08T19:57:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7ff43c0386b0 0x7ff43c03ab70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 --2- 172.21.15.33:0/527932960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff450107380 0x7ff45019a620 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.918+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 >> 172.21.15.33:0/527932960 conn(0x7ff450100e30 msgr2=0x7ff450101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.919+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 shutdown_connections 2024-05-08T19:57:57.296 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:56.919+0000 7ff4572df700 1 -- 172.21.15.33:0/527932960 wait complete. 2024-05-08T19:57:57.513 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:57 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:57.409+0000 7fe93c365200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T19:57:57.514 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:57 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:57.516+0000 7fe93c365200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T19:57:57.823 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:57 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:57.616+0000 7fe93c365200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T19:57:57.823 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:57 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:57.715+0000 7fe93c365200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T19:57:58.286 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:57 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/527932960' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-08T19:57:58.287 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:57 smithi033 ceph-mon[42490]: mgrmap e5: x(active, since 4s) 2024-05-08T19:57:58.318 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.690+0000 7fcb65292700 1 Processor -- start 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.690+0000 7fcb65292700 1 -- start start 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.691+0000 7fcb65292700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb60106e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.691+0000 7fcb65292700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb601073d0 con 0x7fcb601069e0 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.691+0000 7fcb5effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb60106e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.691+0000 7fcb5effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb60106e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38102/0 (socket says 172.21.15.33:38102) 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.691+0000 7fcb5effd700 1 -- 172.21.15.33:0/2258477658 learned_addr learned my addr 172.21.15.33:0/2258477658 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:58.325 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.691+0000 7fcb5effd700 1 -- 172.21.15.33:0/2258477658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60107b90 con 0x7fcb601069e0 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.691+0000 7fcb5effd700 1 --2- 172.21.15.33:0/2258477658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb60106e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcb500098a0 tx=0x7fcb50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212adf2186934981 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb5dffb700 1 -- 172.21.15.33:0/2258477658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb50004160 con 0x7fcb601069e0 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb5dffb700 1 -- 172.21.15.33:0/2258477658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fcb500042c0 con 0x7fcb601069e0 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb5dffb700 1 -- 172.21.15.33:0/2258477658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb50011ac0 con 0x7fcb601069e0 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb65292700 1 -- 172.21.15.33:0/2258477658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 msgr2=0x7fcb60106e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb65292700 1 --2- 172.21.15.33:0/2258477658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb60106e00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcb500098a0 tx=0x7fcb50009bb0 comp rx=0 tx=0).stop 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb65292700 1 -- 172.21.15.33:0/2258477658 shutdown_connections 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb65292700 1 --2- 172.21.15.33:0/2258477658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb60106e00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb65292700 1 -- 172.21.15.33:0/2258477658 >> 172.21.15.33:0/2258477658 conn(0x7fcb60101f60 msgr2=0x7fcb601043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb65292700 1 -- 172.21.15.33:0/2258477658 shutdown_connections 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.692+0000 7fcb65292700 1 -- 172.21.15.33:0/2258477658 wait complete. 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.693+0000 7fcb65292700 1 Processor -- start 2024-05-08T19:57:58.326 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.693+0000 7fcb65292700 1 -- start start 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.693+0000 7fcb65292700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb6019a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.693+0000 7fcb65292700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6019ace0 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb5effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb6019a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb5effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb6019a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38118/0 (socket says 172.21.15.33:38118) 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb5effd700 1 -- 172.21.15.33:0/234707571 learned_addr learned my addr 172.21.15.33:0/234707571 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb5effd700 1 -- 172.21.15.33:0/234707571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50009550 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb5effd700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb6019a7a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb50011780 tx=0x7fcb50011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb47fff700 1 -- 172.21.15.33:0/234707571 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb50003af0 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb47fff700 1 -- 172.21.15.33:0/234707571 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fcb50003c50 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6019aee0 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb47fff700 1 -- 172.21.15.33:0/234707571 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcb50019800 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.694+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6019b380 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.696+0000 7fcb47fff700 1 -- 172.21.15.33:0/234707571 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fcb50019a30 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.696+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6010adc0 con 0x7fcb601069e0 2024-05-08T19:57:58.327 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.696+0000 7fcb47fff700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 0x7fcb4803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.696+0000 7fcb47fff700 1 -- 172.21.15.33:0/234707571 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcb5004ca80 con 0x7fcb601069e0 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.696+0000 7fcb5e7fc700 1 -- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 msgr2=0x7fcb4803ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/113789498 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.696+0000 7fcb5e7fc700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 0x7fcb4803ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.701+0000 7fcb47fff700 1 -- 172.21.15.33:0/234707571 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcb50018530 con 0x7fcb601069e0 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.897+0000 7fcb5e7fc700 1 -- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 msgr2=0x7fcb4803ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/113789498 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.897+0000 7fcb5e7fc700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 0x7fcb4803ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.974+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcb6019dc10 con 0x7fcb601069e0 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.974+0000 7fcb47fff700 1 -- 172.21.15.33:0/234707571 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7fcb50018350 con 0x7fcb601069e0 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 msgr2=0x7fcb4803ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 0x7fcb4803ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 msgr2=0x7fcb6019a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb6019a7a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcb50011780 tx=0x7fcb50011b40 comp rx=0 tx=0).stop 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 shutdown_connections 2024-05-08T19:57:58.328 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7fcb48038750 0x7fcb4803ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:58.329 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 --2- 172.21.15.33:0/234707571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb601069e0 0x7fcb6019a7a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:57:58.329 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.976+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 >> 172.21.15.33:0/234707571 conn(0x7fcb60101f60 msgr2=0x7fcb60102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:57:58.329 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.977+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 shutdown_connections 2024-05-08T19:57:58.329 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:57.977+0000 7fcb65292700 1 -- 172.21.15.33:0/234707571 wait complete. 2024-05-08T19:57:58.329 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-05-08T19:57:58.329 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 5... 2024-05-08T19:57:58.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:58.456+0000 7fe93c365200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:57:59.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:57:58 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/234707571' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T19:57:59.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:58.747+0000 7fe93c365200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T19:57:59.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:58.847+0000 7fe93c365200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T19:57:59.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:58.971+0000 7fe93c365200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T19:57:59.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:59 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:59.151+0000 7fe93c365200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T19:57:59.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:59 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:59.295+0000 7fe93c365200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T19:57:59.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:59 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:59.392+0000 7fe93c365200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T19:58:00.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:57:59 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:57:59.814+0000 7fe93c365200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T19:58:00.570 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:00.256+0000 7fe93c365200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T19:58:00.570 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:00.475+0000 7fe93c365200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T19:58:00.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:00.580+0000 7fe93c365200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T19:58:01.718 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:01.450+0000 7fe93c365200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T19:58:01.718 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:01.559+0000 7fe93c365200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T19:58:02.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:01.728+0000 7fe93c365200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T19:58:02.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:02 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:02.451+0000 7fe93c365200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T19:58:02.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:02 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:02.657+0000 7fe93c365200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T19:58:03.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:02 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:02.876+0000 7fe93c365200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T19:58:04.244 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:03 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:03.933+0000 7fe93c365200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T19:58:04.559 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:04.254+0000 7fe93c365200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:58:04.559 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:04.354+0000 7fe93c365200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:04.569+0000 7fe93c365200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: Active manager daemon x restarted 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: Activating manager daemon x 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: osdmap e2: 0 total, 0 up, 0 in 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: mgrmap e6: x(active, starting, since 0.00359839s) 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T19:58:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T19:58:04.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T19:58:04.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: Manager daemon x is now available 2024-05-08T19:58:04.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:04.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:04.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:04 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:05.944 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:05 smithi033 ceph-mon[42490]: Found migration_current of "None". Setting to last migration. 2024-05-08T19:58:05.944 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:05 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:05.944 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:05 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T19:58:05.944 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:05 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T19:58:05.944 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:05 smithi033 ceph-mon[42490]: mgrmap e7: x(active, since 1.00604s) 2024-05-08T19:58:06.003 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:58:06.003 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-08T19:58:06.003 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T19:58:06.003 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:58:06.003 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f039697b700 1 Processor -- start 2024-05-08T19:58:06.003 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f039697b700 1 -- start start 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f039697b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f0390109760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f039697b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0390079e70 con 0x7f0390107370 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f038ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f0390109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f038ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f0390109760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38134/0 (socket says 172.21.15.33:38134) 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f038ffff700 1 -- 172.21.15.33:0/3128107111 learned_addr learned my addr 172.21.15.33:0/3128107111 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.747+0000 7f038ffff700 1 -- 172.21.15.33:0/3128107111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0390109ca0 con 0x7f0390107370 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.748+0000 7f038ffff700 1 --2- 172.21.15.33:0/3128107111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f0390109760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03800098a0 tx=0x7f0380009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa214207529d85d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.748+0000 7f038effd700 1 -- 172.21.15.33:0/3128107111 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0380004160 con 0x7f0390107370 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.748+0000 7f038effd700 1 -- 172.21.15.33:0/3128107111 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f03800042c0 con 0x7f0390107370 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.748+0000 7f038effd700 1 -- 172.21.15.33:0/3128107111 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0380011ac0 con 0x7f0390107370 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 -- 172.21.15.33:0/3128107111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 msgr2=0x7f0390109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 --2- 172.21.15.33:0/3128107111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f0390109760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f03800098a0 tx=0x7f0380009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.004 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 -- 172.21.15.33:0/3128107111 shutdown_connections 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 --2- 172.21.15.33:0/3128107111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f0390109760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 -- 172.21.15.33:0/3128107111 >> 172.21.15.33:0/3128107111 conn(0x7f0390100e00 msgr2=0x7f0390103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 -- 172.21.15.33:0/3128107111 shutdown_connections 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 -- 172.21.15.33:0/3128107111 wait complete. 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 Processor -- start 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.749+0000 7f039697b700 1 -- start start 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.750+0000 7f039697b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f039019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.750+0000 7f039697b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039019abc0 con 0x7f0390107370 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.750+0000 7f038ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f039019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.750+0000 7f038ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f039019a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38144/0 (socket says 172.21.15.33:38144) 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.750+0000 7f038ffff700 1 -- 172.21.15.33:0/287010633 learned_addr learned my addr 172.21.15.33:0/287010633 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:06.005 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.750+0000 7f038ffff700 1 -- 172.21.15.33:0/287010633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0380009550 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.750+0000 7f038ffff700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f039019a680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0380003f70 tx=0x7f0380011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.751+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f03800039f0 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.751+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039019adc0 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.751+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039019b260 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.751+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0380003b50 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.751+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f038001a760 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.752+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f038001a9a0 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.752+0000 7f038d7fa700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.752+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 --> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f037c000d40 con 0x7f0378038700 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.752+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f038004c7d0 con 0x7f0390107370 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.752+0000 7f038f7fe700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 msgr2=0x7f037803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/113789498 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.752+0000 7f038f7fe700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:58:06.006 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.953+0000 7f038f7fe700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 msgr2=0x7f037803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/113789498 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:58.953+0000 7f038f7fe700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:59.354+0000 7f038f7fe700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 msgr2=0x7f037803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/113789498 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:57:59.354+0000 7f038f7fe700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:00.155+0000 7f038f7fe700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 msgr2=0x7f037803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/113789498 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:00.155+0000 7f038f7fe700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:01.756+0000 7f038f7fe700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 msgr2=0x7f037803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/113789498 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:01.756+0000 7f038f7fe700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:04.584+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 6) v1 ==== 45308+0+0 (secure 0 0 0) 0x7f038002da00 con 0x7f0390107370 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:04.584+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 msgr2=0x7f037803abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:04.584+0000 7f038d7fa700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.585+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f038004e240 con 0x7f0390107370 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.586+0000 7f038d7fa700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f037803be30 0x7f037803e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.586+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f037c000d40 con 0x7f037803be30 2024-05-08T19:58:06.007 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.586+0000 7f038f7fe700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f037803be30 0x7f037803e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.587+0000 7f038f7fe700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f037803be30 0x7f037803e220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0384003a10 tx=0x7f03840092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.587+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f037c000d40 con 0x7f037803be30 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f037c002800 con 0x7f037803be30 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f038d7fa700 1 -- 172.21.15.33:0/287010633 <== mgr.14120 v2:172.21.15.33:6800/2102553152 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f037c002800 con 0x7f037803be30 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f037803be30 msgr2=0x7f037803e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f037803be30 0x7f037803e220 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0384003a10 tx=0x7f03840092b0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 msgr2=0x7f039019a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f039019a680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0380003f70 tx=0x7f0380011b40 comp rx=0 tx=0).stop 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 shutdown_connections 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f037803be30 0x7f037803e220 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0390107370 0x7f039019a680 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 --2- 172.21.15.33:0/287010633 >> [v2:172.21.15.33:6800/113789498,v1:172.21.15.33:6801/113789498] conn(0x7f0378038700 0x7f037803abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 >> 172.21.15.33:0/287010633 conn(0x7f0390100e00 msgr2=0x7f03901019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:06.008 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.600+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 shutdown_connections 2024-05-08T19:58:06.009 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:05.601+0000 7f039697b700 1 -- 172.21.15.33:0/287010633 wait complete. 2024-05-08T19:58:06.009 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 5 is available 2024-05-08T19:58:06.009 INFO:teuthology.orchestra.run.smithi033.stdout:Setting orchestrator backend to cephadm... 2024-05-08T19:58:06.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:06 smithi033 ceph-mon[42490]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T19:58:06.886 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:06 smithi033 ceph-mon[42490]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T19:58:06.886 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:06 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:06.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.354+0000 7f2ec7a06700 1 Processor -- start 2024-05-08T19:58:06.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.354+0000 7f2ec7a06700 1 -- start start 2024-05-08T19:58:06.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.354+0000 7f2ec7a06700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec01097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:06.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.354+0000 7f2ec7a06700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec0079e50 con 0x7f2ec01073d0 2024-05-08T19:58:06.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.354+0000 7f2ec57a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec01097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:06.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.354+0000 7f2ec57a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec01097c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40754/0 (socket says 172.21.15.33:40754) 2024-05-08T19:58:06.946 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.354+0000 7f2ec57a2700 1 -- 172.21.15.33:0/4089263382 learned_addr learned my addr 172.21.15.33:0/4089263382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.355+0000 7f2ec57a2700 1 -- 172.21.15.33:0/4089263382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0109d00 con 0x7f2ec01073d0 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.355+0000 7f2ec57a2700 1 --2- 172.21.15.33:0/4089263382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec01097c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0098a0 tx=0x7f2ebc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824c152a98d635a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.355+0000 7f2eb7fff700 1 -- 172.21.15.33:0/4089263382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ebc004160 con 0x7f2ec01073d0 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.355+0000 7f2eb7fff700 1 -- 172.21.15.33:0/4089263382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2ebc0042c0 con 0x7f2ec01073d0 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.355+0000 7f2eb7fff700 1 -- 172.21.15.33:0/4089263382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ebc011ac0 con 0x7f2ec01073d0 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.355+0000 7f2ec7a06700 1 -- 172.21.15.33:0/4089263382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 msgr2=0x7f2ec01097c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.355+0000 7f2ec7a06700 1 --2- 172.21.15.33:0/4089263382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec01097c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0098a0 tx=0x7f2ebc009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.356+0000 7f2ec7a06700 1 -- 172.21.15.33:0/4089263382 shutdown_connections 2024-05-08T19:58:06.947 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.356+0000 7f2ec7a06700 1 --2- 172.21.15.33:0/4089263382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec01097c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.356+0000 7f2ec7a06700 1 -- 172.21.15.33:0/4089263382 >> 172.21.15.33:0/4089263382 conn(0x7f2ec0100e40 msgr2=0x7f2ec0103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.356+0000 7f2ec7a06700 1 -- 172.21.15.33:0/4089263382 shutdown_connections 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.356+0000 7f2ec7a06700 1 -- 172.21.15.33:0/4089263382 wait complete. 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.356+0000 7f2ec7a06700 1 Processor -- start 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.356+0000 7f2ec7a06700 1 -- start start 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec7a06700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec019a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec7a06700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec019ab60 con 0x7f2ec01073d0 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec57a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec019a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec57a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec019a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40768/0 (socket says 172.21.15.33:40768) 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec57a2700 1 -- 172.21.15.33:0/2716583416 learned_addr learned my addr 172.21.15.33:0/2716583416 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec57a2700 1 -- 172.21.15.33:0/2716583416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc009550 con 0x7f2ec01073d0 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec57a2700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec019a620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc003f70 tx=0x7f2ebc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2eb67fc700 1 -- 172.21.15.33:0/2716583416 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ebc0039f0 con 0x7f2ec01073d0 2024-05-08T19:58:06.948 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2eb67fc700 1 -- 172.21.15.33:0/2716583416 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f2ebc003b50 con 0x7f2ec01073d0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec019ad60 con 0x7f2ec01073d0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.357+0000 7f2eb67fc700 1 -- 172.21.15.33:0/2716583416 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ebc01a760 con 0x7f2ec01073d0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.358+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec019b200 con 0x7f2ec01073d0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.358+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec010aa90 con 0x7f2ec01073d0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.359+0000 7f2eb67fc700 1 -- 172.21.15.33:0/2716583416 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 7) v1 ==== 45435+0+0 (secure 0 0 0) 0x7f2ebc024430 con 0x7f2ec01073d0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.359+0000 7f2eb67fc700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f2eac038590 0x7f2eac03aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.359+0000 7f2eb67fc700 1 -- 172.21.15.33:0/2716583416 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2ebc04cb70 con 0x7f2ec01073d0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.359+0000 7f2ec4fa1700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f2eac038590 0x7f2eac03aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:06.949 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.360+0000 7f2ec4fa1700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f2eac038590 0x7f2eac03aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006fd0 tx=0x7f2eb0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.368+0000 7f2eb67fc700 1 -- 172.21.15.33:0/2716583416 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ebc018940 con 0x7f2ec01073d0 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.597+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ec01020e0 con 0x7f2eac038590 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.608+0000 7f2eb67fc700 1 -- 172.21.15.33:0/2716583416 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f2ec01020e0 con 0x7f2eac038590 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f2eac038590 msgr2=0x7f2eac03aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f2eac038590 0x7f2eac03aa50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0006fd0 tx=0x7f2eb0006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 msgr2=0x7f2ec019a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec019a620 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc003f70 tx=0x7f2ebc011b40 comp rx=0 tx=0).stop 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 shutdown_connections 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f2eac038590 0x7f2eac03aa50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 --2- 172.21.15.33:0/2716583416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ec01073d0 0x7f2ec019a620 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.610+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 >> 172.21.15.33:0/2716583416 conn(0x7f2ec0100e40 msgr2=0x7f2ec01019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:06.950 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.611+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 shutdown_connections 2024-05-08T19:58:06.951 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:06.611+0000 7f2ec7a06700 1 -- 172.21.15.33:0/2716583416 wait complete. 2024-05-08T19:58:07.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:07 smithi033 ceph-mon[42490]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:07.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:07 smithi033 ceph-mon[42490]: mgrmap e8: x(active, since 2s) 2024-05-08T19:58:07.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:07 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:07.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:07 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:07.885 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:07 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:07.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-08T19:58:07.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.336+0000 7f71f3a36700 1 Processor -- start 2024-05-08T19:58:07.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.336+0000 7f71f3a36700 1 -- start start 2024-05-08T19:58:07.929 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.336+0000 7f71f3a36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec104fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.336+0000 7f71f3a36700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec1055b0 con 0x7f71ec104bc0 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.336+0000 7f71f17d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec104fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.336+0000 7f71f17d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec104fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40784/0 (socket says 172.21.15.33:40784) 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.336+0000 7f71f17d2700 1 -- 172.21.15.33:0/3531983956 learned_addr learned my addr 172.21.15.33:0/3531983956 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.337+0000 7f71f17d2700 1 -- 172.21.15.33:0/3531983956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec107b50 con 0x7f71ec104bc0 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.337+0000 7f71f17d2700 1 --2- 172.21.15.33:0/3531983956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec104fe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71e80098a0 tx=0x7f71e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9ee9658161271f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.337+0000 7f71e3fff700 1 -- 172.21.15.33:0/3531983956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e8004160 con 0x7f71ec104bc0 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.337+0000 7f71e3fff700 1 -- 172.21.15.33:0/3531983956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f71e80042c0 con 0x7f71ec104bc0 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.337+0000 7f71e3fff700 1 -- 172.21.15.33:0/3531983956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e8011ac0 con 0x7f71ec104bc0 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.337+0000 7f71f3a36700 1 -- 172.21.15.33:0/3531983956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 msgr2=0x7f71ec104fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.337+0000 7f71f3a36700 1 --2- 172.21.15.33:0/3531983956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec104fe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f71e80098a0 tx=0x7f71e8009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.338+0000 7f71f3a36700 1 -- 172.21.15.33:0/3531983956 shutdown_connections 2024-05-08T19:58:07.930 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.338+0000 7f71f3a36700 1 --2- 172.21.15.33:0/3531983956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec104fe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.338+0000 7f71f3a36700 1 -- 172.21.15.33:0/3531983956 >> 172.21.15.33:0/3531983956 conn(0x7f71ec100550 msgr2=0x7f71ec102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.338+0000 7f71f3a36700 1 -- 172.21.15.33:0/3531983956 shutdown_connections 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.338+0000 7f71f3a36700 1 -- 172.21.15.33:0/3531983956 wait complete. 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f3a36700 1 Processor -- start 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f3a36700 1 -- start start 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f3a36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec19a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f3a36700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec19ac10 con 0x7f71ec104bc0 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f17d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec19a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f17d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec19a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40796/0 (socket says 172.21.15.33:40796) 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f17d2700 1 -- 172.21.15.33:0/1561195334 learned_addr learned my addr 172.21.15.33:0/1561195334 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.339+0000 7f71f17d2700 1 -- 172.21.15.33:0/1561195334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8009550 con 0x7f71ec104bc0 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.340+0000 7f71f17d2700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec19a6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71e8000c00 tx=0x7f71e8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.340+0000 7f71e27fc700 1 -- 172.21.15.33:0/1561195334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e8003aa0 con 0x7f71ec104bc0 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.340+0000 7f71e27fc700 1 -- 172.21.15.33:0/1561195334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f71e8003c00 con 0x7f71ec104bc0 2024-05-08T19:58:07.931 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.340+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec19ae10 con 0x7f71ec104bc0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.340+0000 7f71e27fc700 1 -- 172.21.15.33:0/1561195334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f71e80248a0 con 0x7f71ec104bc0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.340+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec19b2b0 con 0x7f71ec104bc0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.341+0000 7f71e27fc700 1 -- 172.21.15.33:0/1561195334 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f71e801ac60 con 0x7f71ec104bc0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.341+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec10ad80 con 0x7f71ec104bc0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.341+0000 7f71e27fc700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f71d8038750 0x7f71d803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.341+0000 7f71e27fc700 1 -- 172.21.15.33:0/1561195334 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f71e804c710 con 0x7f71ec104bc0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.341+0000 7f71f0fd1700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f71d8038750 0x7f71d803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.342+0000 7f71f0fd1700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f71d8038750 0x7f71d803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71dc006fd0 tx=0x7f71dc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.350+0000 7f71e27fc700 1 -- 172.21.15.33:0/1561195334 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f71e8018530 con 0x7f71ec104bc0 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.564+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f71ec101810 con 0x7f71d8038750 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.565+0000 7f71e27fc700 1 -- 172.21.15.33:0/1561195334 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f71ec101810 con 0x7f71d8038750 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f71d8038750 msgr2=0x7f71d803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f71d8038750 0x7f71d803ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f71dc006fd0 tx=0x7f71dc006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:07.932 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 msgr2=0x7f71ec19a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec19a6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f71e8000c00 tx=0x7f71e8011b40 comp rx=0 tx=0).stop 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 shutdown_connections 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f71d8038750 0x7f71d803ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 --2- 172.21.15.33:0/1561195334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71ec104bc0 0x7f71ec19a6d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 >> 172.21.15.33:0/1561195334 conn(0x7f71ec100550 msgr2=0x7f71ec101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 shutdown_connections 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:07.568+0000 7f71f3a36700 1 -- 172.21.15.33:0/1561195334 wait complete. 2024-05-08T19:58:07.933 INFO:teuthology.orchestra.run.smithi033.stdout:Generating ssh key... 2024-05-08T19:58:08.928 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:08 smithi033 ceph-mon[42490]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:08.928 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:08 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:08.928 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:08 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:08.928 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:08 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: Generating public/private rsa key pair. 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: Your identification has been saved in /tmp/tmprwlw_162/key. 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: Your public key has been saved in /tmp/tmprwlw_162/key.pub. 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: The key fingerprint is: 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: SHA256:hjzCtdK0qyy8124cX0bZjGzusowfNRFjovgGcz+ylNk ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: The key's randomart image is: 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: +---[RSA 3072]----+ 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | . + | 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | . . o o | 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | + = ..= | 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | . X O *.o | 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | + # E+o | 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | =.* o+. | 2024-05-08T19:58:08.929 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | . ooo.+ | 2024-05-08T19:58:08.930 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | o...+oo.. | 2024-05-08T19:58:08.930 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: | .+ooo.+o | 2024-05-08T19:58:08.930 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: +----[SHA256]-----+ 2024-05-08T19:58:08.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.296+0000 7fa395be0700 1 Processor -- start 2024-05-08T19:58:08.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.296+0000 7fa395be0700 1 -- start start 2024-05-08T19:58:08.975 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.297+0000 7fa395be0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390105be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:08.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.297+0000 7fa395be0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3901061b0 con 0x7fa3901057c0 2024-05-08T19:58:08.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.297+0000 7fa38f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390105be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:08.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.297+0000 7fa38f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390105be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40806/0 (socket says 172.21.15.33:40806) 2024-05-08T19:58:08.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.297+0000 7fa38f7fe700 1 -- 172.21.15.33:0/391810544 learned_addr learned my addr 172.21.15.33:0/391810544 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:08.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.297+0000 7fa38f7fe700 1 -- 172.21.15.33:0/391810544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3901069c0 con 0x7fa3901057c0 2024-05-08T19:58:08.976 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.297+0000 7fa38f7fe700 1 --2- 172.21.15.33:0/391810544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390105be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa38000bb40 tx=0x7fa38000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9611df190656adb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:08.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa38e7fc700 1 -- 172.21.15.33:0/391810544 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa38000dbe0 con 0x7fa3901057c0 2024-05-08T19:58:08.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa38e7fc700 1 -- 172.21.15.33:0/391810544 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa3800044f0 con 0x7fa3901057c0 2024-05-08T19:58:08.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa38e7fc700 1 -- 172.21.15.33:0/391810544 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa380010470 con 0x7fa3901057c0 2024-05-08T19:58:08.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa395be0700 1 -- 172.21.15.33:0/391810544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 msgr2=0x7fa390105be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:08.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa395be0700 1 --2- 172.21.15.33:0/391810544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390105be0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa38000bb40 tx=0x7fa38000be50 comp rx=0 tx=0).stop 2024-05-08T19:58:08.977 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa395be0700 1 -- 172.21.15.33:0/391810544 shutdown_connections 2024-05-08T19:58:08.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa395be0700 1 --2- 172.21.15.33:0/391810544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390105be0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:08.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa395be0700 1 -- 172.21.15.33:0/391810544 >> 172.21.15.33:0/391810544 conn(0x7fa390100e00 msgr2=0x7fa390103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:08.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa395be0700 1 -- 172.21.15.33:0/391810544 shutdown_connections 2024-05-08T19:58:08.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.298+0000 7fa395be0700 1 -- 172.21.15.33:0/391810544 wait complete. 2024-05-08T19:58:08.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.299+0000 7fa395be0700 1 Processor -- start 2024-05-08T19:58:08.978 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.299+0000 7fa395be0700 1 -- start start 2024-05-08T19:58:08.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.299+0000 7fa395be0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390190130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:08.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.299+0000 7fa395be0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa390190670 con 0x7fa3901057c0 2024-05-08T19:58:08.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390190130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:08.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390190130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40820/0 (socket says 172.21.15.33:40820) 2024-05-08T19:58:08.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38f7fe700 1 -- 172.21.15.33:0/1776657465 learned_addr learned my addr 172.21.15.33:0/1776657465 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:08.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38f7fe700 1 -- 172.21.15.33:0/1776657465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38000b7f0 con 0x7fa3901057c0 2024-05-08T19:58:08.979 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38f7fe700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390190130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b340 tx=0x7fa380010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:08.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38cff9700 1 -- 172.21.15.33:0/1776657465 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa380004380 con 0x7fa3901057c0 2024-05-08T19:58:08.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38cff9700 1 -- 172.21.15.33:0/1776657465 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa380010b60 con 0x7fa3901057c0 2024-05-08T19:58:08.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa38cff9700 1 -- 172.21.15.33:0/1776657465 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa380021ca0 con 0x7fa3901057c0 2024-05-08T19:58:08.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa390190870 con 0x7fa3901057c0 2024-05-08T19:58:08.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.300+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39018ccc0 con 0x7fa3901057c0 2024-05-08T19:58:08.980 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.301+0000 7fa38cff9700 1 -- 172.21.15.33:0/1776657465 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fa3800193f0 con 0x7fa3901057c0 2024-05-08T19:58:08.981 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.301+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa390068030 con 0x7fa3901057c0 2024-05-08T19:58:08.981 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.301+0000 7fa38cff9700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fa378038750 0x7fa37803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:08.981 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.301+0000 7fa38cff9700 1 -- 172.21.15.33:0/1776657465 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa38004cac0 con 0x7fa3901057c0 2024-05-08T19:58:08.981 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.302+0000 7fa38effd700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fa378038750 0x7fa37803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:08.981 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.302+0000 7fa38effd700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fa378038750 0x7fa37803ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa384006fd0 tx=0x7fa384006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:08.981 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.306+0000 7fa38cff9700 1 -- 172.21.15.33:0/1776657465 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa38000e950 con 0x7fa3901057c0 2024-05-08T19:58:08.982 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.518+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fa39018d4c0 con 0x7fa378038750 2024-05-08T19:58:08.982 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.618+0000 7fa38cff9700 1 -- 172.21.15.33:0/1776657465 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa39018d4c0 con 0x7fa378038750 2024-05-08T19:58:08.982 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fa378038750 msgr2=0x7fa37803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:08.982 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fa378038750 0x7fa37803ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa384006fd0 tx=0x7fa384006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:08.982 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 msgr2=0x7fa390190130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:08.982 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390190130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa38000b340 tx=0x7fa380010590 comp rx=0 tx=0).stop 2024-05-08T19:58:08.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 shutdown_connections 2024-05-08T19:58:08.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fa378038750 0x7fa37803ac10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:08.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 --2- 172.21.15.33:0/1776657465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3901057c0 0x7fa390190130 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:08.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 >> 172.21.15.33:0/1776657465 conn(0x7fa390100e00 msgr2=0x7fa3901930f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:08.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 shutdown_connections 2024-05-08T19:58:08.983 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:08.621+0000 7fa395be0700 1 -- 172.21.15.33:0/1776657465 wait complete. 2024-05-08T19:58:09.869 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:09 smithi033 ceph-mon[42490]: [08/May/2024:19:58:07] ENGINE Bus STARTING 2024-05-08T19:58:09.869 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:09 smithi033 ceph-mon[42490]: [08/May/2024:19:58:08] ENGINE Serving on http://172.21.15.33:8765 2024-05-08T19:58:09.869 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:09 smithi033 ceph-mon[42490]: [08/May/2024:19:58:08] ENGINE Serving on https://172.21.15.33:7150 2024-05-08T19:58:09.870 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:09 smithi033 ceph-mon[42490]: [08/May/2024:19:58:08] ENGINE Bus STARTED 2024-05-08T19:58:09.870 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:09 smithi033 ceph-mon[42490]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:09.870 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:09 smithi033 ceph-mon[42490]: Generating ssh key... 2024-05-08T19:58:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOwC03map9NuB042MVigt5yaNSSBPH7PYu2uQ89Q5B52zxIkqCTKEo1r+Khs005BqlDzNQ4i+MciF3hCn5SnwyBkRVIm5tyRFp2aTDEBnu57TsYtlCpLtGIDFd9Yq0rWWiH+l43BPXZN4Q/cb7gm679T4UJDVtQcCrClb6I8cc3IN0i3LW7gTFkzFqMWzyvrVDJ4GLnJMdUinWxu3dZF7FZezUToTbBbnCmOcn1Gf/m3JGghFAIQAMXXGlGm0fwvKS2vqpjp31I2LCHq5JiBGFrrLG6uTyZi+RWXPQgZGkbRWXJ/ItdkamtfyGvGWQDrqdXnxY+Kh8F3gFAzXarglAyZks+4ECLuFXz0BzDoiWOaLfTbXDZiBYTXt4Ecf1OoQ7+cqlHzvU6AtZuRUXBE6/Vg8jKo5Qg4uF5UuJCjekqgvfgRpOi0lEcdbF/7HfwTaTVKRVLOly2Jhm/VmSSDDBgqvztvwUXuhwsho73qF9gYhZH181+mShVtwbcJx2JU= ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:58:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.342+0000 7fbb1335b700 1 Processor -- start 2024-05-08T19:58:09.921 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.342+0000 7fbb1335b700 1 -- start start 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.342+0000 7fbb1335b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c109760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.342+0000 7fbb1335b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c079e70 con 0x7fbb0c107370 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb110f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c109760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb110f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c109760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40836/0 (socket says 172.21.15.33:40836) 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb110f7700 1 -- 172.21.15.33:0/2881916842 learned_addr learned my addr 172.21.15.33:0/2881916842 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb110f7700 1 -- 172.21.15.33:0/2881916842 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c109ca0 con 0x7fbb0c107370 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb110f7700 1 --2- 172.21.15.33:0/2881916842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c109760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb080098a0 tx=0x7fbb08009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8a2e4553a26660 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb03fff700 1 -- 172.21.15.33:0/2881916842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb08004160 con 0x7fbb0c107370 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb03fff700 1 -- 172.21.15.33:0/2881916842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbb080042c0 con 0x7fbb0c107370 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.343+0000 7fbb03fff700 1 -- 172.21.15.33:0/2881916842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb08011ac0 con 0x7fbb0c107370 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.344+0000 7fbb1335b700 1 -- 172.21.15.33:0/2881916842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 msgr2=0x7fbb0c109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.344+0000 7fbb1335b700 1 --2- 172.21.15.33:0/2881916842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c109760 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb080098a0 tx=0x7fbb08009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.344+0000 7fbb1335b700 1 -- 172.21.15.33:0/2881916842 shutdown_connections 2024-05-08T19:58:09.922 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.344+0000 7fbb1335b700 1 --2- 172.21.15.33:0/2881916842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c109760 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.344+0000 7fbb1335b700 1 -- 172.21.15.33:0/2881916842 >> 172.21.15.33:0/2881916842 conn(0x7fbb0c100e00 msgr2=0x7fbb0c103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.344+0000 7fbb1335b700 1 -- 172.21.15.33:0/2881916842 shutdown_connections 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.344+0000 7fbb1335b700 1 -- 172.21.15.33:0/2881916842 wait complete. 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.345+0000 7fbb1335b700 1 Processor -- start 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.345+0000 7fbb1335b700 1 -- start start 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.345+0000 7fbb1335b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c106b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.345+0000 7fbb1335b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c107090 con 0x7fbb0c107370 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb110f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c106b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb110f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c106b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40846/0 (socket says 172.21.15.33:40846) 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb110f7700 1 -- 172.21.15.33:0/2225374171 learned_addr learned my addr 172.21.15.33:0/2225374171 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb110f7700 1 -- 172.21.15.33:0/2225374171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009550 con 0x7fbb0c107370 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb110f7700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c106b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009130 tx=0x7fbb08011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb027fc700 1 -- 172.21.15.33:0/2225374171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb08003aa0 con 0x7fbb0c107370 2024-05-08T19:58:09.923 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb027fc700 1 -- 172.21.15.33:0/2225374171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbb08003c00 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c105320 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb027fc700 1 -- 172.21.15.33:0/2225374171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbb08024800 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.346+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c1057c0 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.347+0000 7fbb027fc700 1 -- 172.21.15.33:0/2225374171 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7fbb0801a430 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.347+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c068030 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.347+0000 7fbb027fc700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbaf8038750 0x7fbaf803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.347+0000 7fbb027fc700 1 -- 172.21.15.33:0/2225374171 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbb0804c7c0 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.348+0000 7fbb108f6700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbaf8038750 0x7fbaf803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.348+0000 7fbb108f6700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbaf8038750 0x7fbaf803ac10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbafc006fd0 tx=0x7fbafc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.353+0000 7fbb027fc700 1 -- 172.21.15.33:0/2225374171 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbb0801abd0 con 0x7fbb0c107370 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.564+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb0c105d70 con 0x7fbaf8038750 2024-05-08T19:58:09.924 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.565+0000 7fbb027fc700 1 -- 172.21.15.33:0/2225374171 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fbb0c105d70 con 0x7fbaf8038750 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbaf8038750 msgr2=0x7fbaf803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbaf8038750 0x7fbaf803ac10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fbafc006fd0 tx=0x7fbafc006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 msgr2=0x7fbb0c106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c106b50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009130 tx=0x7fbb08011b40 comp rx=0 tx=0).stop 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 shutdown_connections 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbaf8038750 0x7fbaf803ac10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 --2- 172.21.15.33:0/2225374171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbb0c107370 0x7fbb0c106b50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 >> 172.21.15.33:0/2225374171 conn(0x7fbb0c100e00 msgr2=0x7fbb0c1019b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 shutdown_connections 2024-05-08T19:58:09.925 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:09.567+0000 7fbb1335b700 1 -- 172.21.15.33:0/2225374171 wait complete. 2024-05-08T19:58:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-08T19:58:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:Adding key to root@localhost authorized_keys... 2024-05-08T19:58:09.926 INFO:teuthology.orchestra.run.smithi033.stdout:Adding host smithi033... 2024-05-08T19:58:10.808 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:10 smithi033 ceph-mon[42490]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:12.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:11 smithi033 ceph-mon[42490]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:12.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:12 smithi033 ceph-mon[42490]: Deploying cephadm binary to smithi033 2024-05-08T19:58:13.262 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Added host 'smithi033' with addr '172.21.15.33' 2024-05-08T19:58:13.262 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.294+0000 7f8d8f99e700 1 Processor -- start 2024-05-08T19:58:13.262 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.294+0000 7f8d8f99e700 1 -- start start 2024-05-08T19:58:13.262 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.294+0000 7f8d8f99e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d881055b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:13.262 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.294+0000 7f8d8f99e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d88079e30 con 0x7f8d88105190 2024-05-08T19:58:13.262 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.295+0000 7f8d8d73a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d881055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.295+0000 7f8d8d73a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d881055b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40860/0 (socket says 172.21.15.33:40860) 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.295+0000 7f8d8d73a700 1 -- 172.21.15.33:0/812888326 learned_addr learned my addr 172.21.15.33:0/812888326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.295+0000 7f8d8d73a700 1 -- 172.21.15.33:0/812888326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d88105af0 con 0x7f8d88105190 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.295+0000 7f8d8d73a700 1 --2- 172.21.15.33:0/812888326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d881055b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d840098a0 tx=0x7f8d84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af05caac8e7ae4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.295+0000 7f8d7ffff700 1 -- 172.21.15.33:0/812888326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d84004160 con 0x7f8d88105190 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d7ffff700 1 -- 172.21.15.33:0/812888326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8d840042c0 con 0x7f8d88105190 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d7ffff700 1 -- 172.21.15.33:0/812888326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d84011ac0 con 0x7f8d88105190 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d8f99e700 1 -- 172.21.15.33:0/812888326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 msgr2=0x7f8d881055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d8f99e700 1 --2- 172.21.15.33:0/812888326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d881055b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d840098a0 tx=0x7f8d84009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d8f99e700 1 -- 172.21.15.33:0/812888326 shutdown_connections 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d8f99e700 1 --2- 172.21.15.33:0/812888326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d881055b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d8f99e700 1 -- 172.21.15.33:0/812888326 >> 172.21.15.33:0/812888326 conn(0x7f8d88100e30 msgr2=0x7f8d88103250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d8f99e700 1 -- 172.21.15.33:0/812888326 shutdown_connections 2024-05-08T19:58:13.263 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.296+0000 7f8d8f99e700 1 -- 172.21.15.33:0/812888326 wait complete. 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.297+0000 7f8d8f99e700 1 Processor -- start 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.297+0000 7f8d8f99e700 1 -- start start 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.297+0000 7f8d8f99e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d8819c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.297+0000 7f8d8f99e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8819cd50 con 0x7f8d88105190 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.297+0000 7f8d8d73a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d8819c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.297+0000 7f8d8d73a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d8819c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40876/0 (socket says 172.21.15.33:40876) 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.297+0000 7f8d8d73a700 1 -- 172.21.15.33:0/3645964660 learned_addr learned my addr 172.21.15.33:0/3645964660 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.298+0000 7f8d8d73a700 1 -- 172.21.15.33:0/3645964660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84009550 con 0x7f8d88105190 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.298+0000 7f8d8d73a700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d8819c810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009130 tx=0x7f8d84011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.298+0000 7f8d7e7fc700 1 -- 172.21.15.33:0/3645964660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d84003aa0 con 0x7f8d88105190 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.298+0000 7f8d7e7fc700 1 -- 172.21.15.33:0/3645964660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8d84003c00 con 0x7f8d88105190 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.298+0000 7f8d7e7fc700 1 -- 172.21.15.33:0/3645964660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8d84024800 con 0x7f8d88105190 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.298+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8819cf50 con 0x7f8d88105190 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.298+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8819d3f0 con 0x7f8d88105190 2024-05-08T19:58:13.264 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.299+0000 7f8d7e7fc700 1 -- 172.21.15.33:0/3645964660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f8d84024ac0 con 0x7f8d88105190 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.299+0000 7f8d7e7fc700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f8d74038700 0x7f8d7403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.299+0000 7f8d7e7fc700 1 -- 172.21.15.33:0/3645964660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8d8404c7e0 con 0x7f8d88105190 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.299+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d88196510 con 0x7f8d88105190 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.299+0000 7f8d8cf39700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f8d74038700 0x7f8d7403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.300+0000 7f8d8cf39700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f8d74038700 0x7f8d7403abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d78006fd0 tx=0x7f8d78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.304+0000 7f8d7e7fc700 1 -- 172.21.15.33:0/3645964660 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8d84024d70 con 0x7f8d88105190 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:10.523+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d8802cf10 con 0x7f8d74038700 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.933+0000 7f8d7e7fc700 1 -- 172.21.15.33:0/3645964660 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f8d8802cf10 con 0x7f8d74038700 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.936+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f8d74038700 msgr2=0x7f8d7403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.936+0000 7f8d8f99e700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f8d74038700 0x7f8d7403abc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8d78006fd0 tx=0x7f8d78006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 msgr2=0x7f8d8819c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d8819c810 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d84009130 tx=0x7f8d84011b40 comp rx=0 tx=0).stop 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 shutdown_connections 2024-05-08T19:58:13.265 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f8d74038700 0x7f8d7403abc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:13.266 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 --2- 172.21.15.33:0/3645964660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d88105190 0x7f8d8819c810 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:13.266 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 >> 172.21.15.33:0/3645964660 conn(0x7f8d88100e30 msgr2=0x7f8d88193650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:13.266 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 shutdown_connections 2024-05-08T19:58:13.266 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:12.937+0000 7f8d8f99e700 1 -- 172.21.15.33:0/3645964660 wait complete. 2024-05-08T19:58:13.266 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mon service... 2024-05-08T19:58:14.098 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:13 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:14.098 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:13 smithi033 ceph-mon[42490]: Added host smithi033 2024-05-08T19:58:14.098 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:13 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:14.529 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-08T19:58:14.529 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.745+0000 7f780685a700 1 Processor -- start 2024-05-08T19:58:14.529 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f780685a700 1 -- start start 2024-05-08T19:58:14.529 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f780685a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f7800105ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:14.529 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f780685a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7800106170 con 0x7f7800105780 2024-05-08T19:58:14.529 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f77fffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f7800105ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:14.529 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f77fffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f7800105ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40308/0 (socket says 172.21.15.33:40308) 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f77fffff700 1 -- 172.21.15.33:0/1221364168 learned_addr learned my addr 172.21.15.33:0/1221364168 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f77fffff700 1 -- 172.21.15.33:0/1221364168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800106980 con 0x7f7800105780 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.746+0000 7f77fffff700 1 --2- 172.21.15.33:0/1221364168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f7800105ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77f00098a0 tx=0x7f77f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2fa8dff533da73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.747+0000 7f77feffd700 1 -- 172.21.15.33:0/1221364168 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77f0004160 con 0x7f7800105780 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.747+0000 7f77feffd700 1 -- 172.21.15.33:0/1221364168 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f77f00042c0 con 0x7f7800105780 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.747+0000 7f77feffd700 1 -- 172.21.15.33:0/1221364168 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77f0011ac0 con 0x7f7800105780 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.747+0000 7f780685a700 1 -- 172.21.15.33:0/1221364168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 msgr2=0x7f7800105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.747+0000 7f780685a700 1 --2- 172.21.15.33:0/1221364168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f7800105ba0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f77f00098a0 tx=0x7f77f0009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.748+0000 7f780685a700 1 -- 172.21.15.33:0/1221364168 shutdown_connections 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.748+0000 7f780685a700 1 --2- 172.21.15.33:0/1221364168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f7800105ba0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.748+0000 7f780685a700 1 -- 172.21.15.33:0/1221364168 >> 172.21.15.33:0/1221364168 conn(0x7f7800100d60 msgr2=0x7f7800103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.748+0000 7f780685a700 1 -- 172.21.15.33:0/1221364168 shutdown_connections 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.748+0000 7f780685a700 1 -- 172.21.15.33:0/1221364168 wait complete. 2024-05-08T19:58:14.530 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.748+0000 7f780685a700 1 Processor -- start 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.748+0000 7f780685a700 1 -- start start 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.749+0000 7f780685a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f780019a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.749+0000 7f780685a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780019ac20 con 0x7f7800105780 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.749+0000 7f77fffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f780019a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.749+0000 7f77fffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f780019a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40314/0 (socket says 172.21.15.33:40314) 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.749+0000 7f77fffff700 1 -- 172.21.15.33:0/360558315 learned_addr learned my addr 172.21.15.33:0/360558315 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.749+0000 7f77fffff700 1 -- 172.21.15.33:0/360558315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f0009550 con 0x7f7800105780 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.749+0000 7f77fffff700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f780019a6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77f0000c00 tx=0x7f77f0011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.750+0000 7f77fd7fa700 1 -- 172.21.15.33:0/360558315 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77f0003aa0 con 0x7f7800105780 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.750+0000 7f77fd7fa700 1 -- 172.21.15.33:0/360558315 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f77f0003c00 con 0x7f7800105780 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.750+0000 7f77fd7fa700 1 -- 172.21.15.33:0/360558315 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f77f00248a0 con 0x7f7800105780 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.750+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780019ae20 con 0x7f7800105780 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.750+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780019b2c0 con 0x7f7800105780 2024-05-08T19:58:14.531 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.751+0000 7f77fd7fa700 1 -- 172.21.15.33:0/360558315 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f77f002d3f0 con 0x7f7800105780 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.751+0000 7f77fd7fa700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f77e8038700 0x7f77e803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.751+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7800194820 con 0x7f7800105780 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.751+0000 7f77fd7fa700 1 -- 172.21.15.33:0/360558315 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f77f004d8d0 con 0x7f7800105780 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.751+0000 7f77ff7fe700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f77e8038700 0x7f77e803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.752+0000 7f77ff7fe700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f77e8038700 0x7f77e803abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77f4006fd0 tx=0x7f77f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.756+0000 7f77fd7fa700 1 -- 172.21.15.33:0/360558315 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f77f0010740 con 0x7f7800105780 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.985+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f780002d010 con 0x7f77e8038700 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.991+0000 7f77fd7fa700 1 -- 172.21.15.33:0/360558315 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f780002d010 con 0x7f77e8038700 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f77e8038700 msgr2=0x7f77e803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f77e8038700 0x7f77e803abc0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f77f4006fd0 tx=0x7f77f4006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 msgr2=0x7f780019a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f780019a6e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f77f0000c00 tx=0x7f77f0011b40 comp rx=0 tx=0).stop 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 shutdown_connections 2024-05-08T19:58:14.532 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f77e8038700 0x7f77e803abc0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:14.533 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 --2- 172.21.15.33:0/360558315 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7800105780 0x7f780019a6e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:14.533 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 >> 172.21.15.33:0/360558315 conn(0x7f7800100d60 msgr2=0x7f7800101cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:14.533 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 shutdown_connections 2024-05-08T19:58:14.533 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:13.993+0000 7f780685a700 1 -- 172.21.15.33:0/360558315 wait complete. 2024-05-08T19:58:14.533 INFO:teuthology.orchestra.run.smithi033.stdout:Deploying unmanaged mgr service... 2024-05-08T19:58:15.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:14 smithi033 ceph-mon[42490]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:15.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:14 smithi033 ceph-mon[42490]: Saving service mon spec with placement count:5 2024-05-08T19:58:15.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:14 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:15.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:14 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:15.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:14 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-08T19:58:15.620 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.923+0000 7f099a61e700 1 Processor -- start 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.923+0000 7f099a61e700 1 -- start start 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.923+0000 7f099a61e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f0994105ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.923+0000 7f099a61e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0994106170 con 0x7f0994105780 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.923+0000 7f0993fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f0994105ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.923+0000 7f0993fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f0994105ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40316/0 (socket says 172.21.15.33:40316) 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.923+0000 7f0993fff700 1 -- 172.21.15.33:0/1087397251 learned_addr learned my addr 172.21.15.33:0/1087397251 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.924+0000 7f0993fff700 1 -- 172.21.15.33:0/1087397251 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0994106980 con 0x7f0994105780 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.924+0000 7f0993fff700 1 --2- 172.21.15.33:0/1087397251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f0994105ba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f098400bb40 tx=0x7f098400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1cf5498fe79d36 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.924+0000 7f0992ffd700 1 -- 172.21.15.33:0/1087397251 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f098400dbe0 con 0x7f0994105780 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.924+0000 7f0992ffd700 1 -- 172.21.15.33:0/1087397251 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0984004510 con 0x7f0994105780 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.924+0000 7f0992ffd700 1 -- 172.21.15.33:0/1087397251 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0984010470 con 0x7f0994105780 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 -- 172.21.15.33:0/1087397251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 msgr2=0x7f0994105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:15.621 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 --2- 172.21.15.33:0/1087397251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f0994105ba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f098400bb40 tx=0x7f098400be50 comp rx=0 tx=0).stop 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 -- 172.21.15.33:0/1087397251 shutdown_connections 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 --2- 172.21.15.33:0/1087397251 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f0994105ba0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 -- 172.21.15.33:0/1087397251 >> 172.21.15.33:0/1087397251 conn(0x7f0994100d60 msgr2=0x7f0994103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 -- 172.21.15.33:0/1087397251 shutdown_connections 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 -- 172.21.15.33:0/1087397251 wait complete. 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.925+0000 7f099a61e700 1 Processor -- start 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.926+0000 7f099a61e700 1 -- start start 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.926+0000 7f099a61e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f099419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.926+0000 7f099a61e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099419ce90 con 0x7f0994105780 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.926+0000 7f0993fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f099419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.926+0000 7f0993fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f099419c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40322/0 (socket says 172.21.15.33:40322) 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.926+0000 7f0993fff700 1 -- 172.21.15.33:0/1850633952 learned_addr learned my addr 172.21.15.33:0/1850633952 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:15.622 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.926+0000 7f0993fff700 1 -- 172.21.15.33:0/1850633952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098400b7f0 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.927+0000 7f0993fff700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f099419c950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0984006fa0 tx=0x7f0984003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.927+0000 7f09917fa700 1 -- 172.21.15.33:0/1850633952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0984004230 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.927+0000 7f09917fa700 1 -- 172.21.15.33:0/1850633952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0984004390 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.927+0000 7f09917fa700 1 -- 172.21.15.33:0/1850633952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0984019ba0 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.927+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099419d090 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.927+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099419d4d0 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.928+0000 7f09917fa700 1 -- 172.21.15.33:0/1850633952 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f098402a450 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.928+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0994078fd0 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.928+0000 7f09917fa700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f097c0386b0 0x7f097c03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.928+0000 7f09917fa700 1 -- 172.21.15.33:0/1850633952 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f098404c860 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.929+0000 7f09937fe700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f097c0386b0 0x7f097c03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.929+0000 7f09937fe700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f097c0386b0 0x7f097c03ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0988006fd0 tx=0x7f0988006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:14.934+0000 7f09917fa700 1 -- 172.21.15.33:0/1850633952 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0984028940 con 0x7f0994105780 2024-05-08T19:58:15.623 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.174+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f09940613e0 con 0x7f097c0386b0 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.182+0000 7f09917fa700 1 -- 172.21.15.33:0/1850633952 <== mgr.14120 v2:172.21.15.33:6800/2102553152 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f09940613e0 con 0x7f097c0386b0 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.184+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f097c0386b0 msgr2=0x7f097c03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.184+0000 7f099a61e700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f097c0386b0 0x7f097c03ab70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0988006fd0 tx=0x7f0988006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.184+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 msgr2=0x7f099419c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.184+0000 7f099a61e700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f099419c950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0984006fa0 tx=0x7f0984003d40 comp rx=0 tx=0).stop 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.185+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 shutdown_connections 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.185+0000 7f099a61e700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f097c0386b0 0x7f097c03ab70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.185+0000 7f099a61e700 1 --2- 172.21.15.33:0/1850633952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0994105780 0x7f099419c950 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.185+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 >> 172.21.15.33:0/1850633952 conn(0x7f0994100d60 msgr2=0x7f0994193170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.185+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 shutdown_connections 2024-05-08T19:58:15.624 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:15.185+0000 7f099a61e700 1 -- 172.21.15.33:0/1850633952 wait complete. 2024-05-08T19:58:16.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:16 smithi033 ceph-mon[42490]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:16.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:16 smithi033 ceph-mon[42490]: Saving service mgr spec with placement count:2 2024-05-08T19:58:16.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:16 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:16.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:16 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:16.661 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.045+0000 7f7ae1bcf700 1 Processor -- start 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.045+0000 7f7ae1bcf700 1 -- start start 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.046+0000 7f7ae1bcf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc1055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.046+0000 7f7ae1bcf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc079f50 con 0x7f7adc1051c0 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.046+0000 7f7adb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc1055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.046+0000 7f7adb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc1055e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40324/0 (socket says 172.21.15.33:40324) 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.046+0000 7f7adb7fe700 1 -- 172.21.15.33:0/4209307214 learned_addr learned my addr 172.21.15.33:0/4209307214 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.046+0000 7f7adb7fe700 1 -- 172.21.15.33:0/4209307214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc105b20 con 0x7f7adc1051c0 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.046+0000 7f7adb7fe700 1 --2- 172.21.15.33:0/4209307214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc1055e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098a0 tx=0x7f7acc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ca22ba2a35876a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.047+0000 7f7ada7fc700 1 -- 172.21.15.33:0/4209307214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc004160 con 0x7f7adc1051c0 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.047+0000 7f7ada7fc700 1 -- 172.21.15.33:0/4209307214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7acc0042c0 con 0x7f7adc1051c0 2024-05-08T19:58:16.662 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.047+0000 7f7ada7fc700 1 -- 172.21.15.33:0/4209307214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc011a80 con 0x7f7adc1051c0 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/4209307214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 msgr2=0x7f7adc1055e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 --2- 172.21.15.33:0/4209307214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc1055e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0098a0 tx=0x7f7acc009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/4209307214 shutdown_connections 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 --2- 172.21.15.33:0/4209307214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc1055e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/4209307214 >> 172.21.15.33:0/4209307214 conn(0x7f7adc100e40 msgr2=0x7f7adc103260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/4209307214 shutdown_connections 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/4209307214 wait complete. 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.048+0000 7f7ae1bcf700 1 Processor -- start 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.049+0000 7f7ae1bcf700 1 -- start start 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.049+0000 7f7ae1bcf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.049+0000 7f7ae1bcf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc19ce70 con 0x7f7adc1051c0 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.049+0000 7f7adb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:16.663 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.049+0000 7f7adb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc19c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40338/0 (socket says 172.21.15.33:40338) 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.049+0000 7f7adb7fe700 1 -- 172.21.15.33:0/827923060 learned_addr learned my addr 172.21.15.33:0/827923060 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.049+0000 7f7adb7fe700 1 -- 172.21.15.33:0/827923060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009550 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.050+0000 7f7adb7fe700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc19c930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009130 tx=0x7f7acc011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.050+0000 7f7ad8ff9700 1 -- 172.21.15.33:0/827923060 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc003aa0 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.050+0000 7f7ad8ff9700 1 -- 172.21.15.33:0/827923060 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7acc003c00 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.050+0000 7f7ad8ff9700 1 -- 172.21.15.33:0/827923060 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7acc0248a0 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.050+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc19d070 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.050+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc19d510 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.051+0000 7f7ad8ff9700 1 -- 172.21.15.33:0/827923060 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f7acc024a60 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.051+0000 7f7ad8ff9700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f7ac4038700 0x7f7ac403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.051+0000 7f7ad8ff9700 1 -- 172.21.15.33:0/827923060 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7acc04c970 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.051+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc196680 con 0x7f7adc1051c0 2024-05-08T19:58:16.664 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.052+0000 7f7adaffd700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f7ac4038700 0x7f7ac403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.052+0000 7f7adaffd700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f7ac4038700 0x7f7ac403abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006fd0 tx=0x7f7ad0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.057+0000 7f7ad8ff9700 1 -- 172.21.15.33:0/827923060 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7acc024d10 con 0x7f7adc1051c0 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.283+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f7adc068030 con 0x7f7adc1051c0 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.289+0000 7f7ad8ff9700 1 -- 172.21.15.33:0/827923060 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7acc02c350 con 0x7f7adc1051c0 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f7ac4038700 msgr2=0x7f7ac403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f7ac4038700 0x7f7ac403abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0006fd0 tx=0x7f7ad0006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 msgr2=0x7f7adc19c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc19c930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009130 tx=0x7f7acc011b00 comp rx=0 tx=0).stop 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 shutdown_connections 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f7ac4038700 0x7f7ac403abc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 --2- 172.21.15.33:0/827923060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7adc1051c0 0x7f7adc19c930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.291+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 >> 172.21.15.33:0/827923060 conn(0x7f7adc100e40 msgr2=0x7f7adc1937c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.292+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 shutdown_connections 2024-05-08T19:58:16.665 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:16.292+0000 7f7ae1bcf700 1 -- 172.21.15.33:0/827923060 wait complete. 2024-05-08T19:58:17.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:17 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/827923060' entity='client.admin' 2024-05-08T19:58:17.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:17 smithi033 ceph-mon[42490]: from='mgr.14120 172.21.15.33:0/4139457887' entity='mgr.x' 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.043+0000 7f6a4392c700 1 Processor -- start 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.043+0000 7f6a4392c700 1 -- start start 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.043+0000 7f6a4392c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c105ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.043+0000 7f6a4392c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c106170 con 0x7f6a3c105780 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.043+0000 7f6a416c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c105ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.044+0000 7f6a416c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c105ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40342/0 (socket says 172.21.15.33:40342) 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.044+0000 7f6a416c8700 1 -- 172.21.15.33:0/1156161520 learned_addr learned my addr 172.21.15.33:0/1156161520 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.044+0000 7f6a416c8700 1 -- 172.21.15.33:0/1156161520 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c106980 con 0x7f6a3c105780 2024-05-08T19:58:17.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.044+0000 7f6a416c8700 1 --2- 172.21.15.33:0/1156161520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c105ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a380098a0 tx=0x7f6a38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4719f9a2d87acfa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:17.792 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.044+0000 7f6a33fff700 1 -- 172.21.15.33:0/1156161520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a38004160 con 0x7f6a3c105780 2024-05-08T19:58:17.792 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.044+0000 7f6a33fff700 1 -- 172.21.15.33:0/1156161520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6a380042c0 con 0x7f6a3c105780 2024-05-08T19:58:17.792 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.044+0000 7f6a33fff700 1 -- 172.21.15.33:0/1156161520 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a38011a80 con 0x7f6a3c105780 2024-05-08T19:58:17.792 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.045+0000 7f6a4392c700 1 -- 172.21.15.33:0/1156161520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 msgr2=0x7f6a3c105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:17.792 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.045+0000 7f6a4392c700 1 --2- 172.21.15.33:0/1156161520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c105ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a380098a0 tx=0x7f6a38009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:17.795 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.045+0000 7f6a4392c700 1 -- 172.21.15.33:0/1156161520 shutdown_connections 2024-05-08T19:58:17.795 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.045+0000 7f6a4392c700 1 --2- 172.21.15.33:0/1156161520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c105ba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:17.795 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.045+0000 7f6a4392c700 1 -- 172.21.15.33:0/1156161520 >> 172.21.15.33:0/1156161520 conn(0x7f6a3c100d60 msgr2=0x7f6a3c103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:17.795 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.045+0000 7f6a4392c700 1 -- 172.21.15.33:0/1156161520 shutdown_connections 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.045+0000 7f6a4392c700 1 -- 172.21.15.33:0/1156161520 wait complete. 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.046+0000 7f6a4392c700 1 Processor -- start 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.046+0000 7f6a4392c700 1 -- start start 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.046+0000 7f6a4392c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c19c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.046+0000 7f6a4392c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c19cdb0 con 0x7f6a3c105780 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.046+0000 7f6a416c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c19c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.046+0000 7f6a416c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c19c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40346/0 (socket says 172.21.15.33:40346) 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.046+0000 7f6a416c8700 1 -- 172.21.15.33:0/3354978026 learned_addr learned my addr 172.21.15.33:0/3354978026 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.047+0000 7f6a416c8700 1 -- 172.21.15.33:0/3354978026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38009550 con 0x7f6a3c105780 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.047+0000 7f6a416c8700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c19c870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a38011740 tx=0x7f6a38011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.047+0000 7f6a327fc700 1 -- 172.21.15.33:0/3354978026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a380039e0 con 0x7f6a3c105780 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.047+0000 7f6a327fc700 1 -- 172.21.15.33:0/3354978026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6a38003b40 con 0x7f6a3c105780 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.047+0000 7f6a327fc700 1 -- 172.21.15.33:0/3354978026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6a38024710 con 0x7f6a3c105780 2024-05-08T19:58:17.796 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.047+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3c19cfb0 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.047+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3c19d450 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.048+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a3c078fd0 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.048+0000 7f6a327fc700 1 -- 172.21.15.33:0/3354978026 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7f6a3801ab30 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.049+0000 7f6a327fc700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f6a280386a0 0x7f6a2803ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.049+0000 7f6a327fc700 1 -- 172.21.15.33:0/3354978026 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6a38055760 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.049+0000 7f6a40ec7700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f6a280386a0 0x7f6a2803ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.049+0000 7f6a40ec7700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f6a280386a0 0x7f6a2803ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c006fd0 tx=0x7f6a2c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.054+0000 7f6a327fc700 1 -- 172.21.15.33:0/3354978026 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6a38052060 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.285+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f6a3c195fb0 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.291+0000 7f6a327fc700 1 -- 172.21.15.33:0/3354978026 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f6a38052020 con 0x7f6a3c105780 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f6a280386a0 msgr2=0x7f6a2803ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f6a280386a0 0x7f6a2803ab60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c006fd0 tx=0x7f6a2c006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:17.797 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 msgr2=0x7f6a3c19c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c19c870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a38011740 tx=0x7f6a38011b00 comp rx=0 tx=0).stop 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 shutdown_connections 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7f6a280386a0 0x7f6a2803ab60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 --2- 172.21.15.33:0/3354978026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a3c105780 0x7f6a3c19c870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 >> 172.21.15.33:0/3354978026 conn(0x7f6a3c100d60 msgr2=0x7f6a3c193070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 shutdown_connections 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:17.294+0000 7f6a4392c700 1 -- 172.21.15.33:0/3354978026 wait complete. 2024-05-08T19:58:17.798 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling the dashboard module... 2024-05-08T19:58:18.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:18 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3354978026' entity='client.admin' 2024-05-08T19:58:19.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:19 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2750943731' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-08T19:58:19.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: ignoring --setuser ceph since I am not root 2024-05-08T19:58:19.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: ignoring --setgroup ceph since I am not root 2024-05-08T19:58:19.786 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.423+0000 7ff9726ca700 1 Processor -- start 2024-05-08T19:58:19.786 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.423+0000 7ff9726ca700 1 -- start start 2024-05-08T19:58:19.786 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.424+0000 7ff9726ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c105ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.424+0000 7ff9726ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c106170 con 0x7ff96c105780 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.424+0000 7ff96bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c105ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.424+0000 7ff96bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c105ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40358/0 (socket says 172.21.15.33:40358) 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.424+0000 7ff96bfff700 1 -- 172.21.15.33:0/2604905946 learned_addr learned my addr 172.21.15.33:0/2604905946 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.424+0000 7ff96bfff700 1 -- 172.21.15.33:0/2604905946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c106980 con 0x7ff96c105780 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff96bfff700 1 --2- 172.21.15.33:0/2604905946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c105ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00bb40 tx=0x7ff95c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d845df3c4571eb52 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff96affd700 1 -- 172.21.15.33:0/2604905946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff95c00dbe0 con 0x7ff96c105780 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff96affd700 1 -- 172.21.15.33:0/2604905946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff95c004510 con 0x7ff96c105780 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff96affd700 1 -- 172.21.15.33:0/2604905946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff95c010470 con 0x7ff96c105780 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff9726ca700 1 -- 172.21.15.33:0/2604905946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 msgr2=0x7ff96c105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:19.787 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff9726ca700 1 --2- 172.21.15.33:0/2604905946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c105ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00bb40 tx=0x7ff95c00be50 comp rx=0 tx=0).stop 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff9726ca700 1 -- 172.21.15.33:0/2604905946 shutdown_connections 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff9726ca700 1 --2- 172.21.15.33:0/2604905946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c105ba0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.425+0000 7ff9726ca700 1 -- 172.21.15.33:0/2604905946 >> 172.21.15.33:0/2604905946 conn(0x7ff96c100d60 msgr2=0x7ff96c103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.426+0000 7ff9726ca700 1 -- 172.21.15.33:0/2604905946 shutdown_connections 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.426+0000 7ff9726ca700 1 -- 172.21.15.33:0/2604905946 wait complete. 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.426+0000 7ff9726ca700 1 Processor -- start 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.426+0000 7ff9726ca700 1 -- start start 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff9726ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff9726ca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c19ce50 con 0x7ff96c105780 2024-05-08T19:58:19.788 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff96bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff96bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c19c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40364/0 (socket says 172.21.15.33:40364) 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff96bfff700 1 -- 172.21.15.33:0/2750943731 learned_addr learned my addr 172.21.15.33:0/2750943731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff96bfff700 1 -- 172.21.15.33:0/2750943731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c00b7f0 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff96bfff700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c19c910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff95c003c60 tx=0x7ff95c003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff95c004340 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff95c010bc0 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c19d050 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.427+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff95c019c00 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.428+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c19d490 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.428+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 45541+0+0 (secure 0 0 0) 0x7ff95c0106e0 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.429+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c078fd0 con 0x7ff96c105780 2024-05-08T19:58:19.789 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.429+0000 7ff9697fa700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff954038700 0x7ff95403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.429+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff95c04c8c0 con 0x7ff96c105780 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.429+0000 7ff96b7fe700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff954038700 0x7ff95403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.429+0000 7ff96b7fe700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff954038700 0x7ff95403abc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff960006fd0 tx=0x7ff960006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.434+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff95c0193f0 con 0x7ff96c105780 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:18.705+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7ff96c191c40 con 0x7ff96c105780 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.308+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7ff95c0203c0 con 0x7ff96c105780 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.310+0000 7ff9697fa700 1 -- 172.21.15.33:0/2750943731 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7ff95c015250 con 0x7ff96c105780 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff954038700 msgr2=0x7ff95403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff954038700 0x7ff95403abc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff960006fd0 tx=0x7ff960006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 msgr2=0x7ff96c19c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c19c910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff95c003c60 tx=0x7ff95c003980 comp rx=0 tx=0).stop 2024-05-08T19:58:19.790 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 shutdown_connections 2024-05-08T19:58:19.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff954038700 0x7ff95403abc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:19.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 --2- 172.21.15.33:0/2750943731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff96c105780 0x7ff96c19c910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:19.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 >> 172.21.15.33:0/2750943731 conn(0x7ff96c100d60 msgr2=0x7ff96c18ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:19.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 shutdown_connections 2024-05-08T19:58:19.791 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:19.313+0000 7ff9726ca700 1 -- 172.21.15.33:0/2750943731 wait complete. 2024-05-08T19:58:20.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:19.809+0000 7f5bd78d1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T19:58:20.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:19.922+0000 7f5bd78d1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T19:58:20.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:20.023+0000 7f5bd78d1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T19:58:20.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:20 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2750943731' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-08T19:58:20.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:20 smithi033 ceph-mon[42490]: mgrmap e9: x(active, since 14s) 2024-05-08T19:58:20.465 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:20.121+0000 7f5bd78d1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T19:58:20.811 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:58:20.811 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-08T19:58:20.811 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T19:58:20.811 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.163+0000 7fbd8bb8c700 1 Processor -- start 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.163+0000 7fbd8bb8c700 1 -- start start 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.163+0000 7fbd8bb8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd841055c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.163+0000 7fbd8bb8c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd84079e30 con 0x7fbd841051a0 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd89928700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd841055c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd89928700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd841055c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40382/0 (socket says 172.21.15.33:40382) 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd89928700 1 -- 172.21.15.33:0/886916731 learned_addr learned my addr 172.21.15.33:0/886916731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd89928700 1 -- 172.21.15.33:0/886916731 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd84105b00 con 0x7fbd841051a0 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd89928700 1 --2- 172.21.15.33:0/886916731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd841055c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098a0 tx=0x7fbd80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32dbbd9f258de46d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd88926700 1 -- 172.21.15.33:0/886916731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd80004160 con 0x7fbd841051a0 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd88926700 1 -- 172.21.15.33:0/886916731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd800042c0 con 0x7fbd841051a0 2024-05-08T19:58:20.812 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.164+0000 7fbd88926700 1 -- 172.21.15.33:0/886916731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd80011a80 con 0x7fbd841051a0 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.165+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/886916731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 msgr2=0x7fbd841055c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.165+0000 7fbd8bb8c700 1 --2- 172.21.15.33:0/886916731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd841055c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098a0 tx=0x7fbd80009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.165+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/886916731 shutdown_connections 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.165+0000 7fbd8bb8c700 1 --2- 172.21.15.33:0/886916731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd841055c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.165+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/886916731 >> 172.21.15.33:0/886916731 conn(0x7fbd84100e00 msgr2=0x7fbd84103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.165+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/886916731 shutdown_connections 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.165+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/886916731 wait complete. 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.166+0000 7fbd8bb8c700 1 Processor -- start 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.166+0000 7fbd8bb8c700 1 -- start start 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.166+0000 7fbd8bb8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd8419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.166+0000 7fbd8bb8c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8419cdf0 con 0x7fbd841051a0 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.166+0000 7fbd89928700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd8419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.166+0000 7fbd89928700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd8419c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40398/0 (socket says 172.21.15.33:40398) 2024-05-08T19:58:20.813 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.166+0000 7fbd89928700 1 -- 172.21.15.33:0/2991226980 learned_addr learned my addr 172.21.15.33:0/2991226980 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.167+0000 7fbd89928700 1 -- 172.21.15.33:0/2991226980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009550 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.167+0000 7fbd89928700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd8419c8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd80011740 tx=0x7fbd80011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.167+0000 7fbd7affd700 1 -- 172.21.15.33:0/2991226980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd80003b20 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.167+0000 7fbd7affd700 1 -- 172.21.15.33:0/2991226980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbd8001a910 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.167+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8419cff0 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.167+0000 7fbd7affd700 1 -- 172.21.15.33:0/2991226980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd800248c0 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.167+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8419db50 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.168+0000 7fbd7affd700 1 -- 172.21.15.33:0/2991226980 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fbd8002d3f0 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.168+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd84068030 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.168+0000 7fbd7affd700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 0x7fbd7003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.168+0000 7fbd7affd700 1 -- 172.21.15.33:0/2991226980 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbd8004cba0 con 0x7fbd841051a0 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.168+0000 7fbd89127700 1 -- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 msgr2=0x7fbd7003ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2102553152 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.168+0000 7fbd89127700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 0x7fbd7003ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:58:20.814 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.173+0000 7fbd7affd700 1 -- 172.21.15.33:0/2991226980 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbd80010c00 con 0x7fbd841051a0 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.369+0000 7fbd89127700 1 -- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 msgr2=0x7fbd7003ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2102553152 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.369+0000 7fbd89127700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 0x7fbd7003ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.446+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fbd84107190 con 0x7fbd841051a0 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.447+0000 7fbd7affd700 1 -- 172.21.15.33:0/2991226980 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fbd800107f0 con 0x7fbd841051a0 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 msgr2=0x7fbd7003ac60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 0x7fbd7003ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 msgr2=0x7fbd8419c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd8419c8b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd80011740 tx=0x7fbd80011b00 comp rx=0 tx=0).stop 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 shutdown_connections 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7fbd700387a0 0x7fbd7003ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 --2- 172.21.15.33:0/2991226980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbd841051a0 0x7fbd8419c8b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 >> 172.21.15.33:0/2991226980 conn(0x7fbd84100e00 msgr2=0x7fbd841935c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.449+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 shutdown_connections 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:20.450+0000 7fbd8bb8c700 1 -- 172.21.15.33:0/2991226980 wait complete. 2024-05-08T19:58:20.815 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for the mgr to restart... 2024-05-08T19:58:20.816 INFO:teuthology.orchestra.run.smithi033.stdout:Waiting for mgr epoch 9... 2024-05-08T19:58:21.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:20.871+0000 7f5bd78d1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:58:21.562 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:21 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2991226980' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T19:58:21.562 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:21.169+0000 7f5bd78d1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T19:58:21.563 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:21.267+0000 7f5bd78d1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T19:58:21.563 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:21.391+0000 7f5bd78d1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T19:58:21.563 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:21.572+0000 7f5bd78d1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T19:58:21.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:21.718+0000 7f5bd78d1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T19:58:21.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:21.815+0000 7f5bd78d1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T19:58:22.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:22.239+0000 7f5bd78d1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T19:58:23.003 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:22.685+0000 7f5bd78d1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T19:58:23.003 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:22.907+0000 7f5bd78d1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T19:58:23.003 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:23 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:23.013+0000 7f5bd78d1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T19:58:24.165 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:23 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:23.891+0000 7f5bd78d1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T19:58:24.165 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:24.003+0000 7f5bd78d1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T19:58:24.165 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:24.175+0000 7f5bd78d1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T19:58:25.318 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:24.899+0000 7f5bd78d1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T19:58:25.319 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:25.107+0000 7f5bd78d1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T19:58:25.319 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:25.328+0000 7f5bd78d1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T19:58:26.704 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:26.391+0000 7f5bd78d1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T19:58:27.023 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:26.714+0000 7f5bd78d1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:58:27.023 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:26.815+0000 7f5bd78d1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T19:58:27.023 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 19:58:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T19:58:27.033+0000 7f5bd78d1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: Active manager daemon x restarted 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: Activating manager daemon x 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: osdmap e3: 0 total, 0 up, 0 in 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: mgrmap e10: x(active, starting, since 0.00355846s) 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T19:58:27.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: Manager daemon x is now available 2024-05-08T19:58:27.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:28.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T19:58:28.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T19:58:28.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:28 smithi033 ceph-mon[42490]: mgrmap e11: x(active, since 1.00716s) 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout { 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout } 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.160+0000 7ff8901bd700 1 Processor -- start 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.161+0000 7ff8901bd700 1 -- start start 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.161+0000 7ff8901bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff888109740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.161+0000 7ff8901bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888079e90 con 0x7ff888107350 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.161+0000 7ff88df59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff888109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:28.613 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.161+0000 7ff88df59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff888109740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40410/0 (socket says 172.21.15.33:40410) 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.161+0000 7ff88df59700 1 -- 172.21.15.33:0/2502281699 learned_addr learned my addr 172.21.15.33:0/2502281699 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.161+0000 7ff88df59700 1 -- 172.21.15.33:0/2502281699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff888109c80 con 0x7ff888107350 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.162+0000 7ff88df59700 1 --2- 172.21.15.33:0/2502281699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff888109740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8840098a0 tx=0x7ff884009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d32738b41b72f05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.162+0000 7ff88cf57700 1 -- 172.21.15.33:0/2502281699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff884004160 con 0x7ff888107350 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.162+0000 7ff88cf57700 1 -- 172.21.15.33:0/2502281699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff8840042c0 con 0x7ff888107350 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.162+0000 7ff88cf57700 1 -- 172.21.15.33:0/2502281699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff884011a80 con 0x7ff888107350 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 -- 172.21.15.33:0/2502281699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 msgr2=0x7ff888109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 --2- 172.21.15.33:0/2502281699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff888109740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff8840098a0 tx=0x7ff884009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 -- 172.21.15.33:0/2502281699 shutdown_connections 2024-05-08T19:58:28.614 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 --2- 172.21.15.33:0/2502281699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff888109740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 -- 172.21.15.33:0/2502281699 >> 172.21.15.33:0/2502281699 conn(0x7ff888100e00 msgr2=0x7ff888103220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 -- 172.21.15.33:0/2502281699 shutdown_connections 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 -- 172.21.15.33:0/2502281699 wait complete. 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.163+0000 7ff8901bd700 1 Processor -- start 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff8901bd700 1 -- start start 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff8901bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff88819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff8901bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88819aae0 con 0x7ff888107350 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff88df59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff88819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff88df59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff88819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40416/0 (socket says 172.21.15.33:40416) 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff88df59700 1 -- 172.21.15.33:0/3950461392 learned_addr learned my addr 172.21.15.33:0/3950461392 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff88df59700 1 -- 172.21.15.33:0/3950461392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884009550 con 0x7ff888107350 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff88df59700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff88819a5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff884011740 tx=0x7ff884011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.164+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff884003b20 con 0x7ff888107350 2024-05-08T19:58:28.615 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.165+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff88401a910 con 0x7ff888107350 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.165+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88819ace0 con 0x7ff888107350 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.165+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff884024900 con 0x7ff888107350 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.165+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88819b180 con 0x7ff888107350 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.165+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 45554+0+0 (secure 0 0 0) 0x7ff884024b70 con 0x7ff888107350 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.166+0000 7ff87effd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.166+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 --> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff87403b2d0 con 0x7ff874038700 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.166+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff88404d9a0 con 0x7ff888107350 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.166+0000 7ff88d758700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 msgr2=0x7ff87403abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2102553152 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.166+0000 7ff88d758700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.367+0000 7ff88d758700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 msgr2=0x7ff87403abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2102553152 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.367+0000 7ff88d758700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.768+0000 7ff88d758700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 msgr2=0x7ff87403abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2102553152 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:21.768+0000 7ff88d758700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T19:58:28.616 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:22.569+0000 7ff88d758700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 msgr2=0x7ff87403abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2102553152 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:22.569+0000 7ff88d758700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:24.170+0000 7ff88d758700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 msgr2=0x7ff87403abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/2102553152 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:24.170+0000 7ff88d758700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:27.049+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 10) v1 ==== 45321+0+0 (secure 0 0 0) 0x7ff88402d5d0 con 0x7ff888107350 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:27.049+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 msgr2=0x7ff87403abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:27.049+0000 7ff87effd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.052+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7ff88404e910 con 0x7ff888107350 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.052+0000 7ff87effd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff87403bff0 0x7ff87403e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.052+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff87403b2d0 con 0x7ff87403bff0 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.052+0000 7ff88d758700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff87403bff0 0x7ff87403e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.053+0000 7ff88d758700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff87403bff0 0x7ff87403e3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff878003a10 tx=0x7ff8780092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.054+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7ff87403b2d0 con 0x7ff87403bff0 2024-05-08T19:58:28.617 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.061+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff88819b310 con 0x7ff87403bff0 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff87effd700 1 -- 172.21.15.33:0/3950461392 <== mgr.14152 v2:172.21.15.33:6800/3089330166 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7ff87800a050 con 0x7ff87403bff0 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff87403bff0 msgr2=0x7ff87403e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff87403bff0 0x7ff87403e3e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff878003a10 tx=0x7ff8780092b0 comp rx=0 tx=0).stop 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 msgr2=0x7ff88819a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff88819a5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff884011740 tx=0x7ff884011a50 comp rx=0 tx=0).stop 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 shutdown_connections 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff87403bff0 0x7ff87403e3e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff888107350 0x7ff88819a5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 --2- 172.21.15.33:0/3950461392 >> [v2:172.21.15.33:6800/2102553152,v1:172.21.15.33:6801/2102553152] conn(0x7ff874038700 0x7ff87403abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 >> 172.21.15.33:0/3950461392 conn(0x7ff888100e00 msgr2=0x7ff8881018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 shutdown_connections 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:28.062+0000 7ff8901bd700 1 -- 172.21.15.33:0/3950461392 wait complete. 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:mgr epoch 9 is available 2024-05-08T19:58:28.618 INFO:teuthology.orchestra.run.smithi033.stdout:Generating a dashboard self-signed certificate... 2024-05-08T19:58:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:29 smithi033 ceph-mon[42490]: [08/May/2024:19:58:27] ENGINE Bus STARTING 2024-05-08T19:58:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:29 smithi033 ceph-mon[42490]: [08/May/2024:19:58:27] ENGINE Serving on http://172.21.15.33:8765 2024-05-08T19:58:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:29 smithi033 ceph-mon[42490]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T19:58:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:29 smithi033 ceph-mon[42490]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T19:58:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:29 smithi033 ceph-mon[42490]: [08/May/2024:19:58:28] ENGINE Serving on https://172.21.15.33:7150 2024-05-08T19:58:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:29 smithi033 ceph-mon[42490]: [08/May/2024:19:58:28] ENGINE Bus STARTED 2024-05-08T19:58:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.003+0000 7f214c941700 1 Processor -- start 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.003+0000 7f214c941700 1 -- start start 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.004+0000 7f214c941700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148109720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.004+0000 7f214c941700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2148079eb0 con 0x7f2148107330 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.004+0000 7f214659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148109720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.004+0000 7f214659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148109720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39292/0 (socket says 172.21.15.33:39292) 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.004+0000 7f214659c700 1 -- 172.21.15.33:0/288405542 learned_addr learned my addr 172.21.15.33:0/288405542 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:29.652 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.004+0000 7f214659c700 1 -- 172.21.15.33:0/288405542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2148109c60 con 0x7f2148107330 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.005+0000 7f214659c700 1 --2- 172.21.15.33:0/288405542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148109720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21380098a0 tx=0x7f2138009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb023f9ab546af5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.005+0000 7f214559a700 1 -- 172.21.15.33:0/288405542 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2138004160 con 0x7f2148107330 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.005+0000 7f214559a700 1 -- 172.21.15.33:0/288405542 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f21380042c0 con 0x7f2148107330 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.005+0000 7f214559a700 1 -- 172.21.15.33:0/288405542 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2138011a80 con 0x7f2148107330 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.006+0000 7f214c941700 1 -- 172.21.15.33:0/288405542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 msgr2=0x7f2148109720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.006+0000 7f214c941700 1 --2- 172.21.15.33:0/288405542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148109720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21380098a0 tx=0x7f2138009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.006+0000 7f214c941700 1 -- 172.21.15.33:0/288405542 shutdown_connections 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.006+0000 7f214c941700 1 --2- 172.21.15.33:0/288405542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148109720 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.006+0000 7f214c941700 1 -- 172.21.15.33:0/288405542 >> 172.21.15.33:0/288405542 conn(0x7f2148100dc0 msgr2=0x7f21481031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.006+0000 7f214c941700 1 -- 172.21.15.33:0/288405542 shutdown_connections 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.006+0000 7f214c941700 1 -- 172.21.15.33:0/288405542 wait complete. 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214c941700 1 Processor -- start 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214c941700 1 -- start start 2024-05-08T19:58:29.653 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214c941700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148106b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214c941700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21481070a0 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148106b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148106b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39298/0 (socket says 172.21.15.33:39298) 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214659c700 1 -- 172.21.15.33:0/4192127007 learned_addr learned my addr 172.21.15.33:0/4192127007 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.007+0000 7f214659c700 1 -- 172.21.15.33:0/4192127007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009550 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.008+0000 7f214659c700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148106b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2138003f20 tx=0x7f2138011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.008+0000 7f21377fe700 1 -- 172.21.15.33:0/4192127007 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f21380039f0 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.008+0000 7f21377fe700 1 -- 172.21.15.33:0/4192127007 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2138003b50 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.008+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21481052e0 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.008+0000 7f21377fe700 1 -- 172.21.15.33:0/4192127007 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f213801a6d0 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.008+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2148105780 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.009+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214810ab00 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.010+0000 7f21377fe700 1 -- 172.21.15.33:0/4192127007 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 45448+0+0 (secure 0 0 0) 0x7f2138024430 con 0x7f2148107330 2024-05-08T19:58:29.654 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.010+0000 7f21377fe700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f21300385e0 0x7f213003aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.010+0000 7f21377fe700 1 -- 172.21.15.33:0/4192127007 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f213804cda0 con 0x7f2148107330 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.010+0000 7f2145d9b700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f21300385e0 0x7f213003aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.010+0000 7f2145d9b700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f21300385e0 0x7f213003aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f213c006fd0 tx=0x7f213c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.015+0000 7f21377fe700 1 -- 172.21.15.33:0/4192127007 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f21380249a0 con 0x7f2148107330 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.238+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f2148105f30 con 0x7f21300385e0 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.304+0000 7f21377fe700 1 -- 172.21.15.33:0/4192127007 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f2148105f30 con 0x7f21300385e0 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f21300385e0 msgr2=0x7f213003aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f21300385e0 0x7f213003aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f213c006fd0 tx=0x7f213c006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 msgr2=0x7f2148106b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148106b60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2138003f20 tx=0x7f2138011b00 comp rx=0 tx=0).stop 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 shutdown_connections 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f21300385e0 0x7f213003aaa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 --2- 172.21.15.33:0/4192127007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2148107330 0x7f2148106b60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:29.655 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 >> 172.21.15.33:0/4192127007 conn(0x7f2148100dc0 msgr2=0x7f21481018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:29.656 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 shutdown_connections 2024-05-08T19:58:29.656 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:29.307+0000 7f214c941700 1 -- 172.21.15.33:0/4192127007 wait complete. 2024-05-08T19:58:29.656 INFO:teuthology.orchestra.run.smithi033.stdout:Creating initial admin user... 2024-05-08T19:58:30.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:30.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:30 smithi033 ceph-mon[42490]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:30.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:30.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:30.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:30 smithi033 ceph-mon[42490]: mgrmap e12: x(active, since 2s) 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$dze6aSfT.L3KHhAS5rB4SO9op2c/YJ18gkxR.5V0C4CZk7sQ3BDGO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715198310, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.058+0000 7f01d5c17700 1 Processor -- start 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.058+0000 7f01d5c17700 1 -- start start 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.058+0000 7f01d5c17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d007a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.058+0000 7f01d5c17700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d007a800 con 0x7f01d007be10 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.059+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d007a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.059+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d007a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39308/0 (socket says 172.21.15.33:39308) 2024-05-08T19:58:30.910 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.059+0000 7f01cf7fe700 1 -- 172.21.15.33:0/2204172878 learned_addr learned my addr 172.21.15.33:0/2204172878 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.059+0000 7f01cf7fe700 1 -- 172.21.15.33:0/2204172878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d007a940 con 0x7f01d007be10 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.059+0000 7f01cf7fe700 1 --2- 172.21.15.33:0/2204172878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d007a2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01c00098a0 tx=0x7f01c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f46a70131e37343 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.059+0000 7f01ce7fc700 1 -- 172.21.15.33:0/2204172878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c0004160 con 0x7f01d007be10 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01ce7fc700 1 -- 172.21.15.33:0/2204172878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f01c00042c0 con 0x7f01d007be10 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01ce7fc700 1 -- 172.21.15.33:0/2204172878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c0011a80 con 0x7f01d007be10 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01d5c17700 1 -- 172.21.15.33:0/2204172878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 msgr2=0x7f01d007a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01d5c17700 1 --2- 172.21.15.33:0/2204172878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d007a2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f01c00098a0 tx=0x7f01c0009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01d5c17700 1 -- 172.21.15.33:0/2204172878 shutdown_connections 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01d5c17700 1 --2- 172.21.15.33:0/2204172878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d007a2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01d5c17700 1 -- 172.21.15.33:0/2204172878 >> 172.21.15.33:0/2204172878 conn(0x7f01d0101f10 msgr2=0x7f01d0104330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01d5c17700 1 -- 172.21.15.33:0/2204172878 shutdown_connections 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.060+0000 7f01d5c17700 1 -- 172.21.15.33:0/2204172878 wait complete. 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.061+0000 7f01d5c17700 1 Processor -- start 2024-05-08T19:58:30.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.061+0000 7f01d5c17700 1 -- start start 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.061+0000 7f01d5c17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d019c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.061+0000 7f01d5c17700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d019cd40 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d019c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d019c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39320/0 (socket says 172.21.15.33:39320) 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01cf7fe700 1 -- 172.21.15.33:0/2359419763 learned_addr learned my addr 172.21.15.33:0/2359419763 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01cf7fe700 1 -- 172.21.15.33:0/2359419763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009550 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01cf7fe700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d019c800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01c0003f20 tx=0x7f01c0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01ccff9700 1 -- 172.21.15.33:0/2359419763 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c00039f0 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01ccff9700 1 -- 172.21.15.33:0/2359419763 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f01c0003b50 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d019cf40 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01ccff9700 1 -- 172.21.15.33:0/2359419763 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01c001a6d0 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.062+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d019d3e0 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.063+0000 7f01ccff9700 1 -- 172.21.15.33:0/2359419763 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f01c001a990 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.063+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d010ccf0 con 0x7f01d007be10 2024-05-08T19:58:30.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.063+0000 7f01ccff9700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f01bc038700 0x7f01bc03abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.063+0000 7f01ccff9700 1 -- 172.21.15.33:0/2359419763 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f01c004ca80 con 0x7f01d007be10 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.064+0000 7f01ceffd700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f01bc038700 0x7f01bc03abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.064+0000 7f01ceffd700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f01bc038700 0x7f01bc03abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01b8006fd0 tx=0x7f01b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.068+0000 7f01ccff9700 1 -- 172.21.15.33:0/2359419763 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f01c002da50 con 0x7f01d007be10 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.306+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f01d00623f0 con 0x7f01bc038700 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.559+0000 7f01ccff9700 1 -- 172.21.15.33:0/2359419763 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f01d00623f0 con 0x7f01bc038700 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f01bc038700 msgr2=0x7f01bc03abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f01bc038700 0x7f01bc03abc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f01b8006fd0 tx=0x7f01b8006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 msgr2=0x7f01d019c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d019c800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01c0003f20 tx=0x7f01c0011b00 comp rx=0 tx=0).stop 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 shutdown_connections 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f01bc038700 0x7f01bc03abc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 --2- 172.21.15.33:0/2359419763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01d007be10 0x7f01d019c800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:30.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 >> 172.21.15.33:0/2359419763 conn(0x7f01d0101f10 msgr2=0x7f01d0102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 shutdown_connections 2024-05-08T19:58:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:30.562+0000 7f01d5c17700 1 -- 172.21.15.33:0/2359419763 wait complete. 2024-05-08T19:58:30.914 INFO:teuthology.orchestra.run.smithi033.stdout:Fetching dashboard port number... 2024-05-08T19:58:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:31 smithi033 ceph-mon[42490]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:31 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:31.901 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stdout 8443 2024-05-08T19:58:31.901 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.332+0000 7f7ceb8d7700 1 Processor -- start 2024-05-08T19:58:31.901 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.332+0000 7f7ceb8d7700 1 -- start start 2024-05-08T19:58:31.901 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.332+0000 7f7ceb8d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce407a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:31.901 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.332+0000 7f7ceb8d7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce407a8f0 con 0x7f7ce407be70 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7ce9673700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce407a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7ce9673700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce407a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39336/0 (socket says 172.21.15.33:39336) 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7ce9673700 1 -- 172.21.15.33:0/1289322505 learned_addr learned my addr 172.21.15.33:0/1289322505 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7ce9673700 1 -- 172.21.15.33:0/1289322505 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce407aa30 con 0x7f7ce407be70 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7ce9673700 1 --2- 172.21.15.33:0/1289322505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce407a320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40098a0 tx=0x7f7cd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae5863b9a0c1d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7cdbfff700 1 -- 172.21.15.33:0/1289322505 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cd4004160 con 0x7f7ce407be70 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7cdbfff700 1 -- 172.21.15.33:0/1289322505 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7cd40042c0 con 0x7f7ce407be70 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.333+0000 7f7cdbfff700 1 -- 172.21.15.33:0/1289322505 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cd4011a80 con 0x7f7ce407be70 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.334+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/1289322505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 msgr2=0x7f7ce407a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.334+0000 7f7ceb8d7700 1 --2- 172.21.15.33:0/1289322505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce407a320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40098a0 tx=0x7f7cd4009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.334+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/1289322505 shutdown_connections 2024-05-08T19:58:31.902 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.334+0000 7f7ceb8d7700 1 --2- 172.21.15.33:0/1289322505 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce407a320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.334+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/1289322505 >> 172.21.15.33:0/1289322505 conn(0x7f7ce4101fc0 msgr2=0x7f7ce41043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.334+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/1289322505 shutdown_connections 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.334+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/1289322505 wait complete. 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ceb8d7700 1 Processor -- start 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ceb8d7700 1 -- start start 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ceb8d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce419c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ceb8d7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce419cd50 con 0x7f7ce407be70 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ce9673700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce419c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ce9673700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce419c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39348/0 (socket says 172.21.15.33:39348) 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ce9673700 1 -- 172.21.15.33:0/532101604 learned_addr learned my addr 172.21.15.33:0/532101604 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.335+0000 7f7ce9673700 1 -- 172.21.15.33:0/532101604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4009550 con 0x7f7ce407be70 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.336+0000 7f7ce9673700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce419c810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4011740 tx=0x7f7cd4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.336+0000 7f7cda7fc700 1 -- 172.21.15.33:0/532101604 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cd4003b20 con 0x7f7ce407be70 2024-05-08T19:58:31.903 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.336+0000 7f7cda7fc700 1 -- 172.21.15.33:0/532101604 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7cd401a910 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.336+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce419cf50 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.336+0000 7f7cda7fc700 1 -- 172.21.15.33:0/532101604 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cd4024900 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.336+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce419d3f0 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.337+0000 7f7cda7fc700 1 -- 172.21.15.33:0/532101604 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7f7cd4024a60 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.337+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce410cd00 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.337+0000 7f7cda7fc700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7cd0038750 0x7f7cd003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.337+0000 7f7cda7fc700 1 -- 172.21.15.33:0/532101604 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7cd404cbf0 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.337+0000 7f7ce8e72700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7cd0038750 0x7f7cd003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.338+0000 7f7ce8e72700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7cd0038750 0x7f7cd003ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0006fd0 tx=0x7f7ce0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.342+0000 7f7cda7fc700 1 -- 172.21.15.33:0/532101604 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7cd4022310 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.554+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f7ce410cf40 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.555+0000 7f7cda7fc700 1 -- 172.21.15.33:0/532101604 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f7cd402c350 con 0x7f7ce407be70 2024-05-08T19:58:31.904 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7cd0038750 msgr2=0x7f7cd003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7cd0038750 0x7f7cd003ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0006fd0 tx=0x7f7ce0006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 msgr2=0x7f7ce419c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce419c810 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4011740 tx=0x7f7cd4011a50 comp rx=0 tx=0).stop 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 shutdown_connections 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7cd0038750 0x7f7cd003ac10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 --2- 172.21.15.33:0/532101604 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ce407be70 0x7f7ce419c810 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 >> 172.21.15.33:0/532101604 conn(0x7f7ce4101fc0 msgr2=0x7f7ce4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 shutdown_connections 2024-05-08T19:58:31.905 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:31.557+0000 7f7ceb8d7700 1 -- 172.21.15.33:0/532101604 wait complete. 2024-05-08T19:58:31.911 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T19:58:31.911 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout disabled 2024-05-08T19:58:31.920 INFO:teuthology.orchestra.run.smithi033.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T19:58:31.921 INFO:teuthology.orchestra.run.smithi033.stdout:systemctl: stdout inactive 2024-05-08T19:58:31.921 INFO:teuthology.orchestra.run.smithi033.stdout:firewalld.service is not enabled 2024-05-08T19:58:31.921 INFO:teuthology.orchestra.run.smithi033.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-08T19:58:31.923 INFO:teuthology.orchestra.run.smithi033.stdout:Ceph Dashboard is now available at: 2024-05-08T19:58:31.923 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:31.923 INFO:teuthology.orchestra.run.smithi033.stdout: URL: https://smithi033:8443/ 2024-05-08T19:58:31.923 INFO:teuthology.orchestra.run.smithi033.stdout: User: admin 2024-05-08T19:58:31.923 INFO:teuthology.orchestra.run.smithi033.stdout: Password: 7eadl0om0f 2024-05-08T19:58:31.923 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:31.924 INFO:teuthology.orchestra.run.smithi033.stdout:Saving cluster configuration to /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config directory 2024-05-08T19:58:31.924 INFO:teuthology.orchestra.run.smithi033.stdout:Enabling autotune for osd_memory_target 2024-05-08T19:58:32.558 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:32 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/532101604' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-08T19:58:32.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.319+0000 7fa22d70d700 1 Processor -- start 2024-05-08T19:58:32.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.319+0000 7fa22d70d700 1 -- start start 2024-05-08T19:58:32.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.319+0000 7fa22d70d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22807a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:32.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.319+0000 7fa22d70d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22807a820 con 0x7fa22807be30 2024-05-08T19:58:32.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.319+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22807a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:32.911 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.319+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22807a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56976/0 (socket says 172.21.15.33:56976) 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.319+0000 7fa226ffd700 1 -- 172.21.15.33:0/28112874 learned_addr learned my addr 172.21.15.33:0/28112874 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.320+0000 7fa226ffd700 1 -- 172.21.15.33:0/28112874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22807a960 con 0x7fa22807be30 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.320+0000 7fa226ffd700 1 --2- 172.21.15.33:0/28112874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22807a2e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa2180098a0 tx=0x7fa218009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb6e2582cb42aff server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.320+0000 7fa225ffb700 1 -- 172.21.15.33:0/28112874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa218004160 con 0x7fa22807be30 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.320+0000 7fa225ffb700 1 -- 172.21.15.33:0/28112874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa2180042c0 con 0x7fa22807be30 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.320+0000 7fa225ffb700 1 -- 172.21.15.33:0/28112874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa218011a80 con 0x7fa22807be30 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.321+0000 7fa22d70d700 1 -- 172.21.15.33:0/28112874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 msgr2=0x7fa22807a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.321+0000 7fa22d70d700 1 --2- 172.21.15.33:0/28112874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22807a2e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa2180098a0 tx=0x7fa218009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.321+0000 7fa22d70d700 1 -- 172.21.15.33:0/28112874 shutdown_connections 2024-05-08T19:58:32.912 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.321+0000 7fa22d70d700 1 --2- 172.21.15.33:0/28112874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22807a2e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.321+0000 7fa22d70d700 1 -- 172.21.15.33:0/28112874 >> 172.21.15.33:0/28112874 conn(0x7fa228101f40 msgr2=0x7fa228104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.321+0000 7fa22d70d700 1 -- 172.21.15.33:0/28112874 shutdown_connections 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.321+0000 7fa22d70d700 1 -- 172.21.15.33:0/28112874 wait complete. 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.322+0000 7fa22d70d700 1 Processor -- start 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.322+0000 7fa22d70d700 1 -- start start 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.322+0000 7fa22d70d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.322+0000 7fa22d70d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22819cd70 con 0x7fa22807be30 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.322+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.322+0000 7fa226ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22819c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56990/0 (socket says 172.21.15.33:56990) 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.322+0000 7fa226ffd700 1 -- 172.21.15.33:0/893676349 learned_addr learned my addr 172.21.15.33:0/893676349 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.323+0000 7fa226ffd700 1 -- 172.21.15.33:0/893676349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009550 con 0x7fa22807be30 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.323+0000 7fa226ffd700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22819c830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa218003f20 tx=0x7fa218011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.323+0000 7fa20ffff700 1 -- 172.21.15.33:0/893676349 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa218003a70 con 0x7fa22807be30 2024-05-08T19:58:32.913 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.323+0000 7fa20ffff700 1 -- 172.21.15.33:0/893676349 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa218003bd0 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.323+0000 7fa20ffff700 1 -- 172.21.15.33:0/893676349 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa21801a800 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.323+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22819cf70 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.323+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22819d410 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.324+0000 7fa20ffff700 1 -- 172.21.15.33:0/893676349 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 45554+0+0 (secure 0 0 0) 0x7fa218024430 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.324+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22810cd00 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.324+0000 7fa20ffff700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa210038700 0x7fa21003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.325+0000 7fa20ffff700 1 -- 172.21.15.33:0/893676349 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa21804ca60 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.325+0000 7fa2267fc700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa210038700 0x7fa21003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.325+0000 7fa2267fc700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa210038700 0x7fa21003abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa21c006fd0 tx=0x7fa21c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.330+0000 7fa20ffff700 1 -- 172.21.15.33:0/893676349 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa218024aa0 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.541+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fa22810cf40 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.541+0000 7fa20ffff700 1 -- 172.21.15.33:0/893676349 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fa218018350 con 0x7fa22807be30 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa210038700 msgr2=0x7fa21003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:32.914 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa210038700 0x7fa21003abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa21c006fd0 tx=0x7fa21c006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 msgr2=0x7fa22819c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22819c830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa218003f20 tx=0x7fa218011b00 comp rx=0 tx=0).stop 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 shutdown_connections 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa210038700 0x7fa21003abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 --2- 172.21.15.33:0/893676349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa22807be30 0x7fa22819c830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 >> 172.21.15.33:0/893676349 conn(0x7fa228101f40 msgr2=0x7fa228102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 shutdown_connections 2024-05-08T19:58:32.915 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:32.544+0000 7fa22d70d700 1 -- 172.21.15.33:0/893676349 wait complete. 2024-05-08T19:58:34.028 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.297+0000 7fc4dc01e700 1 Processor -- start 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.297+0000 7fc4dc01e700 1 -- start start 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.297+0000 7fc4dc01e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d407a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.297+0000 7fc4dc01e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d407a8f0 con 0x7fc4d407be70 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.297+0000 7fc4d9dba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d407a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.297+0000 7fc4d9dba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d407a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57004/0 (socket says 172.21.15.33:57004) 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.297+0000 7fc4d9dba700 1 -- 172.21.15.33:0/1722107849 learned_addr learned my addr 172.21.15.33:0/1722107849 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.298+0000 7fc4d9dba700 1 -- 172.21.15.33:0/1722107849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d407aa30 con 0x7fc4d407be70 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.298+0000 7fc4d9dba700 1 --2- 172.21.15.33:0/1722107849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d407a320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00098a0 tx=0x7fc4d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93977fc7305afac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.298+0000 7fc4d8db8700 1 -- 172.21.15.33:0/1722107849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0004160 con 0x7fc4d407be70 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.298+0000 7fc4d8db8700 1 -- 172.21.15.33:0/1722107849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc4d00042c0 con 0x7fc4d407be70 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.298+0000 7fc4d8db8700 1 -- 172.21.15.33:0/1722107849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0011a80 con 0x7fc4d407be70 2024-05-08T19:58:34.029 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.299+0000 7fc4dc01e700 1 -- 172.21.15.33:0/1722107849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 msgr2=0x7fc4d407a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.299+0000 7fc4dc01e700 1 --2- 172.21.15.33:0/1722107849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d407a320 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00098a0 tx=0x7fc4d0009bb0 comp rx=0 tx=0).stop 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.299+0000 7fc4dc01e700 1 -- 172.21.15.33:0/1722107849 shutdown_connections 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.299+0000 7fc4dc01e700 1 --2- 172.21.15.33:0/1722107849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d407a320 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.299+0000 7fc4dc01e700 1 -- 172.21.15.33:0/1722107849 >> 172.21.15.33:0/1722107849 conn(0x7fc4d4101f40 msgr2=0x7fc4d4104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.299+0000 7fc4dc01e700 1 -- 172.21.15.33:0/1722107849 shutdown_connections 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.299+0000 7fc4dc01e700 1 -- 172.21.15.33:0/1722107849 wait complete. 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4dc01e700 1 Processor -- start 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4dc01e700 1 -- start start 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4dc01e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d419c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4dc01e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d419cd60 con 0x7fc4d407be70 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4d9dba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d419c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4d9dba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d419c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57016/0 (socket says 172.21.15.33:57016) 2024-05-08T19:58:34.030 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4d9dba700 1 -- 172.21.15.33:0/3932954517 learned_addr learned my addr 172.21.15.33:0/3932954517 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4d9dba700 1 -- 172.21.15.33:0/3932954517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d0009550 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.300+0000 7fc4d9dba700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d419c820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009130 tx=0x7fc4d0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.301+0000 7fc4caffd700 1 -- 172.21.15.33:0/3932954517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4d0003aa0 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.301+0000 7fc4caffd700 1 -- 172.21.15.33:0/3932954517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc4d0003c00 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.301+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d419cf60 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.301+0000 7fc4caffd700 1 -- 172.21.15.33:0/3932954517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4d00248a0 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.301+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d419d400 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.302+0000 7fc4caffd700 1 -- 172.21.15.33:0/3932954517 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fc4d001a430 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.302+0000 7fc4caffd700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4c00387f0 0x7fc4c003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.302+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d410cd20 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.302+0000 7fc4caffd700 1 -- 172.21.15.33:0/3932954517 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc4d004ca00 con 0x7fc4d407be70 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.302+0000 7fc4d95b9700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4c00387f0 0x7fc4c003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.302+0000 7fc4d95b9700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4c00387f0 0x7fc4c003acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4006fd0 tx=0x7fc4c4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:34.031 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.307+0000 7fc4caffd700 1 -- 172.21.15.33:0/3932954517 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc4d001a730 con 0x7fc4d407be70 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.642+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fc4d410cf30 con 0x7fc4d407be70 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.645+0000 7fc4caffd700 1 -- 172.21.15.33:0/3932954517 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fc4d0018350 con 0x7fc4d407be70 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4c00387f0 msgr2=0x7fc4c003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4c00387f0 0x7fc4c003acb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4006fd0 tx=0x7fc4c4006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 msgr2=0x7fc4d419c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d419c820 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009130 tx=0x7fc4d0011b00 comp rx=0 tx=0).stop 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 shutdown_connections 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4c00387f0 0x7fc4c003acb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 --2- 172.21.15.33:0/3932954517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4d407be70 0x7fc4d419c820 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 >> 172.21.15.33:0/3932954517 conn(0x7fc4d4101f40 msgr2=0x7fc4d4102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 shutdown_connections 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr 2024-05-08T19:58:33.647+0000 7fc4dc01e700 1 -- 172.21.15.33:0/3932954517 wait complete. 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-08T19:58:34.032 INFO:teuthology.orchestra.run.smithi033.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout:Or, if you are only running a single cluster on this host: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: ceph telemetry on 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout:For more information see: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-08T19:58:34.033 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:34.034 INFO:teuthology.orchestra.run.smithi033.stdout:Bootstrap complete. 2024-05-08T19:58:34.072 INFO:tasks.cephadm:Fetching config... 2024-05-08T19:58:34.072 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:58:34.072 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-08T19:58:34.091 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-08T19:58:34.091 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:58:34.091 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-08T19:58:34.152 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-08T19:58:34.152 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:58:34.152 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-08T19:58:34.226 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-08T19:58:34.226 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:58:34.226 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-08T19:58:34.287 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-08T19:58:34.288 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOwC03map9NuB042MVigt5yaNSSBPH7PYu2uQ89Q5B52zxIkqCTKEo1r+Khs005BqlDzNQ4i+MciF3hCn5SnwyBkRVIm5tyRFp2aTDEBnu57TsYtlCpLtGIDFd9Yq0rWWiH+l43BPXZN4Q/cb7gm679T4UJDVtQcCrClb6I8cc3IN0i3LW7gTFkzFqMWzyvrVDJ4GLnJMdUinWxu3dZF7FZezUToTbBbnCmOcn1Gf/m3JGghFAIQAMXXGlGm0fwvKS2vqpjp31I2LCHq5JiBGFrrLG6uTyZi+RWXPQgZGkbRWXJ/ItdkamtfyGvGWQDrqdXnxY+Kh8F3gFAzXarglAyZks+4ECLuFXz0BzDoiWOaLfTbXDZiBYTXt4Ecf1OoQ7+cqlHzvU6AtZuRUXBE6/Vg8jKo5Qg4uF5UuJCjekqgvfgRpOi0lEcdbF/7HfwTaTVKRVLOly2Jhm/VmSSDDBgqvztvwUXuhwsho73qF9gYhZH181+mShVtwbcJx2JU= ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T19:58:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:34 smithi033 ceph-mon[42490]: mgrmap e13: x(active, since 6s) 2024-05-08T19:58:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:34 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3932954517' entity='client.admin' 2024-05-08T19:58:34.378 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOwC03map9NuB042MVigt5yaNSSBPH7PYu2uQ89Q5B52zxIkqCTKEo1r+Khs005BqlDzNQ4i+MciF3hCn5SnwyBkRVIm5tyRFp2aTDEBnu57TsYtlCpLtGIDFd9Yq0rWWiH+l43BPXZN4Q/cb7gm679T4UJDVtQcCrClb6I8cc3IN0i3LW7gTFkzFqMWzyvrVDJ4GLnJMdUinWxu3dZF7FZezUToTbBbnCmOcn1Gf/m3JGghFAIQAMXXGlGm0fwvKS2vqpjp31I2LCHq5JiBGFrrLG6uTyZi+RWXPQgZGkbRWXJ/ItdkamtfyGvGWQDrqdXnxY+Kh8F3gFAzXarglAyZks+4ECLuFXz0BzDoiWOaLfTbXDZiBYTXt4Ecf1OoQ7+cqlHzvU6AtZuRUXBE6/Vg8jKo5Qg4uF5UuJCjekqgvfgRpOi0lEcdbF/7HfwTaTVKRVLOly2Jhm/VmSSDDBgqvztvwUXuhwsho73qF9gYhZH181+mShVtwbcJx2JU= ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:58:34.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOwC03map9NuB042MVigt5yaNSSBPH7PYu2uQ89Q5B52zxIkqCTKEo1r+Khs005BqlDzNQ4i+MciF3hCn5SnwyBkRVIm5tyRFp2aTDEBnu57TsYtlCpLtGIDFd9Yq0rWWiH+l43BPXZN4Q/cb7gm679T4UJDVtQcCrClb6I8cc3IN0i3LW7gTFkzFqMWzyvrVDJ4GLnJMdUinWxu3dZF7FZezUToTbBbnCmOcn1Gf/m3JGghFAIQAMXXGlGm0fwvKS2vqpjp31I2LCHq5JiBGFrrLG6uTyZi+RWXPQgZGkbRWXJ/ItdkamtfyGvGWQDrqdXnxY+Kh8F3gFAzXarglAyZks+4ECLuFXz0BzDoiWOaLfTbXDZiBYTXt4Ecf1OoQ7+cqlHzvU6AtZuRUXBE6/Vg8jKo5Qg4uF5UuJCjekqgvfgRpOi0lEcdbF/7HfwTaTVKRVLOly2Jhm/VmSSDDBgqvztvwUXuhwsho73qF9gYhZH181+mShVtwbcJx2JU= ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T19:58:34.440 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOwC03map9NuB042MVigt5yaNSSBPH7PYu2uQ89Q5B52zxIkqCTKEo1r+Khs005BqlDzNQ4i+MciF3hCn5SnwyBkRVIm5tyRFp2aTDEBnu57TsYtlCpLtGIDFd9Yq0rWWiH+l43BPXZN4Q/cb7gm679T4UJDVtQcCrClb6I8cc3IN0i3LW7gTFkzFqMWzyvrVDJ4GLnJMdUinWxu3dZF7FZezUToTbBbnCmOcn1Gf/m3JGghFAIQAMXXGlGm0fwvKS2vqpjp31I2LCHq5JiBGFrrLG6uTyZi+RWXPQgZGkbRWXJ/ItdkamtfyGvGWQDrqdXnxY+Kh8F3gFAzXarglAyZks+4ECLuFXz0BzDoiWOaLfTbXDZiBYTXt4Ecf1OoQ7+cqlHzvU6AtZuRUXBE6/Vg8jKo5Qg4uF5UuJCjekqgvfgRpOi0lEcdbF/7HfwTaTVKRVLOly2Jhm/VmSSDDBgqvztvwUXuhwsho73qF9gYhZH181+mShVtwbcJx2JU= ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:58:34.453 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOwC03map9NuB042MVigt5yaNSSBPH7PYu2uQ89Q5B52zxIkqCTKEo1r+Khs005BqlDzNQ4i+MciF3hCn5SnwyBkRVIm5tyRFp2aTDEBnu57TsYtlCpLtGIDFd9Yq0rWWiH+l43BPXZN4Q/cb7gm679T4UJDVtQcCrClb6I8cc3IN0i3LW7gTFkzFqMWzyvrVDJ4GLnJMdUinWxu3dZF7FZezUToTbBbnCmOcn1Gf/m3JGghFAIQAMXXGlGm0fwvKS2vqpjp31I2LCHq5JiBGFrrLG6uTyZi+RWXPQgZGkbRWXJ/ItdkamtfyGvGWQDrqdXnxY+Kh8F3gFAzXarglAyZks+4ECLuFXz0BzDoiWOaLfTbXDZiBYTXt4Ecf1OoQ7+cqlHzvU6AtZuRUXBE6/Vg8jKo5Qg4uF5UuJCjekqgvfgRpOi0lEcdbF/7HfwTaTVKRVLOly2Jhm/VmSSDDBgqvztvwUXuhwsho73qF9gYhZH181+mShVtwbcJx2JU= ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T19:58:34.499 INFO:teuthology.orchestra.run.smithi132.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdOwC03map9NuB042MVigt5yaNSSBPH7PYu2uQ89Q5B52zxIkqCTKEo1r+Khs005BqlDzNQ4i+MciF3hCn5SnwyBkRVIm5tyRFp2aTDEBnu57TsYtlCpLtGIDFd9Yq0rWWiH+l43BPXZN4Q/cb7gm679T4UJDVtQcCrClb6I8cc3IN0i3LW7gTFkzFqMWzyvrVDJ4GLnJMdUinWxu3dZF7FZezUToTbBbnCmOcn1Gf/m3JGghFAIQAMXXGlGm0fwvKS2vqpjp31I2LCHq5JiBGFrrLG6uTyZi+RWXPQgZGkbRWXJ/ItdkamtfyGvGWQDrqdXnxY+Kh8F3gFAzXarglAyZks+4ECLuFXz0BzDoiWOaLfTbXDZiBYTXt4Ecf1OoQ7+cqlHzvU6AtZuRUXBE6/Vg8jKo5Qg4uF5UuJCjekqgvfgRpOi0lEcdbF/7HfwTaTVKRVLOly2Jhm/VmSSDDBgqvztvwUXuhwsho73qF9gYhZH181+mShVtwbcJx2JU= ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:58:34.512 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-08T19:58:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:58:35.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.774+0000 7f276312c700 1 -- 172.21.15.33:0/2729133742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 msgr2=0x7f275c0ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.774+0000 7f276312c700 1 --2- 172.21.15.33:0/2729133742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c0ffc50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2750009910 tx=0x7f2750009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.774+0000 7f276312c700 1 -- 172.21.15.33:0/2729133742 shutdown_connections 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.774+0000 7f276312c700 1 --2- 172.21.15.33:0/2729133742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c0ffc50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.774+0000 7f276312c700 1 -- 172.21.15.33:0/2729133742 >> 172.21.15.33:0/2729133742 conn(0x7f275c0fadd0 msgr2=0x7f275c0fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.774+0000 7f276312c700 1 -- 172.21.15.33:0/2729133742 shutdown_connections 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.774+0000 7f276312c700 1 -- 172.21.15.33:0/2729133742 wait complete. 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f276312c700 1 Processor -- start 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f276312c700 1 -- start start 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f276312c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f276312c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c1963b0 con 0x7f275c0ff830 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f2760ec8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:35.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f2760ec8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c195e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57036/0 (socket says 172.21.15.33:57036) 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f2760ec8700 1 -- 172.21.15.33:0/890830765 learned_addr learned my addr 172.21.15.33:0/890830765 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.775+0000 7f2760ec8700 1 -- 172.21.15.33:0/890830765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500095f0 con 0x7f275c0ff830 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.776+0000 7f2760ec8700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c195e70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2750004f40 tx=0x7f2750005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.776+0000 7f2759ffb700 1 -- 172.21.15.33:0/890830765 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f275001d070 con 0x7f275c0ff830 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.776+0000 7f2759ffb700 1 -- 172.21.15.33:0/890830765 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f27500044a0 con 0x7f275c0ff830 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.776+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c1965b0 con 0x7f275c0ff830 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.776+0000 7f2759ffb700 1 -- 172.21.15.33:0/890830765 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2750003a40 con 0x7f275c0ff830 2024-05-08T19:58:35.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.776+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c196a50 con 0x7f275c0ff830 2024-05-08T19:58:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.777+0000 7f2759ffb700 1 -- 172.21.15.33:0/890830765 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2750003cb0 con 0x7f275c0ff830 2024-05-08T19:58:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.777+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275c18f9b0 con 0x7f275c0ff830 2024-05-08T19:58:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.777+0000 7f2759ffb700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f274c0387f0 0x7f274c03acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.777+0000 7f2759ffb700 1 -- 172.21.15.33:0/890830765 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f275004c7a0 con 0x7f275c0ff830 2024-05-08T19:58:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.777+0000 7f275bfff700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f274c0387f0 0x7f274c03acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.778+0000 7f275bfff700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f274c0387f0 0x7f274c03acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2748006fd0 tx=0x7f2748006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.782+0000 7f2759ffb700 1 -- 172.21.15.33:0/890830765 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2750029910 con 0x7f275c0ff830 2024-05-08T19:58:35.989 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:35.999+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f275c0625d0 con 0x7f275c0ff830 2024-05-08T19:58:35.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.002+0000 7f2759ffb700 1 -- 172.21.15.33:0/890830765 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f275c0625d0 con 0x7f275c0ff830 2024-05-08T19:58:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f274c0387f0 msgr2=0x7f274c03acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f274c0387f0 0x7f274c03acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2748006fd0 tx=0x7f2748006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 msgr2=0x7f275c195e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c195e70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2750004f40 tx=0x7f2750005020 comp rx=0 tx=0).stop 2024-05-08T19:58:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 shutdown_connections 2024-05-08T19:58:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f274c0387f0 0x7f274c03acb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 --2- 172.21.15.33:0/890830765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f275c0ff830 0x7f275c195e70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:35.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 >> 172.21.15.33:0/890830765 conn(0x7f275c0fadd0 msgr2=0x7f275c0685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:35.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 shutdown_connections 2024-05-08T19:58:35.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:36.005+0000 7f276312c700 1 -- 172.21.15.33:0/890830765 wait complete. 2024-05-08T19:58:36.419 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-08T19:58:36.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-08T19:58:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:58:37.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:37 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/890830765' entity='client.admin' 2024-05-08T19:58:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.748+0000 7feb6ed71700 1 -- 172.21.15.33:0/499468474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 msgr2=0x7feb680ffc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.748+0000 7feb6ed71700 1 --2- 172.21.15.33:0/499468474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb680ffc50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feb58009910 tx=0x7feb58009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.748+0000 7feb6ed71700 1 -- 172.21.15.33:0/499468474 shutdown_connections 2024-05-08T19:58:37.739 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.748+0000 7feb6ed71700 1 --2- 172.21.15.33:0/499468474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb680ffc50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.748+0000 7feb6ed71700 1 -- 172.21.15.33:0/499468474 >> 172.21.15.33:0/499468474 conn(0x7feb680fadd0 msgr2=0x7feb680fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.748+0000 7feb6ed71700 1 -- 172.21.15.33:0/499468474 shutdown_connections 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.748+0000 7feb6ed71700 1 -- 172.21.15.33:0/499468474 wait complete. 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.749+0000 7feb6ed71700 1 Processor -- start 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.749+0000 7feb6ed71700 1 -- start start 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.749+0000 7feb6ed71700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb68195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.749+0000 7feb6ed71700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb681963d0 con 0x7feb680ff830 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.749+0000 7feb6cb0d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb68195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.749+0000 7feb6cb0d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb68195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57058/0 (socket says 172.21.15.33:57058) 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.749+0000 7feb6cb0d700 1 -- 172.21.15.33:0/859342187 learned_addr learned my addr 172.21.15.33:0/859342187 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.750+0000 7feb6cb0d700 1 -- 172.21.15.33:0/859342187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580095f0 con 0x7feb680ff830 2024-05-08T19:58:37.740 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.750+0000 7feb6cb0d700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb68195e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb58005850 tx=0x7feb58004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.750+0000 7feb65ffb700 1 -- 172.21.15.33:0/859342187 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb5801d070 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.750+0000 7feb65ffb700 1 -- 172.21.15.33:0/859342187 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feb5800be40 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.750+0000 7feb65ffb700 1 -- 172.21.15.33:0/859342187 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb58022ea0 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.750+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb681965d0 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.750+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb68196a70 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.751+0000 7feb65ffb700 1 -- 172.21.15.33:0/859342187 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7feb58022670 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.751+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6818fa00 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.752+0000 7feb65ffb700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb540387a0 0x7feb5403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.752+0000 7feb65ffb700 1 -- 172.21.15.33:0/859342187 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feb5804c7d0 con 0x7feb680ff830 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.752+0000 7feb67fff700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb540387a0 0x7feb5403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.752+0000 7feb67fff700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb540387a0 0x7feb5403ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb50006fd0 tx=0x7feb50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:37.746 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.757+0000 7feb65ffb700 1 -- 172.21.15.33:0/859342187 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7feb5800b960 con 0x7feb680ff830 2024-05-08T19:58:37.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.972+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7feb680613e0 con 0x7feb540387a0 2024-05-08T19:58:37.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.976+0000 7feb65ffb700 1 -- 172.21.15.33:0/859342187 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7feb680613e0 con 0x7feb540387a0 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb540387a0 msgr2=0x7feb5403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb540387a0 0x7feb5403ac60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feb50006fd0 tx=0x7feb50006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 msgr2=0x7feb68195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb68195e90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feb58005850 tx=0x7feb58004ff0 comp rx=0 tx=0).stop 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 shutdown_connections 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb540387a0 0x7feb5403ac60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 --2- 172.21.15.33:0/859342187 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb680ff830 0x7feb68195e90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 >> 172.21.15.33:0/859342187 conn(0x7feb680fadd0 msgr2=0x7feb68068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:37.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 shutdown_connections 2024-05-08T19:58:37.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:37.978+0000 7feb6ed71700 1 -- 172.21.15.33:0/859342187 wait complete. 2024-05-08T19:58:38.340 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi082 2024-05-08T19:58:38.340 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:58:38.341 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.conf 2024-05-08T19:58:38.361 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:58:38.361 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:58:38.421 INFO:tasks.cephadm:Adding host smithi082 to orchestrator... 2024-05-08T19:58:38.422 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch host add smithi082 2024-05-08T19:58:38.699 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:58:39.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:39.185 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:39.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:39.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:39.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:58:39.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:39.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:58:39.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: Updating smithi033:/etc/ceph/ceph.conf 2024-05-08T19:58:39.186 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:38 smithi033 ceph-mon[42490]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:58:39.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 -- 172.21.15.33:0/1347919462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 msgr2=0x7f41140ff570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:39.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 --2- 172.21.15.33:0/1347919462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f41140ff570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4104009910 tx=0x7f4104009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:39.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 -- 172.21.15.33:0/1347919462 shutdown_connections 2024-05-08T19:58:39.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 --2- 172.21.15.33:0/1347919462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f41140ff570 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:39.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 -- 172.21.15.33:0/1347919462 >> 172.21.15.33:0/1347919462 conn(0x7f41140faa00 msgr2=0x7f41140fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:39.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 -- 172.21.15.33:0/1347919462 shutdown_connections 2024-05-08T19:58:39.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 -- 172.21.15.33:0/1347919462 wait complete. 2024-05-08T19:58:39.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.774+0000 7f411a218700 1 Processor -- start 2024-05-08T19:58:39.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f411a218700 1 -- start start 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f411a218700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f4114196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f411a218700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4114196840 con 0x7f41140ff190 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f41137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f4114196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f41137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f4114196300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57064/0 (socket says 172.21.15.33:57064) 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f41137fe700 1 -- 172.21.15.33:0/237618822 learned_addr learned my addr 172.21.15.33:0/237618822 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f41137fe700 1 -- 172.21.15.33:0/237618822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41040095f0 con 0x7f41140ff190 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.775+0000 7f41137fe700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f4114196300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4104004f40 tx=0x7f4104005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.776+0000 7f4110ff9700 1 -- 172.21.15.33:0/237618822 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f410401d070 con 0x7f41140ff190 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.776+0000 7f4110ff9700 1 -- 172.21.15.33:0/237618822 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f410400bc30 con 0x7f41140ff190 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.776+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4114196a40 con 0x7f41140ff190 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.776+0000 7f4110ff9700 1 -- 172.21.15.33:0/237618822 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4104003970 con 0x7f41140ff190 2024-05-08T19:58:39.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.776+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4114196e60 con 0x7f41140ff190 2024-05-08T19:58:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.777+0000 7f4110ff9700 1 -- 172.21.15.33:0/237618822 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f4104003c30 con 0x7f41140ff190 2024-05-08T19:58:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.777+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4114100670 con 0x7f41140ff190 2024-05-08T19:58:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.777+0000 7f4110ff9700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f40fc038790 0x7f40fc03ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.777+0000 7f4110ff9700 1 -- 172.21.15.33:0/237618822 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f410404c4b0 con 0x7f41140ff190 2024-05-08T19:58:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.777+0000 7f4112ffd700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f40fc038790 0x7f40fc03ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:39.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.778+0000 7f4112ffd700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f40fc038790 0x7f40fc03ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4108006fd0 tx=0x7f4108006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:39.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.783+0000 7f4110ff9700 1 -- 172.21.15.33:0/237618822 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4104029950 con 0x7f41140ff190 2024-05-08T19:58:39.988 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:39.999+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}) v1 -- 0x7f4114108bd0 con 0x7f40fc038790 2024-05-08T19:58:40.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:58:40.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T19:58:40.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:40.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:40.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:40.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:40.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:40.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:58:40.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:41 smithi033 ceph-mon[42490]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:42.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.285+0000 7f4110ff9700 1 -- 172.21.15.33:0/237618822 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f4114108bd0 con 0x7f40fc038790 2024-05-08T19:58:42.274 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi082' with addr '172.21.15.82' 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f40fc038790 msgr2=0x7f40fc03ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f40fc038790 0x7f40fc03ac50 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4108006fd0 tx=0x7f4108006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 msgr2=0x7f4114196300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f4114196300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4104004f40 tx=0x7f4104005020 comp rx=0 tx=0).stop 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 shutdown_connections 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f40fc038790 0x7f40fc03ac50 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 --2- 172.21.15.33:0/237618822 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41140ff190 0x7f4114196300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:42.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 >> 172.21.15.33:0/237618822 conn(0x7f41140faa00 msgr2=0x7f4114106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:42.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 shutdown_connections 2024-05-08T19:58:42.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:42.288+0000 7f411a218700 1 -- 172.21.15.33:0/237618822 wait complete. 2024-05-08T19:58:42.443 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:42 smithi033 ceph-mon[42490]: Deploying cephadm binary to smithi082 2024-05-08T19:58:42.664 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T19:58:42.912 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:58:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:43 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:43 smithi033 ceph-mon[42490]: Added host smithi082 2024-05-08T19:58:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:43 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:43 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:43 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.944+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/3775354618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 msgr2=0x7f7a84105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.944+0000 7f7a8c7d3700 1 --2- 172.21.15.33:0/3775354618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a84105c00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009910 tx=0x7f7a80009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.944+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/3775354618 shutdown_connections 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.944+0000 7f7a8c7d3700 1 --2- 172.21.15.33:0/3775354618 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a84105c00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.944+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/3775354618 >> 172.21.15.33:0/3775354618 conn(0x7f7a84075350 msgr2=0x7f7a84075760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.944+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/3775354618 shutdown_connections 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.944+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/3775354618 wait complete. 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8c7d3700 1 Processor -- start 2024-05-08T19:58:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8c7d3700 1 -- start start 2024-05-08T19:58:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8c7d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a841962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8c7d3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a84196800 con 0x7f7a84105820 2024-05-08T19:58:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8a56f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a841962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8a56f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a841962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33558/0 (socket says 172.21.15.33:33558) 2024-05-08T19:58:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8a56f700 1 -- 172.21.15.33:0/2625719303 learned_addr learned my addr 172.21.15.33:0/2625719303 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8a56f700 1 -- 172.21.15.33:0/2625719303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800095f0 con 0x7f7a84105820 2024-05-08T19:58:43.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.945+0000 7f7a8a56f700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a841962c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7a80006010 tx=0x7f7a80004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.946+0000 7f7a7b7fe700 1 -- 172.21.15.33:0/2625719303 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a8001d070 con 0x7f7a84105820 2024-05-08T19:58:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.946+0000 7f7a7b7fe700 1 -- 172.21.15.33:0/2625719303 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a8000bc30 con 0x7f7a84105820 2024-05-08T19:58:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.946+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a84196a00 con 0x7f7a84105820 2024-05-08T19:58:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.946+0000 7f7a7b7fe700 1 -- 172.21.15.33:0/2625719303 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a800039a0 con 0x7f7a84105820 2024-05-08T19:58:43.936 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.946+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a84196e20 con 0x7f7a84105820 2024-05-08T19:58:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.947+0000 7f7a7b7fe700 1 -- 172.21.15.33:0/2625719303 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f7a80004390 con 0x7f7a84105820 2024-05-08T19:58:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.947+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a84100ef0 con 0x7f7a84105820 2024-05-08T19:58:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.947+0000 7f7a7b7fe700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7a700387f0 0x7f7a7003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:43.937 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.947+0000 7f7a7b7fe700 1 -- 172.21.15.33:0/2625719303 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7a8004c460 con 0x7f7a84105820 2024-05-08T19:58:43.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.951+0000 7f7a89d6e700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7a700387f0 0x7f7a7003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:43.939 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.951+0000 7f7a89d6e700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7a700387f0 0x7f7a7003acb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a74006fd0 tx=0x7f7a74006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:43.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:43.952+0000 7f7a7b7fe700 1 -- 172.21.15.33:0/2625719303 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7a80005c00 con 0x7f7a84105820 2024-05-08T19:58:44.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.171+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a84109c60 con 0x7f7a700387f0 2024-05-08T19:58:44.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.172+0000 7f7a7b7fe700 1 -- 172.21.15.33:0/2625719303 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f7a84109c60 con 0x7f7a700387f0 2024-05-08T19:58:44.161 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:44.161 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}] 2024-05-08T19:58:44.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7a700387f0 msgr2=0x7f7a7003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:44.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7a700387f0 0x7f7a7003acb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a74006fd0 tx=0x7f7a74006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:44.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 msgr2=0x7f7a841962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:44.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a841962c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7a80006010 tx=0x7f7a80004ff0 comp rx=0 tx=0).stop 2024-05-08T19:58:44.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 shutdown_connections 2024-05-08T19:58:44.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7a700387f0 0x7f7a7003acb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:44.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 --2- 172.21.15.33:0/2625719303 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a84105820 0x7f7a841962c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:44.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.174+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 >> 172.21.15.33:0/2625719303 conn(0x7f7a84075350 msgr2=0x7f7a840680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:44.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.175+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 shutdown_connections 2024-05-08T19:58:44.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:44.175+0000 7f7a8c7d3700 1 -- 172.21.15.33:0/2625719303 wait complete. 2024-05-08T19:58:44.589 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi132 2024-05-08T19:58:44.590 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:58:44.590 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/etc/ceph/ceph.conf 2024-05-08T19:58:44.611 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:58:44.611 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:58:44.670 INFO:tasks.cephadm:Adding host smithi132 to orchestrator... 2024-05-08T19:58:44.671 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch host add smithi132 2024-05-08T19:58:44.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:44.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:44 smithi033 ceph-mon[42490]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T19:58:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:58:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.964+0000 7f891ae40700 1 -- 172.21.15.33:0/3162252226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 msgr2=0x7f8914105c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.964+0000 7f891ae40700 1 --2- 172.21.15.33:0/3162252226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f8914105c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8904009910 tx=0x7f8904009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.964+0000 7f891ae40700 1 -- 172.21.15.33:0/3162252226 shutdown_connections 2024-05-08T19:58:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.964+0000 7f891ae40700 1 --2- 172.21.15.33:0/3162252226 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f8914105c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.964+0000 7f891ae40700 1 -- 172.21.15.33:0/3162252226 >> 172.21.15.33:0/3162252226 conn(0x7f8914075350 msgr2=0x7f8914075760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:45.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.964+0000 7f891ae40700 1 -- 172.21.15.33:0/3162252226 shutdown_connections 2024-05-08T19:58:45.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.964+0000 7f891ae40700 1 -- 172.21.15.33:0/3162252226 wait complete. 2024-05-08T19:58:45.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f891ae40700 1 Processor -- start 2024-05-08T19:58:45.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f891ae40700 1 -- start start 2024-05-08T19:58:45.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f891ae40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f89141962c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:45.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f891ae40700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8914196800 con 0x7f8914105820 2024-05-08T19:58:45.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f8918bdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f89141962c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:45.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f8918bdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f89141962c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33586/0 (socket says 172.21.15.33:33586) 2024-05-08T19:58:45.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f8918bdc700 1 -- 172.21.15.33:0/4292832440 learned_addr learned my addr 172.21.15.33:0/4292832440 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:45.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f8918bdc700 1 -- 172.21.15.33:0/4292832440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89040095f0 con 0x7f8914105820 2024-05-08T19:58:45.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.965+0000 7f8918bdc700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f89141962c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8904005850 tx=0x7f8904004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:45.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.966+0000 7f8911ffb700 1 -- 172.21.15.33:0/4292832440 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f890401d070 con 0x7f8914105820 2024-05-08T19:58:45.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.966+0000 7f8911ffb700 1 -- 172.21.15.33:0/4292832440 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f890400bc30 con 0x7f8914105820 2024-05-08T19:58:45.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.966+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8914196a00 con 0x7f8914105820 2024-05-08T19:58:45.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.966+0000 7f8911ffb700 1 -- 172.21.15.33:0/4292832440 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f89040039e0 con 0x7f8914105820 2024-05-08T19:58:45.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.966+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8914196e20 con 0x7f8914105820 2024-05-08T19:58:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.967+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8914100ef0 con 0x7f8914105820 2024-05-08T19:58:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.968+0000 7f8911ffb700 1 -- 172.21.15.33:0/4292832440 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f8904004390 con 0x7f8914105820 2024-05-08T19:58:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.968+0000 7f8911ffb700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f88fc0387f0 0x7f88fc03acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.968+0000 7f8913fff700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f88fc0387f0 0x7f88fc03acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.968+0000 7f8913fff700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f88fc0387f0 0x7f88fc03acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8908006fd0 tx=0x7f8908006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:45.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.969+0000 7f8911ffb700 1 -- 172.21.15.33:0/4292832440 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8904021da0 con 0x7f8914105820 2024-05-08T19:58:45.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:45.974+0000 7f8911ffb700 1 -- 172.21.15.33:0/4292832440 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8904005c00 con 0x7f8914105820 2024-05-08T19:58:46.183 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:46.195+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi132", "target": ["mon-mgr", ""]}) v1 -- 0x7f8914109c60 con 0x7f88fc0387f0 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T19:58:47.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi132", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:47.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:46 smithi033 ceph-mon[42490]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:58:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:47 smithi033 ceph-mon[42490]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:58:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:47 smithi033 ceph-mon[42490]: Deploying cephadm binary to smithi132 2024-05-08T19:58:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:47 smithi033 ceph-mon[42490]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T19:58:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:48.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:48.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:48.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:47 smithi033 ceph-mon[42490]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:48.412 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.422+0000 7f8911ffb700 1 -- 172.21.15.33:0/4292832440 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8914109c60 con 0x7f88fc0387f0 2024-05-08T19:58:48.412 INFO:teuthology.orchestra.run.smithi033.stdout:Added host 'smithi132' with addr '172.21.15.132' 2024-05-08T19:58:48.415 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f88fc0387f0 msgr2=0x7f88fc03acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f88fc0387f0 0x7f88fc03acb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8908006fd0 tx=0x7f8908006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 msgr2=0x7f89141962c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f89141962c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8904005850 tx=0x7f8904004ff0 comp rx=0 tx=0).stop 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 shutdown_connections 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f88fc0387f0 0x7f88fc03acb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 --2- 172.21.15.33:0/4292832440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8914105820 0x7f89141962c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 >> 172.21.15.33:0/4292832440 conn(0x7f8914075350 msgr2=0x7f89140680f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 shutdown_connections 2024-05-08T19:58:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:48.426+0000 7f891ae40700 1 -- 172.21.15.33:0/4292832440 wait complete. 2024-05-08T19:58:48.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T19:58:49.034 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:58:49.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:49 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:49.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:49 smithi033 ceph-mon[42490]: Added host smithi132 2024-05-08T19:58:49.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:49 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:49.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:49 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:49.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:49 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:49.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:49 smithi033 ceph-mon[42490]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:50.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.086+0000 7f434f469700 1 -- 172.21.15.33:0/2297624643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 msgr2=0x7f4348106ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:50.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.086+0000 7f434f469700 1 --2- 172.21.15.33:0/2297624643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f4348106ca0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4344009910 tx=0x7f4344009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:50.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.086+0000 7f434f469700 1 -- 172.21.15.33:0/2297624643 shutdown_connections 2024-05-08T19:58:50.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.086+0000 7f434f469700 1 --2- 172.21.15.33:0/2297624643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f4348106ca0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:50.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.086+0000 7f434f469700 1 -- 172.21.15.33:0/2297624643 >> 172.21.15.33:0/2297624643 conn(0x7f4348075350 msgr2=0x7f4348075760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:50.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.086+0000 7f434f469700 1 -- 172.21.15.33:0/2297624643 shutdown_connections 2024-05-08T19:58:50.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.086+0000 7f434f469700 1 -- 172.21.15.33:0/2297624643 wait complete. 2024-05-08T19:58:50.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.087+0000 7f434f469700 1 Processor -- start 2024-05-08T19:58:50.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.087+0000 7f434f469700 1 -- start start 2024-05-08T19:58:50.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.087+0000 7f434f469700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f43480ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:50.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.087+0000 7f434f469700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4348101760 con 0x7f43481068c0 2024-05-08T19:58:50.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f434d205700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f43480ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:50.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f434d205700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f43480ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33606/0 (socket says 172.21.15.33:33606) 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f434d205700 1 -- 172.21.15.33:0/2985962695 learned_addr learned my addr 172.21.15.33:0/2985962695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f434d205700 1 -- 172.21.15.33:0/2985962695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43440095f0 con 0x7f43481068c0 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f434d205700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f43480ff8a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4344004f40 tx=0x7f4344005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f433e7fc700 1 -- 172.21.15.33:0/2985962695 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f434401d070 con 0x7f43481068c0 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f433e7fc700 1 -- 172.21.15.33:0/2985962695 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f434400bbd0 con 0x7f43481068c0 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f433e7fc700 1 -- 172.21.15.33:0/2985962695 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f43440038a0 con 0x7f43481068c0 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43480ffde0 con 0x7f43481068c0 2024-05-08T19:58:50.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.088+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4348100260 con 0x7f43481068c0 2024-05-08T19:58:50.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.089+0000 7f433e7fc700 1 -- 172.21.15.33:0/2985962695 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f434400b6f0 con 0x7f43481068c0 2024-05-08T19:58:50.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.089+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348109190 con 0x7f43481068c0 2024-05-08T19:58:50.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.089+0000 7f433e7fc700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f43340387f0 0x7f433403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:50.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.089+0000 7f433e7fc700 1 -- 172.21.15.33:0/2985962695 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f434404c450 con 0x7f43481068c0 2024-05-08T19:58:50.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.090+0000 7f434ca04700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f43340387f0 0x7f433403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:50.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.090+0000 7f434ca04700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f43340387f0 0x7f433403acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4338006fd0 tx=0x7f4338006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:50.084 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.095+0000 7f433e7fc700 1 -- 172.21.15.33:0/2985962695 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4344029540 con 0x7f43481068c0 2024-05-08T19:58:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.312+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43481004a0 con 0x7f43340387f0 2024-05-08T19:58:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.313+0000 7f433e7fc700 1 -- 172.21.15.33:0/2985962695 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7f43481004a0 con 0x7f43340387f0 2024-05-08T19:58:50.303 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T19:58:50.303 INFO:teuthology.orchestra.run.smithi033.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.132", "hostname": "smithi132", "labels": [], "status": ""}] 2024-05-08T19:58:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.315+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f43340387f0 msgr2=0x7f433403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:50.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.315+0000 7f434f469700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f43340387f0 0x7f433403acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4338006fd0 tx=0x7f4338006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.315+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 msgr2=0x7f43480ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.315+0000 7f434f469700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f43480ff8a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4344004f40 tx=0x7f4344005020 comp rx=0 tx=0).stop 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.316+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 shutdown_connections 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.316+0000 7f434f469700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f43340387f0 0x7f433403acb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.316+0000 7f434f469700 1 --2- 172.21.15.33:0/2985962695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43481068c0 0x7f43480ff8a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.316+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 >> 172.21.15.33:0/2985962695 conn(0x7f4348075350 msgr2=0x7f43480fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.316+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 shutdown_connections 2024-05-08T19:58:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:50.316+0000 7f434f469700 1 -- 172.21.15.33:0/2985962695 wait complete. 2024-05-08T19:58:50.720 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-08T19:58:50.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-08T19:58:50.969 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:58:51.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:50 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:51.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:50 smithi033 ceph-mon[42490]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T19:58:52.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:51 smithi033 ceph-mon[42490]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.142+0000 7f38985d0700 1 -- 172.21.15.33:0/120344030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 msgr2=0x7f3890105cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.142+0000 7f38985d0700 1 --2- 172.21.15.33:0/120344030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890105cc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f388c009910 tx=0x7f388c009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.142+0000 7f38985d0700 1 -- 172.21.15.33:0/120344030 shutdown_connections 2024-05-08T19:58:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.142+0000 7f38985d0700 1 --2- 172.21.15.33:0/120344030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890105cc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.142+0000 7f38985d0700 1 -- 172.21.15.33:0/120344030 >> 172.21.15.33:0/120344030 conn(0x7f38900faa00 msgr2=0x7f38900fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.142+0000 7f38985d0700 1 -- 172.21.15.33:0/120344030 shutdown_connections 2024-05-08T19:58:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.142+0000 7f38985d0700 1 -- 172.21.15.33:0/120344030 wait complete. 2024-05-08T19:58:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.143+0000 7f38985d0700 1 Processor -- start 2024-05-08T19:58:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.143+0000 7f38985d0700 1 -- start start 2024-05-08T19:58:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.143+0000 7f38985d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.143+0000 7f38985d0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38901967b0 con 0x7f38901058e0 2024-05-08T19:58:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f389636c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f389636c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33612/0 (socket says 172.21.15.33:33612) 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f389636c700 1 -- 172.21.15.33:0/1304042440 learned_addr learned my addr 172.21.15.33:0/1304042440 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f389636c700 1 -- 172.21.15.33:0/1304042440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c0095f0 con 0x7f38901058e0 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f389636c700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890196270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f388c004f40 tx=0x7f388c005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f38877fe700 1 -- 172.21.15.33:0/1304042440 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f388c01d070 con 0x7f38901058e0 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f38877fe700 1 -- 172.21.15.33:0/1304042440 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f388c00bc30 con 0x7f38901058e0 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f38877fe700 1 -- 172.21.15.33:0/1304042440 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f388c003970 con 0x7f38901058e0 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38901969b0 con 0x7f38901058e0 2024-05-08T19:58:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.144+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3890196dd0 con 0x7f38901058e0 2024-05-08T19:58:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.145+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3890102020 con 0x7f38901058e0 2024-05-08T19:58:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.146+0000 7f38877fe700 1 -- 172.21.15.33:0/1304042440 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f388c003c30 con 0x7f38901058e0 2024-05-08T19:58:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.146+0000 7f38877fe700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f387c0387a0 0x7f387c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.146+0000 7f38877fe700 1 -- 172.21.15.33:0/1304042440 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f388c04c480 con 0x7f38901058e0 2024-05-08T19:58:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.146+0000 7f3895b6b700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f387c0387a0 0x7f387c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.146+0000 7f3895b6b700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f387c0387a0 0x7f387c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3880006fd0 tx=0x7f3880006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.151+0000 7f38877fe700 1 -- 172.21.15.33:0/1304042440 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f388c00ba70 con 0x7f38901058e0 2024-05-08T19:58:52.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:52.376+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f38901976d0 con 0x7f38901058e0 2024-05-08T19:58:53.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.140+0000 7f38877fe700 1 -- 172.21.15.33:0/1304042440 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f388c026020 con 0x7f38901058e0 2024-05-08T19:58:53.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f387c0387a0 msgr2=0x7f387c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:53.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f387c0387a0 0x7f387c03ac60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3880006fd0 tx=0x7f3880006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:53.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 msgr2=0x7f3890196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890196270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f388c004f40 tx=0x7f388c005020 comp rx=0 tx=0).stop 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 shutdown_connections 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f387c0387a0 0x7f387c03ac60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 --2- 172.21.15.33:0/1304042440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f38901058e0 0x7f3890196270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 >> 172.21.15.33:0/1304042440 conn(0x7f38900faa00 msgr2=0x7f38901084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 shutdown_connections 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:58:53.143+0000 7f38985d0700 1 -- 172.21.15.33:0/1304042440 wait complete. 2024-05-08T19:58:53.133 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2024-05-08T19:58:53.435 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi132", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1304042440' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:53.436 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:53.503 INFO:tasks.cephadm:Adding mon.a on smithi033 2024-05-08T19:58:53.503 INFO:tasks.cephadm:Adding mon.b on smithi082 2024-05-08T19:58:53.503 INFO:tasks.cephadm:Adding mon.c on smithi132 2024-05-08T19:58:53.503 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c' 2024-05-08T19:58:53.743 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:58:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:54 smithi033 ceph-mon[42490]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:58:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:54 smithi033 ceph-mon[42490]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T19:58:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:54 smithi033 ceph-mon[42490]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:54 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1304042440' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T19:58:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:54 smithi033 ceph-mon[42490]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:58:54.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 -- 172.21.15.132:0/4158947380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 msgr2=0x7feb18105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 --2- 172.21.15.132:0/4158947380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb18105bd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb08009910 tx=0x7feb08009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 -- 172.21.15.132:0/4158947380 shutdown_connections 2024-05-08T19:58:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 --2- 172.21.15.132:0/4158947380 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb18105bd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 -- 172.21.15.132:0/4158947380 >> 172.21.15.132:0/4158947380 conn(0x7feb180fb2e0 msgr2=0x7feb180fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 -- 172.21.15.132:0/4158947380 shutdown_connections 2024-05-08T19:58:54.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 -- 172.21.15.132:0/4158947380 wait complete. 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.729+0000 7feb1e2de700 1 Processor -- start 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.730+0000 7feb1e2de700 1 -- start start 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.730+0000 7feb1e2de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb181970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.730+0000 7feb1e2de700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb18069ce0 con 0x7feb181057f0 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.730+0000 7feb17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb181970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.730+0000 7feb17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb181970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.132:49004/0 (socket says 172.21.15.132:49004) 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.730+0000 7feb17fff700 1 -- 172.21.15.132:0/1172265470 learned_addr learned my addr 172.21.15.132:0/1172265470 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.731+0000 7feb17fff700 1 -- 172.21.15.132:0/1172265470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb080095f0 con 0x7feb181057f0 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.731+0000 7feb17fff700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb181970d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb08006010 tx=0x7feb08004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:54.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.731+0000 7feb157fa700 1 -- 172.21.15.132:0/1172265470 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb0801d070 con 0x7feb181057f0 2024-05-08T19:58:54.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.731+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb18197670 con 0x7feb181057f0 2024-05-08T19:58:54.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.731+0000 7feb157fa700 1 -- 172.21.15.132:0/1172265470 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feb0800bc30 con 0x7feb181057f0 2024-05-08T19:58:54.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.731+0000 7feb157fa700 1 -- 172.21.15.132:0/1172265470 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feb08003930 con 0x7feb181057f0 2024-05-08T19:58:54.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.731+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb18197af0 con 0x7feb181057f0 2024-05-08T19:58:54.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.732+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb18100f30 con 0x7feb181057f0 2024-05-08T19:58:54.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.732+0000 7feb157fa700 1 -- 172.21.15.132:0/1172265470 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7feb08003b30 con 0x7feb181057f0 2024-05-08T19:58:54.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.732+0000 7feb157fa700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb000387a0 0x7feb0003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:54.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.732+0000 7feb157fa700 1 -- 172.21.15.132:0/1172265470 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feb0804c520 con 0x7feb181057f0 2024-05-08T19:58:54.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.732+0000 7feb177fe700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb000387a0 0x7feb0003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:54.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.733+0000 7feb177fe700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb000387a0 0x7feb0003ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb0c006fd0 tx=0x7feb0c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:54.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.738+0000 7feb157fa700 1 -- 172.21.15.132:0/1172265470 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7feb0800ba70 con 0x7feb181057f0 2024-05-08T19:58:54.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.941+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c", "target": ["mon-mgr", ""]}) v1 -- 0x7feb18197df0 con 0x7feb000387a0 2024-05-08T19:58:54.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.948+0000 7feb157fa700 1 -- 172.21.15.132:0/1172265470 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7feb18197df0 con 0x7feb000387a0 2024-05-08T19:58:54.938 INFO:teuthology.orchestra.run.smithi132.stdout:Scheduled mon update... 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb000387a0 msgr2=0x7feb0003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb000387a0 0x7feb0003ac60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7feb0c006fd0 tx=0x7feb0c006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 msgr2=0x7feb181970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb181970d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feb08006010 tx=0x7feb08004ff0 comp rx=0 tx=0).stop 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 shutdown_connections 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb000387a0 0x7feb0003ac60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 --2- 172.21.15.132:0/1172265470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb181057f0 0x7feb181970d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 >> 172.21.15.132:0/1172265470 conn(0x7feb180fb2e0 msgr2=0x7feb18107320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:54.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 shutdown_connections 2024-05-08T19:58:54.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:54.950+0000 7feb1e2de700 1 -- 172.21.15.132:0/1172265470 wait complete. 2024-05-08T19:58:55.319 DEBUG:teuthology.orchestra.run.smithi082:mon.b> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.b.service 2024-05-08T19:58:55.322 DEBUG:teuthology.orchestra.run.smithi132:mon.c> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.c.service 2024-05-08T19:58:55.324 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T19:58:55.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T19:58:55.354 INFO:journalctl@ceph.mon.c.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T19:58:55.357 INFO:journalctl@ceph.mon.b.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T19:58:55.650 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c;count:3 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:56.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:58:56.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:56.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: Deploying daemon mon.c on smithi132 2024-05-08T19:58:56.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:55 smithi033 ceph-mon[42490]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:56.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 -- 172.21.15.132:0/498430061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 msgr2=0x7ff124105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:56.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 --2- 172.21.15.132:0/498430061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff124105bd0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff114009910 tx=0x7ff114009c20 comp rx=0 tx=0).stop 2024-05-08T19:58:56.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 -- 172.21.15.132:0/498430061 shutdown_connections 2024-05-08T19:58:56.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 --2- 172.21.15.132:0/498430061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff124105bd0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:56.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 -- 172.21.15.132:0/498430061 >> 172.21.15.132:0/498430061 conn(0x7ff1240fb340 msgr2=0x7ff1240fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:56.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 -- 172.21.15.132:0/498430061 shutdown_connections 2024-05-08T19:58:56.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 -- 172.21.15.132:0/498430061 wait complete. 2024-05-08T19:58:56.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 Processor -- start 2024-05-08T19:58:56.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.000+0000 7ff12a9e7700 1 -- start start 2024-05-08T19:58:56.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.001+0000 7ff12a9e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff1241970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:56.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.001+0000 7ff12a9e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff124069c20 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.001+0000 7ff123fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff1241970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.001+0000 7ff123fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff1241970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.132:49022/0 (socket says 172.21.15.132:49022) 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.001+0000 7ff123fff700 1 -- 172.21.15.132:0/596016580 learned_addr learned my addr 172.21.15.132:0/596016580 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.001+0000 7ff123fff700 1 -- 172.21.15.132:0/596016580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140095f0 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.001+0000 7ff123fff700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff1241970e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff114004f40 tx=0x7ff114005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.002+0000 7ff1217fa700 1 -- 172.21.15.132:0/596016580 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff11401d070 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.002+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff124197680 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.002+0000 7ff1217fa700 1 -- 172.21.15.132:0/596016580 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff11400bc30 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.002+0000 7ff1217fa700 1 -- 172.21.15.132:0/596016580 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff114003970 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.002+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff124197b00 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.003+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff124100f30 con 0x7ff1241057f0 2024-05-08T19:58:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.003+0000 7ff1217fa700 1 -- 172.21.15.132:0/596016580 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7ff114003c30 con 0x7ff1241057f0 2024-05-08T19:58:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.003+0000 7ff1217fa700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff10c0387a0 0x7ff10c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:58:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.003+0000 7ff1217fa700 1 -- 172.21.15.132:0/596016580 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff11404c560 con 0x7ff1241057f0 2024-05-08T19:58:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.003+0000 7ff1237fe700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff10c0387a0 0x7ff10c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:58:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.004+0000 7ff1237fe700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff10c0387a0 0x7ff10c03ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff118006fd0 tx=0x7ff118006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:58:56.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.008+0000 7ff1217fa700 1 -- 172.21.15.132:0/596016580 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff11400b6f0 con 0x7ff1241057f0 2024-05-08T19:58:57.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.308+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff124069380 con 0x7ff1241057f0 2024-05-08T19:58:57.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.309+0000 7ff1217fa700 1 -- 172.21.15.132:0/596016580 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7ff124069380 con 0x7ff1241057f0 2024-05-08T19:58:57.299 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:58:57.299 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":1,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","modified":"2024-05-08T19:57:37.385900Z","created":"2024-05-08T19:57:37.385900Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T19:58:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff10c0387a0 msgr2=0x7ff10c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:57.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff10c0387a0 0x7ff10c03ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff118006fd0 tx=0x7ff118006e40 comp rx=0 tx=0).stop 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 msgr2=0x7ff1241970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff1241970e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff114004f40 tx=0x7ff114005020 comp rx=0 tx=0).stop 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 shutdown_connections 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff10c0387a0 0x7ff10c03ac60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 --2- 172.21.15.132:0/596016580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1241057f0 0x7ff1241970e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 >> 172.21.15.132:0/596016580 conn(0x7ff1240fb340 msgr2=0x7ff124107420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 shutdown_connections 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:58:57.312+0000 7ff12a9e7700 1 -- 172.21.15.132:0/596016580 wait complete. 2024-05-08T19:58:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 1 2024-05-08T19:58:57.865 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:57 smithi132 systemd[1]: Starting Ceph mon.c for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T19:58:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:58 smithi033 ceph-mon[42490]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:58:58 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/596016580' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable), process ceph-mon, pid 7 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: pidfile_write: ignore empty --pid-file 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 bash[47447]: 3b65f8f780b5e5a1358e267e31e2ab62858898e2a405cf836309d21aed6e9cea 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: load: jerasure load: lrc 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 systemd[1]: Started Ceph mon.c for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: RocksDB version: 7.9.2 2024-05-08T19:58:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Git sha 0 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Compile date 2024-05-08 17:55:50 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: DB SUMMARY 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: DB Session ID: J0LY0W800LLCS247IEJO 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: CURRENT file: CURRENT 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.error_if_exists: 0 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.create_if_missing: 0 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.paranoid_checks: 1 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T19:58:58.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.env: 0x55ea1754b820 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.info_log: 0x55ea1a98b520 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.statistics: (nil) 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.use_fsync: 0 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_log_file_size: 0 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.allow_fallocate: 1 2024-05-08T19:58:58.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.use_direct_reads: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.db_log_dir: 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.wal_dir: 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T19:58:58.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.write_buffer_manager: 0x55ea19c20320 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.unordered_write: 0 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.row_cache: None 2024-05-08T19:58:58.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.wal_filter: None 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.two_write_queues: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.wal_compression: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.atomic_flush: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.log_readahead_size: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T19:58:58.630 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_background_jobs: 2 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_background_compactions: -1 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_subcompactions: 1 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T19:58:58.631 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_open_files: -1 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_background_flushes: -1 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Compression algorithms supported: 2024-05-08T19:58:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kZSTD supported: 0 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kXpressCompression supported: 0 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kZlibCompression supported: 1 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kSnappyCompression supported: 1 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kLZ4Compression supported: 1 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: kBZip2Compression supported: 0 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.merge_operator: 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_filter: None 2024-05-08T19:58:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ea1a98b620) 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: cache_index_and_filter_blocks: 1 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: pin_top_level_index_and_filter: 1 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: index_type: 0 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: data_block_index_type: 0 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: index_shortening: 1 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: checksum: 4 2024-05-08T19:58:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout: no_block_cache: 0 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_cache: 0x55ea19ca31f0 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_cache_name: BinnedLRUCache 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_cache_options: 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: capacity : 536870912 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: num_shard_bits : 4 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: strict_capacity_limit : 0 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: high_pri_pool_ratio: 0.000 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_cache_compressed: (nil) 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: persistent_cache: (nil) 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_size: 4096 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_size_deviation: 10 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_restart_interval: 16 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: index_block_restart_interval: 1 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: metadata_block_size: 4096 2024-05-08T19:58:58.635 INFO:journalctl@ceph.mon.c.smithi132.stdout: partition_filters: 0 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: use_delta_encoding: 1 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: filter_policy: bloomfilter 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: whole_key_filtering: 1 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: verify_compression: 0 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: read_amp_bytes_per_bit: 0 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: format_version: 5 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: enable_index_compression: 1 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: block_align: 0 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: max_auto_readahead_size: 262144 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: prepopulate_block_cache: 0 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: initial_auto_readahead_size: 8192 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T19:58:58.636 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression: NoCompression 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.num_levels: 7 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T19:58:58.637 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T19:58:58.639 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T19:58:58.640 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T19:58:58.641 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.table_properties_collectors: 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.inplace_update_support: 0 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T19:58:58.642 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.bloom_locality: 0 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.max_successive_merges: 0 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.ttl: 2592000 2024-05-08T19:58:58.643 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.enable_blob_files: false 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.min_blob_size: 0 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T19:58:58.644 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0cb3099c-ed45-40b3-9b75-20c7b50c6e30 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198338237040, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198338237481, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715198338, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0cb3099c-ed45-40b3-9b75-20c7b50c6e30", "db_session_id": "J0LY0W800LLCS247IEJO", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198338237547, "job": 1, "event": "recovery_finished"} 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ea19d40000 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: DB pointer 0x55ea19d2e000 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T19:58:58.645 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: ** DB Stats ** 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: ** Compaction Stats [default] ** 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:58:58.646 INFO:journalctl@ceph.mon.c.smithi132.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: ** Compaction Stats [default] ** 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T19:58:58.647 INFO:journalctl@ceph.mon.c.smithi132.stdout: Cumulative compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: Interval compaction: 0.00 GB write, 0.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: Block cache BinnedLRUCache@0x55ea19ca31f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: using public_addr v2:172.21.15.132:0/0 -> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: starting mon.c rank -1 at public addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] at bind addrs [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(???) e0 preinit fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).mds e1 new map 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: e1 2024-05-08T19:58:58.648 INFO:journalctl@ceph.mon.c.smithi132.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout: legacy client fscid: -1 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout: 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout: No filesystems configured 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:58:58.649 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi132", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1304042440' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.650 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1304042440' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c;count:3 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: Deploying daemon mon.c on smithi132 2024-05-08T19:58:58.651 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:58.652 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:58:58.652 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/596016580' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:58:58.652 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:58:58 smithi132 ceph-mon[47484]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T19:58:58.720 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T19:58:58.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T19:58:58.939 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.511+0000 7efeba97c700 1 -- 172.21.15.132:0/1229353551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 msgr2=0x7efe9c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.511+0000 7efeba97c700 1 --2- 172.21.15.132:0/1229353551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 0x7efe9c005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efeb4078170 tx=0x7efea4014ec0 comp rx=0 tx=0).stop 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.511+0000 7efeba97c700 1 -- 172.21.15.132:0/1229353551 shutdown_connections 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.511+0000 7efeba97c700 1 --2- 172.21.15.132:0/1229353551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 0x7efe9c005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.511+0000 7efeba97c700 1 -- 172.21.15.132:0/1229353551 >> 172.21.15.132:0/1229353551 conn(0x7efeb4076ea0 msgr2=0x7efeb40772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.511+0000 7efeba97c700 1 -- 172.21.15.132:0/1229353551 shutdown_connections 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.511+0000 7efeba97c700 1 -- 172.21.15.132:0/1229353551 wait complete. 2024-05-08T19:59:03.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.512+0000 7efeba97c700 1 Processor -- start 2024-05-08T19:59:03.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.512+0000 7efeba97c700 1 -- start start 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeba97c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 0x7efeb4100270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeba97c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 0x7efeb4100c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeba97c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4102130 con 0x7efe9c0035c0 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeba97c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb41a2550 con 0x7efeb41007b0 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 0x7efeb4100c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb37fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 0x7efeb4100c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41462/0 (socket says 172.21.15.132:41462) 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb37fe700 1 -- 172.21.15.132:0/1515534961 learned_addr learned my addr 172.21.15.132:0/1515534961 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb37fe700 1 -- 172.21.15.132:0/1515534961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 msgr2=0x7efeb4100c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T19:59:03.505 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb37fe700 1 -- 172.21.15.132:0/1515534961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 msgr2=0x7efeb4100c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb37fe700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 0x7efeb4100c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb3fff700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 0x7efeb4100270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb37fe700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 0x7efeb4100c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb3fff700 1 -- 172.21.15.132:0/1515534961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 msgr2=0x7efeb4100c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb3fff700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 0x7efeb4100c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.513+0000 7efeb3fff700 1 -- 172.21.15.132:0/1515534961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea4014910 con 0x7efe9c0035c0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.514+0000 7efeb3fff700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 0x7efeb4100270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efeb4078170 tx=0x7efea400fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.514+0000 7efeb17fa700 1 -- 172.21.15.132:0/1515534961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7efea4023070 con 0x7efe9c0035c0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.514+0000 7efeb17fa700 1 -- 172.21.15.132:0/1515534961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efea401e470 con 0x7efe9c0035c0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.514+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb41a2690 con 0x7efe9c0035c0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.514+0000 7efeb17fa700 1 -- 172.21.15.132:0/1515534961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7efea4019040 con 0x7efe9c0035c0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.514+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb41a2b60 con 0x7efe9c0035c0 2024-05-08T19:59:03.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.515+0000 7efeb17fa700 1 -- 172.21.15.132:0/1515534961 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7efea40126e0 con 0x7efe9c0035c0 2024-05-08T19:59:03.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.515+0000 7efeb17fa700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efea0038580 0x7efea003aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:03.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.515+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb4190250 con 0x7efe9c0035c0 2024-05-08T19:59:03.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.515+0000 7efeb17fa700 1 -- 172.21.15.132:0/1515534961 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efea404d780 con 0x7efe9c0035c0 2024-05-08T19:59:03.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.515+0000 7efeb37fe700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efea0038580 0x7efea003aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:03.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.516+0000 7efeb37fe700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efea0038580 0x7efea003aa40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efea8009180 tx=0x7efea8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:03.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.521+0000 7efeb17fa700 1 -- 172.21.15.132:0/1515534961 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efea401c370 con 0x7efe9c0035c0 2024-05-08T19:59:03.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:59:03.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: mon.a calling monitor election 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: mon.c calling monitor election 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: monmap e2: 2 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],c=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: fsmap 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: mgrmap e13: x(active, since 36s) 2024-05-08T19:59:03.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: overall HEALTH_OK 2024-05-08T19:59:03.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:03.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:03.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.793+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efeb4108860 con 0x7efe9c0035c0 2024-05-08T19:59:03.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.794+0000 7efeb17fa700 1 -- 172.21.15.132:0/1515534961 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7efea4048070 con 0x7efe9c0035c0 2024-05-08T19:59:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:59:03.784 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","modified":"2024-05-08T19:58:58.268329Z","created":"2024-05-08T19:57:37.385900Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efea0038580 msgr2=0x7efea003aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efea0038580 0x7efea003aa40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efea8009180 tx=0x7efea8008040 comp rx=0 tx=0).stop 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 msgr2=0x7efeb4100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 0x7efeb4100270 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efeb4078170 tx=0x7efea400fda0 comp rx=0 tx=0).stop 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 shutdown_connections 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe9c0035c0 0x7efeb4100270 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efea0038580 0x7efea003aa40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 --2- 172.21.15.132:0/1515534961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efeb41007b0 0x7efeb4100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 >> 172.21.15.132:0/1515534961 conn(0x7efeb4076ea0 msgr2=0x7efeb40fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 shutdown_connections 2024-05-08T19:59:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:03.796+0000 7efeba97c700 1 -- 172.21.15.132:0/1515534961 wait complete. 2024-05-08T19:59:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 2 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: mon.a calling monitor election 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: mon.c calling monitor election 2024-05-08T19:59:03.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: monmap e2: 2 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],c=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: fsmap 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: mgrmap e13: x(active, since 36s) 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: overall HEALTH_OK 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:03.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:04 smithi132 ceph-mon[47484]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:04 smithi132 ceph-mon[47484]: Deploying daemon mon.b on smithi082 2024-05-08T19:59:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:04 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/1515534961' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:59:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:04 smithi033 ceph-mon[42490]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:04 smithi033 ceph-mon[42490]: Deploying daemon mon.b on smithi082 2024-05-08T19:59:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:04 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/1515534961' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:59:04.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:05.151 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T19:59:05.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T19:59:05.382 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T19:59:06.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 systemd[1]: Started Ceph mon.b for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.wal_dir: 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.write_buffer_manager: 0x55c8b1fee320 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T19:59:06.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.unordered_write: 0 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.row_cache: None 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.wal_filter: None 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T19:59:06.125 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.two_write_queues: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.wal_compression: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.atomic_flush: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.log_readahead_size: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T19:59:06.126 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_background_jobs: 2 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_background_compactions: -1 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_subcompactions: 1 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_open_files: -1 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T19:59:06.127 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_background_flushes: -1 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Compression algorithms supported: 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kZSTD supported: 0 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kXpressCompression supported: 0 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kZlibCompression supported: 1 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kSnappyCompression supported: 1 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kLZ4Compression supported: 1 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: kBZip2Compression supported: 0 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T19:59:06.128 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.merge_operator: 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_filter: None 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c8b2d59620) 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-05-08T19:59:06.129 INFO:journalctl@ceph.mon.b.smithi082.stdout: index_type: 0 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: data_block_index_type: 0 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: index_shortening: 1 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: checksum: 4 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: no_block_cache: 0 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache: 0x55c8b20711f0 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache_options: 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: capacity : 536870912 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: num_shard_bits : 4 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: strict_capacity_limit : 0 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_cache_compressed: (nil) 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: persistent_cache: (nil) 2024-05-08T19:59:06.130 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_size: 4096 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_size_deviation: 10 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_restart_interval: 16 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: index_block_restart_interval: 1 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: metadata_block_size: 4096 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: partition_filters: 0 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: use_delta_encoding: 1 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: filter_policy: bloomfilter 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: whole_key_filtering: 1 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: verify_compression: 0 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: format_version: 5 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: enable_index_compression: 1 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: block_align: 0 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: max_auto_readahead_size: 262144 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: prepopulate_block_cache: 0 2024-05-08T19:59:06.131 INFO:journalctl@ceph.mon.b.smithi082.stdout: initial_auto_readahead_size: 8192 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression: NoCompression 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.num_levels: 7 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T19:59:06.132 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T19:59:06.133 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T19:59:06.134 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T19:59:06.135 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.table_properties_collectors: 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.inplace_update_support: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.bloom_locality: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.max_successive_merges: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T19:59:06.136 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.ttl: 2592000 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.enable_blob_files: false 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.min_blob_size: 0 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T19:59:06.137 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 325fe30a-7ecc-467d-ac81-08400dc7604e 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198345888756, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198345889184, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715198345, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "325fe30a-7ecc-467d-ac81-08400dc7604e", "db_session_id": "NFFWGFEIGADPK7BRK0IL", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715198345889253, "job": 1, "event": "recovery_finished"} 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c8b210e000 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: DB pointer 0x55c8b20fc000 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** DB Stats ** 2024-05-08T19:59:06.138 INFO:journalctl@ceph.mon.b.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** Compaction Stats [default] ** 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-05-08T19:59:06.139 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** Compaction Stats [default] ** 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T19:59:06.140 INFO:journalctl@ceph.mon.b.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: Block cache BinnedLRUCache@0x55c8b20711f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: using public_addr v2:172.21.15.82:0/0 -> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: starting mon.b rank -1 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(???) e0 preinit fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).mds e1 new map 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: e1 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: legacy client fscid: -1 2024-05-08T19:59:06.141 INFO:journalctl@ceph.mon.b.smithi082.stdout: 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout: No filesystems configured 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:06.142 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi132", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1304042440' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T19:59:06.143 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1304042440' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: Saving service mon spec with placement smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c;count:3 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: Deploying daemon mon.c on smithi132 2024-05-08T19:59:06.144 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/596016580' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.a calling monitor election 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.c calling monitor election 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T19:59:06.145 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: monmap e2: 2 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],c=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: fsmap 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mgrmap e13: x(active, since 36s) 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: overall HEALTH_OK 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: Deploying daemon mon.b on smithi082 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/1515534961' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:06.146 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:05 smithi082 ceph-mon[46774]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-08T19:59:11.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:59:11.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: mon.a calling monitor election 2024-05-08T19:59:11.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: mon.c calling monitor election 2024-05-08T19:59:11.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: mon.b calling monitor election 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: fsmap 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:59:11.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: mgrmap e13: x(active, since 43s) 2024-05-08T19:59:11.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: overall HEALTH_OK 2024-05-08T19:59:11.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: mon.a calling monitor election 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: mon.c calling monitor election 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: mon.b calling monitor election 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: fsmap 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: mgrmap e13: x(active, since 43s) 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: overall HEALTH_OK 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: mon.a calling monitor election 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: mon.c calling monitor election 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: mon.b calling monitor election 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0],c=[v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: fsmap 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: mgrmap e13: x(active, since 43s) 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: overall HEALTH_OK 2024-05-08T19:59:11.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.376 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.376 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:11.376 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.240+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3782579688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 msgr2=0x7fca840086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.240+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3782579688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca840086d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fca98100980 tx=0x7fca8800fe90 comp rx=0 tx=0).stop 2024-05-08T19:59:12.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.240+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3782579688 shutdown_connections 2024-05-08T19:59:12.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.240+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3782579688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca840086d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:12.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.240+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3782579688 >> 172.21.15.132:0/3782579688 conn(0x7fca98076570 msgr2=0x7fca980fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:12.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.240+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3782579688 shutdown_connections 2024-05-08T19:59:12.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.240+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3782579688 wait complete. 2024-05-08T19:59:12.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 Processor -- start 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 -- start start 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca98196550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca98196a90 0x7fca9819ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 0x7fca9819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca98197180 con 0x7fca840062a0 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca981a30f0 con 0x7fca98196a90 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fcaa03c1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca981a3230 con 0x7fca9819b380 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca98196550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e95e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 0x7fca9819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca98196550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.132:36798/0 (socket says 172.21.15.132:36798) 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 -- 172.21.15.132:0/3319039976 learned_addr learned my addr 172.21.15.132:0/3319039976 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T19:59:12.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e95e700 1 -- 172.21.15.132:0/3319039976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 msgr2=0x7fca9819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e95e700 1 -- 172.21.15.132:0/3319039976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 msgr2=0x7fca9819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e95e700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 0x7fca9819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e95e700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 0x7fca9819b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9d95c700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca98196a90 0x7fca9819ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 -- 172.21.15.132:0/3319039976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 msgr2=0x7fca9819b830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 0x7fca9819b830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 -- 172.21.15.132:0/3319039976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca98196a90 msgr2=0x7fca9819ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca98196a90 0x7fca9819ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.242+0000 7fca9e15d700 1 -- 172.21.15.132:0/3319039976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8800f8e0 con 0x7fca840062a0 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.243+0000 7fca9e15d700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca98196550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca88000c00 tx=0x7fca88005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.243+0000 7fca8f7fe700 1 -- 172.21.15.132:0/3319039976 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8801da50 con 0x7fca840062a0 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.243+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca981a34b0 con 0x7fca840062a0 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.243+0000 7fca8f7fe700 1 -- 172.21.15.132:0/3319039976 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fca8801dbb0 con 0x7fca840062a0 2024-05-08T19:59:12.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.243+0000 7fca8f7fe700 1 -- 172.21.15.132:0/3319039976 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880116a0 con 0x7fca840062a0 2024-05-08T19:59:12.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.243+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca981a3950 con 0x7fca840062a0 2024-05-08T19:59:12.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.244+0000 7fca8f7fe700 1 -- 172.21.15.132:0/3319039976 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7fca88011800 con 0x7fca840062a0 2024-05-08T19:59:12.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.244+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca98101000 con 0x7fca840062a0 2024-05-08T19:59:12.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.244+0000 7fca8f7fe700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fca7c038c70 0x7fca7c03b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:12.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.244+0000 7fca8f7fe700 1 -- 172.21.15.132:0/3319039976 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fca8804e110 con 0x7fca840062a0 2024-05-08T19:59:12.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.244+0000 7fca9d95c700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fca7c038c70 0x7fca7c03b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:12.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.244+0000 7fca9d95c700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fca7c038c70 0x7fca7c03b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca94009850 tx=0x7fca94008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:12.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.249+0000 7fca8f7fe700 1 -- 172.21.15.132:0/3319039976 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fca88011ab0 con 0x7fca840062a0 2024-05-08T19:59:12.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:12.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:12.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:12.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:12.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:12.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.535+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fca98107760 con 0x7fca840062a0 2024-05-08T19:59:12.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.536+0000 7fca8f7fe700 1 -- 172.21.15.132:0/3319039976 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1272 (secure 0 0 0) 0x7fca88036b00 con 0x7fca840062a0 2024-05-08T19:59:12.526 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-05-08T19:59:12.526 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","modified":"2024-05-08T19:59:05.921200Z","created":"2024-05-08T19:57:37.385900Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-08T19:59:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fca7c038c70 msgr2=0x7fca7c03b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fca7c038c70 0x7fca7c03b130 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca94009850 tx=0x7fca94008040 comp rx=0 tx=0).stop 2024-05-08T19:59:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 msgr2=0x7fca98196550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca98196550 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fca88000c00 tx=0x7fca88005790 comp rx=0 tx=0).stop 2024-05-08T19:59:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 shutdown_connections 2024-05-08T19:59:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fca7c038c70 0x7fca7c03b130 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9819b380 0x7fca9819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca840062a0 0x7fca98196550 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 --2- 172.21.15.132:0/3319039976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca98196a90 0x7fca9819ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 >> 172.21.15.132:0/3319039976 conn(0x7fca98076570 msgr2=0x7fca98104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 shutdown_connections 2024-05-08T19:59:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:12.538+0000 7fcaa03c1700 1 -- 172.21.15.132:0/3319039976 wait complete. 2024-05-08T19:59:12.529 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 3 2024-05-08T19:59:12.899 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-08T19:59:12.900 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: Updating smithi033:/etc/ceph/ceph.conf 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.200 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/3319039976' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:13.201 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: Updating smithi033:/etc/ceph/ceph.conf 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/3319039976' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:13.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: Updating smithi033:/etc/ceph/ceph.conf 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T19:59:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/3319039976' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:13.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:13.469 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: Reconfiguring daemon mon.a on smithi033 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:14.410 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:14 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:14.540 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T19:59:14.540 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: Reconfiguring daemon mon.a on smithi033 2024-05-08T19:59:14.540 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:14.541 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:14.541 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:14.541 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:14.541 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:14.541 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:14 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 -- 172.21.15.33:0/744547107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46840692f0 msgr2=0x7f468410de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 --2- 172.21.15.33:0/744547107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46840692f0 0x7f468410de60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f467c00b0a0 tx=0x7f467c00b3b0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 -- 172.21.15.33:0/744547107 shutdown_connections 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 --2- 172.21.15.33:0/744547107 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46840692f0 0x7f468410de60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 --2- 172.21.15.33:0/744547107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4684107020 0x7f4684107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 --2- 172.21.15.33:0/744547107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4684068950 0x7f4684068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 -- 172.21.15.33:0/744547107 >> 172.21.15.33:0/744547107 conn(0x7f4684075f80 msgr2=0x7f4684076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 -- 172.21.15.33:0/744547107 shutdown_connections 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.607+0000 7f468b46c700 1 -- 172.21.15.33:0/744547107 wait complete. 2024-05-08T19:59:14.600 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 Processor -- start 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 -- start start 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4684068950 0x7f4684197690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46840692f0 0x7f4684197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4684107020 0x7f468419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468419c540 con 0x7f4684068950 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468419c6b0 con 0x7f46840692f0 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f468b46c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468419c870 con 0x7f4684107020 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4684068950 0x7f4684197690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4684068950 0x7f4684197690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54112/0 (socket says 172.21.15.33:54112) 2024-05-08T19:59:14.601 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 -- 172.21.15.33:0/3975519859 learned_addr learned my addr 172.21.15.33:0/3975519859 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4688a07700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46840692f0 0x7f4684197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689a09700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4684107020 0x7f468419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 -- 172.21.15.33:0/3975519859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4684107020 msgr2=0x7f468419bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4684107020 0x7f468419bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 -- 172.21.15.33:0/3975519859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46840692f0 msgr2=0x7f4684197bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46840692f0 0x7f4684197bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4689208700 1 -- 172.21.15.33:0/3975519859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c009d00 con 0x7f4684068950 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.608+0000 7f4688a07700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46840692f0 0x7f4684197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.609+0000 7f4689208700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4684068950 0x7f4684197690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f468000e9a0 tx=0x7f468000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.609+0000 7f467a7fc700 1 -- 172.21.15.33:0/3975519859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680009790 con 0x7f4684068950 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.609+0000 7f467a7fc700 1 -- 172.21.15.33:0/3975519859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f468000cbd0 con 0x7f4684068950 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.609+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468419cb50 con 0x7f4684068950 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.609+0000 7f467a7fc700 1 -- 172.21.15.33:0/3975519859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680018680 con 0x7f4684068950 2024-05-08T19:59:14.602 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.609+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46841a43b0 con 0x7f4684068950 2024-05-08T19:59:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.610+0000 7f467a7fc700 1 -- 172.21.15.33:0/3975519859 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f46800188a0 con 0x7f4684068950 2024-05-08T19:59:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.610+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4684109540 con 0x7f4684068950 2024-05-08T19:59:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.610+0000 7f467a7fc700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f46700389d0 0x7f467003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.610+0000 7f467a7fc700 1 -- 172.21.15.33:0/3975519859 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4680014070 con 0x7f4684068950 2024-05-08T19:59:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.610+0000 7f4688a07700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f46700389d0 0x7f467003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.611+0000 7f4688a07700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f46700389d0 0x7f467003ae90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4684198ba0 tx=0x7f467400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:14.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.615+0000 7f467a7fc700 1 -- 172.21.15.33:0/3975519859 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4680016330 con 0x7f4684068950 2024-05-08T19:59:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T19:59:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: Reconfiguring daemon mon.a on smithi033 2024-05-08T19:59:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:14.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:14.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:14.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:14.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:14 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:14.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.827+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f46841026d0 con 0x7f4684068950 2024-05-08T19:59:14.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.828+0000 7f467a7fc700 1 -- 172.21.15.33:0/3975519859 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7f468001fb00 con 0x7f4684068950 2024-05-08T19:59:14.818 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:59:14.818 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2024-05-08T19:59:14.818 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T19:59:14.819 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] 2024-05-08T19:59:14.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f46700389d0 msgr2=0x7f467003ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f46700389d0 0x7f467003ae90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4684198ba0 tx=0x7f467400b410 comp rx=0 tx=0).stop 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4684068950 msgr2=0x7f4684197690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4684068950 0x7f4684197690 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f468000e9a0 tx=0x7f468000ecb0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 shutdown_connections 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f46700389d0 0x7f467003ae90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4684107020 0x7f468419bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4684068950 0x7f4684197690 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 --2- 172.21.15.33:0/3975519859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f46840692f0 0x7f4684197bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:14.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 >> 172.21.15.33:0/3975519859 conn(0x7f4684075f80 msgr2=0x7f46840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:14.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 shutdown_connections 2024-05-08T19:59:14.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:14.830+0000 7f468b46c700 1 -- 172.21.15.33:0/3975519859 wait complete. 2024-05-08T19:59:15.191 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-08T19:59:15.191 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:59:15.191 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T19:59:15.230 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:59:15.230 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:59:15.306 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:59:15.307 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T19:59:15.340 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:59:15.340 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:59:15.409 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:59:15.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T19:59:15.435 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: Reconfiguring mon.b (monmap changed)... 2024-05-08T19:59:15.435 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: Reconfiguring daemon mon.b on smithi082 2024-05-08T19:59:15.435 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:15.436 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:15.436 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3975519859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:15.436 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:15.436 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:15.436 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:15.440 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:59:15.440 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T19:59:15.508 INFO:tasks.cephadm:Adding mgr.x on smithi033 2024-05-08T19:59:15.509 INFO:tasks.cephadm:Adding mgr.y on smithi082 2024-05-08T19:59:15.509 INFO:tasks.cephadm:Adding mgr.z on smithi132 2024-05-08T19:59:15.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi033=x;smithi082=y;smithi132=z' 2024-05-08T19:59:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: Reconfiguring mon.b (monmap changed)... 2024-05-08T19:59:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: Reconfiguring daemon mon.b on smithi082 2024-05-08T19:59:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3975519859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: Reconfiguring mon.b (monmap changed)... 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: Reconfiguring daemon mon.b on smithi082 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3975519859' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T19:59:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:15.767 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T19:59:16.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: Reconfiguring mon.c (monmap changed)... 2024-05-08T19:59:16.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: Reconfiguring daemon mon.c on smithi132 2024-05-08T19:59:16.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:16.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:16.571 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:16.572 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:16.572 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: Reconfiguring mon.c (monmap changed)... 2024-05-08T19:59:16.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: Reconfiguring daemon mon.c on smithi132 2024-05-08T19:59:16.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:16.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:16.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:16.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:16.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: Reconfiguring mon.c (monmap changed)... 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: Reconfiguring daemon mon.c on smithi132 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 -- 172.21.15.132:0/481259311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 msgr2=0x7efd501002b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 --2- 172.21.15.132:0/481259311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd501002b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd44009990 tx=0x7efd44009ca0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 -- 172.21.15.132:0/481259311 shutdown_connections 2024-05-08T19:59:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 --2- 172.21.15.132:0/481259311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd50101a40 0x7efd50108360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 --2- 172.21.15.132:0/481259311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd501002b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 --2- 172.21.15.132:0/481259311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50101080 0x7efd50101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 -- 172.21.15.132:0/481259311 >> 172.21.15.132:0/481259311 conn(0x7efd500fb4a0 msgr2=0x7efd500fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 -- 172.21.15.132:0/481259311 shutdown_connections 2024-05-08T19:59:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.758+0000 7efd5737f700 1 -- 172.21.15.132:0/481259311 wait complete. 2024-05-08T19:59:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 Processor -- start 2024-05-08T19:59:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 -- start start 2024-05-08T19:59:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd50103e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50101080 0x7efd501024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd50101a40 0x7efd50102a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd501031d0 con 0x7efd50101080 2024-05-08T19:59:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd50103340 con 0x7efd50101a40 2024-05-08T19:59:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5737f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd501a0fc0 con 0x7efd500ffe90 2024-05-08T19:59:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5511b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd50103e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5511b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd50103e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52930/0 (socket says 172.21.15.132:52930) 2024-05-08T19:59:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5511b700 1 -- 172.21.15.132:0/2654942754 learned_addr learned my addr 172.21.15.132:0/2654942754 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T19:59:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.759+0000 7efd5591c700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd50101a40 0x7efd50102a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5491a700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50101080 0x7efd501024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5511b700 1 -- 172.21.15.132:0/2654942754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd50101a40 msgr2=0x7efd50102a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5511b700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd50101a40 0x7efd50102a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5511b700 1 -- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50101080 msgr2=0x7efd501024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:16.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5511b700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50101080 0x7efd501024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5511b700 1 -- 172.21.15.132:0/2654942754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd440095f0 con 0x7efd500ffe90 2024-05-08T19:59:16.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5491a700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50101080 0x7efd501024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T19:59:16.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5511b700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd50103e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd44000c00 tx=0x7efd4400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:16.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd427fc700 1 -- 172.21.15.132:0/2654942754 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4401d070 con 0x7efd500ffe90 2024-05-08T19:59:16.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd427fc700 1 -- 172.21.15.132:0/2654942754 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd4400fc70 con 0x7efd500ffe90 2024-05-08T19:59:16.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd501a11f0 con 0x7efd500ffe90 2024-05-08T19:59:16.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd427fc700 1 -- 172.21.15.132:0/2654942754 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd440176e0 con 0x7efd500ffe90 2024-05-08T19:59:16.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.760+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd501a1660 con 0x7efd500ffe90 2024-05-08T19:59:16.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.761+0000 7efd427fc700 1 -- 172.21.15.132:0/2654942754 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7efd44017840 con 0x7efd500ffe90 2024-05-08T19:59:16.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.761+0000 7efd427fc700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efd3c0389d0 0x7efd3c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:16.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.761+0000 7efd427fc700 1 -- 172.21.15.132:0/2654942754 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efd4404c880 con 0x7efd500ffe90 2024-05-08T19:59:16.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.761+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5004ec60 con 0x7efd500ffe90 2024-05-08T19:59:16.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.761+0000 7efd5491a700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efd3c0389d0 0x7efd3c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:16.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.762+0000 7efd5491a700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efd3c0389d0 0x7efd3c03ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd4c005fd0 tx=0x7efd4c005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:16.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.766+0000 7efd427fc700 1 -- 172.21.15.132:0/2654942754 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efd44027070 con 0x7efd500ffe90 2024-05-08T19:59:16.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.966+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi082=y;smithi132=z", "target": ["mon-mgr", ""]}) v1 -- 0x7efd500fd6a0 con 0x7efd3c0389d0 2024-05-08T19:59:16.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.973+0000 7efd427fc700 1 -- 172.21.15.132:0/2654942754 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7efd500fd6a0 con 0x7efd3c0389d0 2024-05-08T19:59:16.961 INFO:teuthology.orchestra.run.smithi132.stdout:Scheduled mgr update... 2024-05-08T19:59:16.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efd3c0389d0 msgr2=0x7efd3c03ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:16.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efd3c0389d0 0x7efd3c03ae90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7efd4c005fd0 tx=0x7efd4c005e40 comp rx=0 tx=0).stop 2024-05-08T19:59:16.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 msgr2=0x7efd50103e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd50103e50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd44000c00 tx=0x7efd4400f690 comp rx=0 tx=0).stop 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 shutdown_connections 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd50101a40 0x7efd50102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7efd3c0389d0 0x7efd3c03ae90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd500ffe90 0x7efd50103e50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 --2- 172.21.15.132:0/2654942754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd50101080 0x7efd501024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 >> 172.21.15.132:0/2654942754 conn(0x7efd500fb4a0 msgr2=0x7efd500fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 shutdown_connections 2024-05-08T19:59:16.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:16.975+0000 7efd5737f700 1 -- 172.21.15.132:0/2654942754 wait complete. 2024-05-08T19:59:17.517 DEBUG:teuthology.orchestra.run.smithi082:mgr.y> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.y.service 2024-05-08T19:59:17.520 DEBUG:teuthology.orchestra.run.smithi132:mgr.z> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.z.service 2024-05-08T19:59:17.523 INFO:tasks.cephadm:Deploying OSDs... 2024-05-08T19:59:17.523 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T19:59:17.523 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T19:59:17.545 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T19:59:17.545 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2024-05-08T19:59:17.552 INFO:journalctl@ceph.mgr.y.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T19:59:17.553 INFO:journalctl@ceph.mgr.z.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T19:59:17.607 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T19:59:17.607 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:17.608 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 184324 Links: 1 2024-05-08T19:59:17.608 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:17.608 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:17.608 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 19:58:37.072187824 +0000 2024-05-08T19:59:17.608 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 19:51:41.728399910 +0000 2024-05-08T19:59:17.608 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 19:51:41.728399910 +0000 2024-05-08T19:59:17.608 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-05-08T19:59:17.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T19:59:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T19:59:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T19:59:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000239363 s, 2.1 MB/s 2024-05-08T19:59:17.682 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T19:59:17.746 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2024-05-08T19:59:17.808 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T19:59:17.808 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:17.808 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 174950 Links: 1 2024-05-08T19:59:17.809 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:17.809 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:17.809 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 19:58:37.146186590 +0000 2024-05-08T19:59:17.809 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 19:51:42.102393944 +0000 2024-05-08T19:59:17.809 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 19:51:42.102393944 +0000 2024-05-08T19:59:17.809 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-05-08T19:59:17.809 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T19:59:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T19:59:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T19:59:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000278155 s, 1.8 MB/s 2024-05-08T19:59:17.882 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T19:59:17.946 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2024-05-08T19:59:18.008 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T19:59:18.008 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:18.009 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 184521 Links: 1 2024-05-08T19:59:18.009 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:18.009 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:18.009 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 19:58:37.220185356 +0000 2024-05-08T19:59:18.009 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 19:51:42.484387850 +0000 2024-05-08T19:59:18.009 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 19:51:42.484387850 +0000 2024-05-08T19:59:18.009 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-05-08T19:59:18.009 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T19:59:18.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi082=y;smithi132=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:18.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: Saving service mgr spec with placement smithi033=x;smithi082=y;smithi132=z;count:3 2024-05-08T19:59:18.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:18.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:18.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:18.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:18.052 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:18.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:18.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T19:59:18.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:18.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:18.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: Deploying daemon mgr.z on smithi132 2024-05-08T19:59:18.053 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:17 smithi132 ceph-mon[47484]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T19:59:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T19:59:18.082 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000248892 s, 2.1 MB/s 2024-05-08T19:59:18.084 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T19:59:18.147 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2024-05-08T19:59:18.209 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T19:59:18.209 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:18.209 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 184621 Links: 1 2024-05-08T19:59:18.209 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:18.210 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:18.210 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 19:58:37.298184056 +0000 2024-05-08T19:59:18.210 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 19:51:42.889381390 +0000 2024-05-08T19:59:18.210 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 19:51:42.889381390 +0000 2024-05-08T19:59:18.210 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2024-05-08T19:59:18.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T19:59:18.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi082=y;smithi132=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: Saving service mgr spec with placement smithi033=x;smithi082=y;smithi132=z;count:3 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: Deploying daemon mgr.z on smithi132 2024-05-08T19:59:18.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:17 smithi033 ceph-mon[42490]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:18.282 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2024-05-08T19:59:18.282 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2024-05-08T19:59:18.282 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000255485 s, 2.0 MB/s 2024-05-08T19:59:18.284 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T19:59:18.348 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T19:59:18.348 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T19:59:18.369 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T19:59:18.369 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-05-08T19:59:18.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi033=x;smithi082=y;smithi132=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: Saving service mgr spec with placement smithi033=x;smithi082=y;smithi132=z;count:3 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:18.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: Deploying daemon mgr.z on smithi132 2024-05-08T19:59:18.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:17 smithi082 ceph-mon[46774]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:18.392 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T19:59:18.392 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:18.392 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 184430 Links: 1 2024-05-08T19:59:18.393 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:18.393 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:18.393 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 19:59:05.514197943 +0000 2024-05-08T19:59:18.393 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 19:50:48.920877884 +0000 2024-05-08T19:59:18.393 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 19:50:48.920877884 +0000 2024-05-08T19:59:18.393 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-05-08T19:59:18.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T19:59:18.461 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T19:59:18.462 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T19:59:18.462 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000276076 s, 1.9 MB/s 2024-05-08T19:59:18.463 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T19:59:18.524 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-05-08T19:59:18.582 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T19:59:18.582 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:18.582 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 184504 Links: 1 2024-05-08T19:59:18.582 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:18.582 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:18.582 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 19:59:05.514197943 +0000 2024-05-08T19:59:18.582 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 19:50:49.260871162 +0000 2024-05-08T19:59:18.583 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 19:50:49.260871162 +0000 2024-05-08T19:59:18.583 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-05-08T19:59:18.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T19:59:18.624 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:18 smithi132 systemd[1]: Starting Ceph mgr.z for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T19:59:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T19:59:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T19:59:18.650 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000338748 s, 1.5 MB/s 2024-05-08T19:59:18.651 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T19:59:18.710 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-05-08T19:59:18.768 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T19:59:18.768 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:18.769 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 184585 Links: 1 2024-05-08T19:59:18.769 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:18.769 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:18.769 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 19:59:05.514197943 +0000 2024-05-08T19:59:18.769 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 19:50:49.611864223 +0000 2024-05-08T19:59:18.769 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 19:50:49.611864223 +0000 2024-05-08T19:59:18.769 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-05-08T19:59:18.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T19:59:18.834 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T19:59:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T19:59:18.835 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000183312 s, 2.8 MB/s 2024-05-08T19:59:18.836 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T19:59:18.895 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 182715 Links: 1 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 19:59:05.514197943 +0000 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 19:50:49.958857363 +0000 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 19:50:49.958857363 +0000 2024-05-08T19:59:18.953 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: - 2024-05-08T19:59:18.954 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T19:59:19.019 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T19:59:19.019 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T19:59:19.019 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000209806 s, 2.4 MB/s 2024-05-08T19:59:19.020 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T19:59:19.078 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-05-08T19:59:19.078 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T19:59:19.095 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T19:59:19.095 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-05-08T19:59:19.153 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T19:59:19.153 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:19.153 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 177112 Links: 1 2024-05-08T19:59:19.154 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:19.154 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:19.154 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 19:59:18.508154483 +0000 2024-05-08T19:59:19.154 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 19:50:51.183272515 +0000 2024-05-08T19:59:19.154 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 19:50:51.183272515 +0000 2024-05-08T19:59:19.154 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-05-08T19:59:19.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T19:59:19.219 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:18 smithi132 ceph-mgr[49372]: -- 172.21.15.132:0/3810330481 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555c7fd2e1a0 con 0x555c7fd04800 2024-05-08T19:59:19.219 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:18 smithi132 bash[49334]: 0921424ae2e4efb9353536e0646ffc4d70cd623484b5c84df8f5384327c2c9d0 2024-05-08T19:59:19.219 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:18 smithi132 systemd[1]: Started Ceph mgr.z for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:59:19.222 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T19:59:19.222 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T19:59:19.222 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00020715 s, 2.5 MB/s 2024-05-08T19:59:19.224 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T19:59:19.282 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 177927 Links: 1 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 19:59:18.508154483 +0000 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 19:50:51.535263086 +0000 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 19:50:51.535263086 +0000 2024-05-08T19:59:19.340 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-05-08T19:59:19.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T19:59:19.406 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:19.336+0000 7fe4bd35a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T19:59:19.408 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T19:59:19.408 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T19:59:19.408 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000198135 s, 2.6 MB/s 2024-05-08T19:59:19.410 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T19:59:19.468 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-05-08T19:59:19.513 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:19.434+0000 7fe4bd35a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T19:59:19.526 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T19:59:19.526 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:19.526 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 178838 Links: 1 2024-05-08T19:59:19.526 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:19.526 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:19.526 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 19:59:18.508154483 +0000 2024-05-08T19:59:19.526 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 19:50:51.899253334 +0000 2024-05-08T19:59:19.527 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 19:50:51.899253334 +0000 2024-05-08T19:59:19.527 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-05-08T19:59:19.527 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T19:59:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T19:59:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T19:59:19.593 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000195182 s, 2.6 MB/s 2024-05-08T19:59:19.594 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T19:59:19.652 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 178954 Links: 1 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-05-08 19:59:18.509154455 +0000 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-05-08 19:50:52.264243557 +0000 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-05-08 19:50:52.264243557 +0000 2024-05-08T19:59:19.710 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2024-05-08T19:59:19.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T19:59:19.774 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:19.524+0000 7fe4bd35a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T19:59:19.774 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:19.617+0000 7fe4bd35a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T19:59:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-05-08T19:59:19.777 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-05-08T19:59:19.777 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000232216 s, 2.2 MB/s 2024-05-08T19:59:19.778 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T19:59:19.836 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2024-05-08T19:59:19.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T19:59:20.086 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:59:20.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T19:59:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:20 smithi132 ceph-mon[47484]: Deploying daemon mgr.y on smithi082 2024-05-08T19:59:20.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:20.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T19:59:20.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:20.195 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:20.195 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:20.195 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:20 smithi033 ceph-mon[42490]: Deploying daemon mgr.y on smithi082 2024-05-08T19:59:20.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:20.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:20.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T19:59:20.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:20.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:20.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:20.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mon[46774]: Deploying daemon mgr.y on smithi082 2024-05-08T19:59:20.373 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:20 smithi082 systemd[1]: Starting Ceph mgr.y for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T19:59:20.518 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:20.277+0000 7fe4bd35a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:59:20.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:20 smithi082 ceph-mgr[48276]: -- 172.21.15.82:0/2730654907 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ec21961a0 con 0x558ec216c800 2024-05-08T19:59:20.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:20 smithi082 bash[48238]: 692e54ac9c195b836b3a2f3a3d7ed76e503ab7a4485a4cbe058f9f467765f951 2024-05-08T19:59:20.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:20 smithi082 systemd[1]: Started Ceph mgr.y for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T19:59:20.873 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:20.528+0000 7fe4bd35a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T19:59:20.873 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:20.614+0000 7fe4bd35a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T19:59:20.873 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:20.724+0000 7fe4bd35a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T19:59:20.873 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:20.884+0000 7fe4bd35a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T19:59:21.045 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:20 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:20.959+0000 7fd33b6fc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T19:59:21.124 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:21.019+0000 7fe4bd35a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T19:59:21.124 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:21.111+0000 7fe4bd35a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T19:59:21.241 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:21.055+0000 7fd33b6fc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T19:59:21.242 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:21.153+0000 7fd33b6fc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T19:59:21.242 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:21.252+0000 7fd33b6fc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T19:59:21.480 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T19:59:21.480 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T19:59:21.480 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-05-08T19:59:21.480 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-05-08T19:59:21.480 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119398 s, 878 MB/s 2024-05-08T19:59:21.480 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-05-08T19:59:21.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:21.782 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:21 smithi033 ceph-mon[42490]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:21.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2024-05-08T19:59:21.874 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:21.541+0000 7fe4bd35a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T19:59:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:21 smithi132 ceph-mon[47484]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:21.900 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.900 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:21.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:21.901 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:21 smithi082 ceph-mon[46774]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:22.132 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T19:59:22.233 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:21.910+0000 7fd33b6fc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:59:22.233 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:22.159+0000 7fd33b6fc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T19:59:22.241 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:21.963+0000 7fe4bd35a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T19:59:22.241 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:22.159+0000 7fe4bd35a200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T19:59:22.497 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:22.243+0000 7fd33b6fc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T19:59:22.497 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:22.351+0000 7fd33b6fc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T19:59:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: Reconfiguring daemon mgr.x on smithi033 2024-05-08T19:59:22.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.871 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:22.507+0000 7fd33b6fc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:22.634+0000 7fd33b6fc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:22.719+0000 7fd33b6fc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T19:59:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: Reconfiguring daemon mgr.x on smithi033 2024-05-08T19:59:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:23.030 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:22.252+0000 7fe4bd35a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T19:59:23.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: Reconfiguring daemon mgr.x on smithi033 2024-05-08T19:59:23.031 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:23.371 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:23.088+0000 7fd33b6fc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T19:59:23.374 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:23.041+0000 7fe4bd35a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T19:59:23.374 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:23.138+0000 7fe4bd35a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T19:59:23.374 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:23.287+0000 7fe4bd35a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T19:59:23.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.393+0000 7f2d8c271700 1 -- 172.21.15.33:0/3226879414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d840ff900 msgr2=0x7f2d840ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:23.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.393+0000 7f2d8c271700 1 --2- 172.21.15.33:0/3226879414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d840ff900 0x7f2d840ffd20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009990 tx=0x7f2d80009ca0 comp rx=0 tx=0).stop 2024-05-08T19:59:23.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.393+0000 7f2d8c271700 1 -- 172.21.15.33:0/3226879414 shutdown_connections 2024-05-08T19:59:23.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.393+0000 7f2d8c271700 1 --2- 172.21.15.33:0/3226879414 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d84100c20 0x7f2d841010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:23.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.393+0000 7f2d8c271700 1 --2- 172.21.15.33:0/3226879414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d840ff900 0x7f2d840ffd20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:23.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.393+0000 7f2d8c271700 1 --2- 172.21.15.33:0/3226879414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d84100260 0x7f2d841006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:23.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.393+0000 7f2d8c271700 1 -- 172.21.15.33:0/3226879414 >> 172.21.15.33:0/3226879414 conn(0x7f2d840fb4a0 msgr2=0x7f2d840fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:23.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 -- 172.21.15.33:0/3226879414 shutdown_connections 2024-05-08T19:59:23.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 -- 172.21.15.33:0/3226879414 wait complete. 2024-05-08T19:59:23.385 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 Processor -- start 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 -- start start 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d840ff900 0x7f2d84199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d84100260 0x7f2d841997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d84100c20 0x7f2d841a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841a0dd0 con 0x7f2d84100260 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841a0f10 con 0x7f2d84100c20 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.394+0000 7f2d8c271700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d841a10a0 con 0x7f2d840ff900 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d84100260 0x7f2d841997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d84100260 0x7f2d841997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42026/0 (socket says 172.21.15.33:42026) 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 -- 172.21.15.33:0/1823948125 learned_addr learned my addr 172.21.15.33:0/1823948125 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8a00d700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d840ff900 0x7f2d84199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:23.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8a80e700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d84100c20 0x7f2d841a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 -- 172.21.15.33:0/1823948125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d840ff900 msgr2=0x7f2d84199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d840ff900 0x7f2d84199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 -- 172.21.15.33:0/1823948125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d84100c20 msgr2=0x7f2d841a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d84100c20 0x7f2d841a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 -- 172.21.15.33:0/1823948125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800095f0 con 0x7f2d84100260 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8980c700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d84100260 0x7f2d841997d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400e9d0 tx=0x7f2d7400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74009790 con 0x7f2d84100260 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2d7400ee70 con 0x7f2d84100260 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d841a1380 con 0x7f2d84100260 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74018680 con 0x7f2d84100260 2024-05-08T19:59:23.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.395+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d841a1880 con 0x7f2d84100260 2024-05-08T19:59:23.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.396+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 13) v1 ==== 45597+0+0 (secure 0 0 0) 0x7f2d740187e0 con 0x7f2d84100260 2024-05-08T19:59:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.396+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8410a6e0 con 0x7f2d84100260 2024-05-08T19:59:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.397+0000 7f2d7b7fe700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2d700389d0 0x7f2d7003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.397+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f2d74014070 con 0x7f2d84100260 2024-05-08T19:59:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.397+0000 7f2d8a00d700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2d700389d0 0x7f2d7003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:23.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.397+0000 7f2d8a00d700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2d700389d0 0x7f2d7003ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000b8b0 tx=0x7f2d80005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:23.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.402+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2d7401fd50 con 0x7f2d84100260 2024-05-08T19:59:23.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:23.623+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d840613e0 con 0x7f2d700389d0 2024-05-08T19:59:23.755 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:23.481+0000 7fd33b6fc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T19:59:23.755 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:23.673+0000 7fd33b6fc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T19:59:24.121 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:23.765+0000 7fd33b6fc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:23.920+0000 7fe4bd35a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:24.102+0000 7fe4bd35a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:24.287 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:24.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:24.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:24.288 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:24.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:24.512 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:24.512 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:24.513 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:24.624 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:24.297+0000 7fe4bd35a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T19:59:24.871 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:24 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:24.522+0000 7fd33b6fc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T19:59:24.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:24 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:24.619+0000 7fd33b6fc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T19:59:24.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:24 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:24.767+0000 7fd33b6fc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T19:59:25.499 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:25 smithi132 ceph-mon[47484]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:25.499 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:25.224+0000 7fe4bd35a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T19:59:25.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:25 smithi082 ceph-mon[46774]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:25.560 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:25.389+0000 7fd33b6fc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T19:59:25.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:25 smithi033 ceph-mon[42490]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:25.776 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:25.509+0000 7fe4bd35a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:59:25.776 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:25.597+0000 7fe4bd35a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T19:59:25.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:25.570+0000 7fd33b6fc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T19:59:25.872 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:25.763+0000 7fd33b6fc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T19:59:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1272756429' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "475543e7-9098-4d93-82e8-529f6ae4e779"}]: dispatch 2024-05-08T19:59:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1272756429' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "475543e7-9098-4d93-82e8-529f6ae4e779"}]': finished 2024-05-08T19:59:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T19:59:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: Standby manager daemon z started 2024-05-08T19:59:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T19:59:26.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T19:59:26.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T19:59:26.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:26 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1272756429' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "475543e7-9098-4d93-82e8-529f6ae4e779"}]: dispatch 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1272756429' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "475543e7-9098-4d93-82e8-529f6ae4e779"}]': finished 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: Standby manager daemon z started 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T19:59:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:26 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T19:59:26.624 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 19:59:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T19:59:25.786+0000 7fe4bd35a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T19:59:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1272756429' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "475543e7-9098-4d93-82e8-529f6ae4e779"}]: dispatch 2024-05-08T19:59:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1272756429' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "475543e7-9098-4d93-82e8-529f6ae4e779"}]': finished 2024-05-08T19:59:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T19:59:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: Standby manager daemon z started 2024-05-08T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T19:59:26.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:26 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/3647065184' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T19:59:26.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:26.647+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 14) v1 ==== 90707+0+0 (secure 0 0 0) 0x7f2d74010430 con 0x7f2d84100260 2024-05-08T19:59:26.960 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:26 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:26.687+0000 7fd33b6fc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T19:59:27.238 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:27 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1222151502' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T19:59:27.238 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:27 smithi082 ceph-mon[46774]: mgrmap e14: x(active, since 59s), standbys: z 2024-05-08T19:59:27.239 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T19:59:27.239 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:26 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:26.970+0000 7fd33b6fc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T19:59:27.239 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:27.057+0000 7fd33b6fc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T19:59:27.239 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 19:59:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T19:59:27.248+0000 7fd33b6fc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T19:59:27.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:27 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1222151502' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T19:59:27.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:27 smithi033 ceph-mon[42490]: mgrmap e14: x(active, since 59s), standbys: z 2024-05-08T19:59:27.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T19:59:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:27 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1222151502' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T19:59:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:27 smithi132 ceph-mon[47484]: mgrmap e14: x(active, since 59s), standbys: z 2024-05-08T19:59:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T19:59:28.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:28.166+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7f2d74018a90 con 0x7f2d84100260 2024-05-08T19:59:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:28 smithi033 ceph-mon[42490]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:28 smithi033 ceph-mon[42490]: Standby manager daemon y started 2024-05-08T19:59:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:28 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T19:59:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:28 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T19:59:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:28 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T19:59:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:28 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T19:59:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:28 smithi082 ceph-mon[46774]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:28 smithi082 ceph-mon[46774]: Standby manager daemon y started 2024-05-08T19:59:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:28 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T19:59:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:28 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T19:59:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:28 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T19:59:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:28 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T19:59:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:28 smithi132 ceph-mon[47484]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:28 smithi132 ceph-mon[47484]: Standby manager daemon y started 2024-05-08T19:59:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:28 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T19:59:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:28 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T19:59:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:28 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T19:59:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:28 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/1281033109' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T19:59:29.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:29 smithi033 ceph-mon[42490]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-05-08T19:59:29.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T19:59:29.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:29 smithi082 ceph-mon[46774]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-05-08T19:59:29.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T19:59:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:29 smithi132 ceph-mon[47484]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-05-08T19:59:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T19:59:30.511 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:30 smithi033 ceph-mon[42490]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:30.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:30 smithi082 ceph-mon[46774]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:30.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:30 smithi132 ceph-mon[47484]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:32.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:32 smithi033 ceph-mon[42490]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:32.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:32 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T19:59:32.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:32 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:32.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:32 smithi082 ceph-mon[46774]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:32.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:32 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T19:59:32.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:32 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:32 smithi132 ceph-mon[47484]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:32 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T19:59:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:32 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:33.426 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:33 smithi033 ceph-mon[42490]: Deploying daemon osd.0 on smithi033 2024-05-08T19:59:33.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:33 smithi082 ceph-mon[46774]: Deploying daemon osd.0 on smithi033 2024-05-08T19:59:33.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:33 smithi132 ceph-mon[47484]: Deploying daemon osd.0 on smithi033 2024-05-08T19:59:34.316 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:34 smithi033 ceph-mon[42490]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:34.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:34 smithi082 ceph-mon[46774]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:34 smithi132 ceph-mon[47484]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:36.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:36 smithi033 ceph-mon[42490]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:36.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:36 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:36.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:36 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:36.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:36 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:36 smithi082 ceph-mon[46774]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:36 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:36 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:36 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:36 smithi132 ceph-mon[47484]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:36 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:36 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:36 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:37 smithi033 ceph-mon[42490]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:38.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.023+0000 7f2d7b7fe700 1 -- 172.21.15.33:0/1823948125 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2d840613e0 con 0x7f2d700389d0 2024-05-08T19:59:38.013 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2d700389d0 msgr2=0x7f2d7003ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2d700389d0 0x7f2d7003ae90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000b8b0 tx=0x7f2d80005fd0 comp rx=0 tx=0).stop 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d84100260 msgr2=0x7f2d841997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d84100260 0x7f2d841997d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d7400e9d0 tx=0x7f2d7400ece0 comp rx=0 tx=0).stop 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 shutdown_connections 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d84100c20 0x7f2d841a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2d700389d0 0x7f2d7003ae90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d840ff900 0x7f2d84199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 --2- 172.21.15.33:0/1823948125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d84100260 0x7f2d841997d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 >> 172.21.15.33:0/1823948125 conn(0x7f2d840fb4a0 msgr2=0x7f2d840fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:38.017 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 shutdown_connections 2024-05-08T19:59:38.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T19:59:38.027+0000 7f2d8c271700 1 -- 172.21.15.33:0/1823948125 wait complete. 2024-05-08T19:59:38.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:38.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:38.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:37 smithi082 ceph-mon[46774]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:38.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:38.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:38.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:38.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:38.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:38.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:37 smithi132 ceph-mon[47484]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:38.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:38.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:38.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:38.422 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.0.service 2024-05-08T19:59:38.424 INFO:tasks.cephadm:Deploying osd.1 on smithi082 with /dev/vg_nvme/lv_4... 2024-05-08T19:59:38.425 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T19:59:38.458 INFO:journalctl@ceph.osd.0.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T19:59:38.651 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T19:59:39.059 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:39.059 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:39.059 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:39.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:39.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:39.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:39.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:39.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:39.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:39.903 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T19:59:39.903 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T19:59:39.903 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T19:59:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T19:59:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.01128 s, 930 MB/s 2024-05-08T19:59:39.904 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 2024-05-08T19:59:39.904 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T19:59:39.978 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 19:59:39 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-0[61701]: 2024-05-08T19:59:39.656+0000 7f53f082b7c0 -1 osd.0 0 log_to_monitors true 2024-05-08T19:59:40.196 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:39 smithi082 ceph-mon[46774]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:40.196 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:39 smithi082 ceph-mon[46774]: from='osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T19:59:40.196 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:39 smithi082 ceph-mon[46774]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T19:59:40.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-05-08T19:59:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:39 smithi033 ceph-mon[42490]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:39 smithi033 ceph-mon[42490]: from='osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T19:59:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:39 smithi033 ceph-mon[42490]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T19:59:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:39 smithi132 ceph-mon[47484]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:39 smithi132 ceph-mon[47484]: from='osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T19:59:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:39 smithi132 ceph-mon[47484]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T19:59:40.495 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T19:59:41.259 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:40 smithi082 ceph-mon[46774]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T19:59:41.259 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:40 smithi082 ceph-mon[46774]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:40 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:40 smithi082 ceph-mon[46774]: from='osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:40 smithi082 ceph-mon[46774]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:40 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:40 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:41.260 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:59:41.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:41.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:41.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T19:59:41.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T19:59:41.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:41.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 -- 172.21.15.82:0/3650654308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 msgr2=0x7fd0780ffaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 --2- 172.21.15.82:0/3650654308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd0780ffaa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0680099c0 tx=0x7fd068009cd0 comp rx=0 tx=0).stop 2024-05-08T19:59:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 -- 172.21.15.82:0/3650654308 shutdown_connections 2024-05-08T19:59:41.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 --2- 172.21.15.82:0/3650654308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd078101220 0x7fd078107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 --2- 172.21.15.82:0/3650654308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd0780ffaa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 --2- 172.21.15.82:0/3650654308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd078100880 0x7fd078100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 -- 172.21.15.82:0/3650654308 >> 172.21.15.82:0/3650654308 conn(0x7fd0780fac40 msgr2=0x7fd0780fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 -- 172.21.15.82:0/3650654308 shutdown_connections 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.438+0000 7fd07db6f700 1 -- 172.21.15.82:0/3650654308 wait complete. 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 Processor -- start 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 -- start start 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd078108f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd078100880 0x7fd07819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd078101220 0x7fd07819e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07819eb40 con 0x7fd078101220 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07819ecb0 con 0x7fd0780ff680 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd07db6f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd07819ee70 con 0x7fd078100880 2024-05-08T19:59:41.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd078108f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd0777fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd078108f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38042/0 (socket says 172.21.15.82:38042) 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd0777fe700 1 -- 172.21.15.82:0/756365441 learned_addr learned my addr 172.21.15.82:0/756365441 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd077fff700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd078101220 0x7fd07819e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.439+0000 7fd076ffd700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd078100880 0x7fd07819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd0777fe700 1 -- 172.21.15.82:0/756365441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd078100880 msgr2=0x7fd07819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd0777fe700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd078100880 0x7fd07819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd0777fe700 1 -- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd078101220 msgr2=0x7fd07819e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd0777fe700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd078101220 0x7fd07819e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd0777fe700 1 -- 172.21.15.82:0/756365441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0680095f0 con 0x7fd0780ff680 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd077fff700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd078101220 0x7fd07819e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd0777fe700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd078108f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd068003800 tx=0x7fd068009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd074ff9700 1 -- 172.21.15.82:0/756365441 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06801d070 con 0x7fd0780ff680 2024-05-08T19:59:41.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd074ff9700 1 -- 172.21.15.82:0/756365441 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd0680040a0 con 0x7fd0780ff680 2024-05-08T19:59:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd07819f0f0 con 0x7fd0780ff680 2024-05-08T19:59:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd074ff9700 1 -- 172.21.15.82:0/756365441 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06800fe30 con 0x7fd0780ff680 2024-05-08T19:59:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.440+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd07819f500 con 0x7fd0780ff680 2024-05-08T19:59:41.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.441+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd078106b10 con 0x7fd0780ff680 2024-05-08T19:59:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.442+0000 7fd074ff9700 1 -- 172.21.15.82:0/756365441 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fd06800f460 con 0x7fd0780ff680 2024-05-08T19:59:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.442+0000 7fd074ff9700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0600a1110 0x7fd0600a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.442+0000 7fd074ff9700 1 -- 172.21.15.82:0/756365441 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1487+0+0 (secure 0 0 0) 0x7fd0680cbe00 con 0x7fd0780ff680 2024-05-08T19:59:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.443+0000 7fd076ffd700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0600a1110 0x7fd0600a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:41.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.443+0000 7fd076ffd700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0600a1110 0x7fd0600a35d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd06c005fd0 tx=0x7fd06c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:41.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.447+0000 7fd074ff9700 1 -- 172.21.15.82:0/756365441 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd068097110 con 0x7fd0780ff680 2024-05-08T19:59:41.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:41.648+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd07802ce60 con 0x7fd0600a1110 2024-05-08T19:59:41.821 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 19:59:41 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-0[61701]: 2024-05-08T19:59:41.476+0000 7f53e5e8f700 -1 osd.0 0 waiting for initial osdmap 2024-05-08T19:59:41.821 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 19:59:41 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-0[61701]: 2024-05-08T19:59:41.479+0000 7f53ddc7c700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi033 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi033 to 17118M 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: from='osd.0 ' entity='osd.0' 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:42.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi033 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi033 to 17118M 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: from='osd.0 ' entity='osd.0' 2024-05-08T19:59:42.334 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:42.335 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:42.335 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:42.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi033 2024-05-08T19:59:42.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi033 to 17118M 2024-05-08T19:59:42.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: from='osd.0 ' entity='osd.0' 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:42.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:43 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T19:59:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:43 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T19:59:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:43 smithi033 ceph-mon[42490]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:43 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:43 smithi033 ceph-mon[42490]: osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] boot 2024-05-08T19:59:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:43 smithi033 ceph-mon[42490]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T19:59:43.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:43 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:43.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:43 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T19:59:43.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:43 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T19:59:43.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:43 smithi082 ceph-mon[46774]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:43.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:43 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:43.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:43 smithi082 ceph-mon[46774]: osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] boot 2024-05-08T19:59:43.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:43 smithi082 ceph-mon[46774]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T19:59:43.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:43 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:43 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T19:59:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:43 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T19:59:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:43 smithi132 ceph-mon[47484]: from='client.24152 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T19:59:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:43 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:43 smithi132 ceph-mon[47484]: osd.0 [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] boot 2024-05-08T19:59:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:43 smithi132 ceph-mon[47484]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T19:59:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:43 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T19:59:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:44 smithi033 ceph-mon[42490]: pgmap v36: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:44 smithi033 ceph-mon[42490]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T19:59:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:44 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/2517322550' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]: dispatch 2024-05-08T19:59:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:44 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]: dispatch 2024-05-08T19:59:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:44 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]': finished 2024-05-08T19:59:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:44 smithi033 ceph-mon[42490]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T19:59:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:44 smithi082 ceph-mon[46774]: pgmap v36: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:44 smithi082 ceph-mon[46774]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T19:59:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:44 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/2517322550' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]: dispatch 2024-05-08T19:59:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:44 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]: dispatch 2024-05-08T19:59:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:44 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]': finished 2024-05-08T19:59:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:44 smithi082 ceph-mon[46774]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T19:59:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:44 smithi132 ceph-mon[47484]: pgmap v36: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:44 smithi132 ceph-mon[47484]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T19:59:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:44 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/2517322550' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]: dispatch 2024-05-08T19:59:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:44 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]: dispatch 2024-05-08T19:59:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:44 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47267f72-b070-4a71-a9fd-8737a8e4ed6e"}]': finished 2024-05-08T19:59:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:44 smithi132 ceph-mon[47484]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T19:59:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:45.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:45 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/3899107826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T19:59:45.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:45 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/3899107826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T19:59:45.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:45 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/3899107826' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T19:59:46.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:46 smithi033 ceph-mon[42490]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:46.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:46 smithi082 ceph-mon[46774]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:46.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:46 smithi132 ceph-mon[47484]: pgmap v39: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:48.183 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:48 smithi082 ceph-mon[46774]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:48.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:48 smithi132 ceph-mon[47484]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:48 smithi033 ceph-mon[42490]: pgmap v40: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:50.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:50 smithi082 ceph-mon[46774]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:50.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:50 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T19:59:50.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:50 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:50.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:50 smithi082 ceph-mon[46774]: Deploying daemon osd.1 on smithi082 2024-05-08T19:59:50.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:50 smithi132 ceph-mon[47484]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:50.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:50 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T19:59:50.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:50 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:50.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:50 smithi132 ceph-mon[47484]: Deploying daemon osd.1 on smithi082 2024-05-08T19:59:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:50 smithi033 ceph-mon[42490]: pgmap v41: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:50 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T19:59:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:50 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:50 smithi033 ceph-mon[42490]: Deploying daemon osd.1 on smithi082 2024-05-08T19:59:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:52 smithi082 ceph-mon[46774]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:52 smithi132 ceph-mon[47484]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:52 smithi033 ceph-mon[42490]: pgmap v42: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:54.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:53 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:54.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:53 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:54.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:53 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:54.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:53 smithi082 ceph-mon[46774]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:54.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:54.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:54.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:54.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:53 smithi033 ceph-mon[42490]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:53 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:53 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:53 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:53 smithi132 ceph-mon[47484]: pgmap v43: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:55.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.110+0000 7fd074ff9700 1 -- 172.21.15.82:0/756365441 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd07802ce60 con 0x7fd0600a1110 2024-05-08T19:59:55.100 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 1 on host 'smithi082' 2024-05-08T19:59:55.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0600a1110 msgr2=0x7fd0600a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:55.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0600a1110 0x7fd0600a35d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd06c005fd0 tx=0x7fd06c00a560 comp rx=0 tx=0).stop 2024-05-08T19:59:55.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 msgr2=0x7fd078108f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:55.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd078108f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd068003800 tx=0x7fd068009580 comp rx=0 tx=0).stop 2024-05-08T19:59:55.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 shutdown_connections 2024-05-08T19:59:55.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd078101220 0x7fd07819e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0780ff680 0x7fd078108f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0600a1110 0x7fd0600a35d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 --2- 172.21.15.82:0/756365441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd078100880 0x7fd07819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 >> 172.21.15.82:0/756365441 conn(0x7fd0780fac40 msgr2=0x7fd078103c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.112+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 shutdown_connections 2024-05-08T19:59:55.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T19:59:55.113+0000 7fd07db6f700 1 -- 172.21.15.82:0/756365441 wait complete. 2024-05-08T19:59:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:55.470 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:55.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:55.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.471 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.472 DEBUG:teuthology.orchestra.run.smithi082:osd.1> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.1.service 2024-05-08T19:59:55.474 INFO:tasks.cephadm:Deploying osd.2 on smithi132 with /dev/vg_nvme/lv_4... 2024-05-08T19:59:55.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T19:59:55.504 INFO:journalctl@ceph.osd.1.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T19:59:55.505 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.505 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.505 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:55.505 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:55.505 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.505 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:55.506 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.506 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:55.698 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T19:59:56.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:56 smithi132 ceph-mon[47484]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:56.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:56 smithi033 ceph-mon[42490]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:56.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:56 smithi082 ceph-mon[46774]: pgmap v44: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:57.014 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T19:59:57.014 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T19:59:57.014 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2024-05-08T19:59:57.015 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2024-05-08T19:59:57.015 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111904 s, 937 MB/s 2024-05-08T19:59:57.015 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2024-05-08T19:59:57.256 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 19:59:56 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-1[51770]: 2024-05-08T19:59:56.988+0000 7f6aa46d17c0 -1 osd.1 0 log_to_monitors true 2024-05-08T19:59:57.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:57 smithi132 ceph-mon[47484]: from='osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T19:59:57.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:57 smithi132 ceph-mon[47484]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T19:59:57.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_4 2024-05-08T19:59:57.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:57 smithi033 ceph-mon[42490]: from='osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T19:59:57.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:57 smithi033 ceph-mon[42490]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T19:59:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:57 smithi082 ceph-mon[46774]: from='osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T19:59:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:57 smithi082 ceph-mon[46774]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T19:59:57.637 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T19:59:58.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:58.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T19:59:58.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T19:59:58.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:58.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T19:59:58.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T19:59:58.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:59:58.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:58.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:58.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:59:58.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:58.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:58.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.622 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 19:59:58 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-1[51770]: 2024-05-08T19:59:58.282+0000 7f6a99d35700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T19:59:58.622 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 19:59:58 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-1[51770]: 2024-05-08T19:59:58.285+0000 7f6a95b2a700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T19:59:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: pgmap v45: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T19:59:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T19:59:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T19:59:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T19:59:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T19:59:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T19:59:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T19:59:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T19:59:58.634 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.643+0000 7fd1a440c700 1 -- 172.21.15.132:0/3481256177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 msgr2=0x7fd19c108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 --2- 172.21.15.132:0/3481256177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c108340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd19400b0a0 tx=0x7fd19400b3b0 comp rx=0 tx=0).stop 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- 172.21.15.132:0/3481256177 shutdown_connections 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 --2- 172.21.15.132:0/3481256177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c108340 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 --2- 172.21.15.132:0/3481256177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c0fff00 0x7fd19c100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 --2- 172.21.15.132:0/3481256177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd19c101060 0x7fd19c1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- 172.21.15.132:0/3481256177 >> 172.21.15.132:0/3481256177 conn(0x7fd19c0fb4c0 msgr2=0x7fd19c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- 172.21.15.132:0/3481256177 shutdown_connections 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- 172.21.15.132:0/3481256177 wait complete. 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 Processor -- start 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- start start 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd19c0fff00 0x7fd19c196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c101060 0x7fd19c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:58.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c19e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c19ea10 con 0x7fd19c0fff00 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c19eb50 con 0x7fd19c101060 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.644+0000 7fd1a440c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c19ece0 con 0x7fd19c101a20 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c19e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c19e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43576/0 (socket says 172.21.15.132:43576) 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 -- 172.21.15.132:0/2525117514 learned_addr learned my addr 172.21.15.132:0/2525117514 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a19a7700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c101060 0x7fd19c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a21a8700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd19c0fff00 0x7fd19c196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 -- 172.21.15.132:0/2525117514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c101060 msgr2=0x7fd19c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c101060 0x7fd19c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 -- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd19c0fff00 msgr2=0x7fd19c196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd19c0fff00 0x7fd19c196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T19:59:58.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 -- 172.21.15.132:0/2525117514 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd194009d00 con 0x7fd19c101a20 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a21a8700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd19c0fff00 0x7fd19c196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a29a9700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c19e440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd19400b070 tx=0x7fd194005a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd18f7fe700 1 -- 172.21.15.132:0/2525117514 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19400e040 con 0x7fd19c101a20 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd18f7fe700 1 -- 172.21.15.132:0/2525117514 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd194012de0 con 0x7fd19c101a20 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c19ef60 con 0x7fd19c101a20 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd18f7fe700 1 -- 172.21.15.132:0/2525117514 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19401b450 con 0x7fd19c101a20 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.645+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c19f370 con 0x7fd19c101a20 2024-05-08T19:59:58.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.646+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c04ec60 con 0x7fd19c101a20 2024-05-08T19:59:58.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.647+0000 7fd18f7fe700 1 -- 172.21.15.132:0/2525117514 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fd19401d710 con 0x7fd19c101a20 2024-05-08T19:59:58.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.648+0000 7fd18f7fe700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1880a1090 0x7fd1880a3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T19:59:58.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.648+0000 7fd18f7fe700 1 -- 172.21.15.132:0/2525117514 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2029+0+0 (secure 0 0 0) 0x7fd1940cc8c0 con 0x7fd19c101a20 2024-05-08T19:59:58.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.648+0000 7fd1a21a8700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1880a1090 0x7fd1880a3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T19:59:58.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.649+0000 7fd1a21a8700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1880a1090 0x7fd1880a3550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd198005950 tx=0x7fd1980058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T19:59:58.641 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.652+0000 7fd18f7fe700 1 -- 172.21.15.132:0/2525117514 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd194097a50 con 0x7fd19c101a20 2024-05-08T19:59:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T19:59:58.852+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd19c0fd630 con 0x7fd1880a1090 2024-05-08T19:59:59.521 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi082 2024-05-08T19:59:59.521 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi082 to 17113M 2024-05-08T19:59:59.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T19:59:59.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T19:59:59.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:59.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:59.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:59.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:59.522 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 19:59:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi082 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi082 to 17113M 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:59.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 19:59:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi082 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi082 to 17113M 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T19:59:59.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 19:59:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] boot 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:00:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:00 smithi033 ceph-mon[42490]: overall HEALTH_OK 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] boot 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:00:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:00 smithi082 ceph-mon[46774]: overall HEALTH_OK 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: pgmap v48: 0 pgs: ; 0 B data, 30 MiB used, 89 GiB / 89 GiB avail 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: osd.1 [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] boot 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T20:00:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:00:00.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:00 smithi132 ceph-mon[47484]: overall HEALTH_OK 2024-05-08T20:00:01.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:01 smithi033 ceph-mon[42490]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T20:00:01.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:01 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/2347252528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]: dispatch 2024-05-08T20:00:01.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:01 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]: dispatch 2024-05-08T20:00:01.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:01 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]': finished 2024-05-08T20:00:01.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:01 smithi033 ceph-mon[42490]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T20:00:01.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:01.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:01 smithi082 ceph-mon[46774]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T20:00:01.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:01 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/2347252528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]: dispatch 2024-05-08T20:00:01.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:01 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]: dispatch 2024-05-08T20:00:01.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:01 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]': finished 2024-05-08T20:00:01.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:01 smithi082 ceph-mon[46774]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T20:00:01.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:01.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:01 smithi132 ceph-mon[47484]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T20:00:01.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:01 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/2347252528' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]: dispatch 2024-05-08T20:00:01.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:01 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]: dispatch 2024-05-08T20:00:01.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:01 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4a04dc0-c34f-488e-b0e9-8826eb6a555c"}]': finished 2024-05-08T20:00:01.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:01 smithi132 ceph-mon[47484]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T20:00:01.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:02.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:02 smithi033 ceph-mon[42490]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:02.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:02 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/1165961187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:02 smithi082 ceph-mon[46774]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:02 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/1165961187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:02.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:02 smithi132 ceph-mon[47484]: pgmap v52: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:02.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:02 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/1165961187' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:04 smithi033 ceph-mon[42490]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:04.607 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:04 smithi132 ceph-mon[47484]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:04.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:04 smithi082 ceph-mon[46774]: pgmap v53: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:06.457 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:06 smithi132 ceph-mon[47484]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:06.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:06 smithi033 ceph-mon[42490]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:06 smithi082 ceph-mon[46774]: pgmap v54: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:07.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:07 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T20:00:07.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:07 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:07.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:07 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T20:00:07.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:07 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:07 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T20:00:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:07 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:08 smithi033 ceph-mon[42490]: Deploying daemon osd.2 on smithi132 2024-05-08T20:00:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:08 smithi033 ceph-mon[42490]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:08.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:08 smithi132 ceph-mon[47484]: Deploying daemon osd.2 on smithi132 2024-05-08T20:00:08.575 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:08 smithi132 ceph-mon[47484]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:08 smithi082 ceph-mon[46774]: Deploying daemon osd.2 on smithi132 2024-05-08T20:00:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:08 smithi082 ceph-mon[46774]: pgmap v55: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:10 smithi033 ceph-mon[42490]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:10 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:10 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:10 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:10.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:10 smithi082 ceph-mon[46774]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:10 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:10 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:10 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:10 smithi132 ceph-mon[47484]: pgmap v56: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:10 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:10 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:10 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.306+0000 7fd18f7fe700 1 -- 172.21.15.132:0/2525117514 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd19c0fd630 con 0x7fd1880a1090 2024-05-08T20:00:12.297 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 2 on host 'smithi132' 2024-05-08T20:00:12.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1880a1090 msgr2=0x7fd1880a3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1880a1090 0x7fd1880a3550 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd198005950 tx=0x7fd1980058e0 comp rx=0 tx=0).stop 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 msgr2=0x7fd19c19e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c19e440 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd19400b070 tx=0x7fd194005a60 comp rx=0 tx=0).stop 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 shutdown_connections 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1880a1090 0x7fd1880a3550 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd19c101a20 0x7fd19c19e440 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd19c0fff00 0x7fd19c196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 --2- 172.21.15.132:0/2525117514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd19c101060 0x7fd19c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 >> 172.21.15.132:0/2525117514 conn(0x7fd19c0fb4c0 msgr2=0x7fd19c0fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 shutdown_connections 2024-05-08T20:00:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:12.309+0000 7fd1a440c700 1 -- 172.21.15.132:0/2525117514 wait complete. 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.594 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:12.594 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.594 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.594 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:12.595 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:12.595 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.595 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.595 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: pgmap v57: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:12.672 DEBUG:teuthology.orchestra.run.smithi132:osd.2> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.2.service 2024-05-08T20:00:12.674 INFO:tasks.cephadm:Deploying osd.3 on smithi033 with /dev/vg_nvme/lv_3... 2024-05-08T20:00:12.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T20:00:12.707 INFO:journalctl@ceph.osd.2.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:00:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:00:13.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:13.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:13.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T20:00:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T20:00:14.402 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-05-08T20:00:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-05-08T20:00:14.402 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0117454 s, 893 MB/s 2024-05-08T20:00:14.402 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-05-08T20:00:14.519 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:14 smithi132 ceph-mon[47484]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:14.519 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:14 smithi132 ceph-mon[47484]: from='osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T20:00:14.519 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:14 smithi132 ceph-mon[47484]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T20:00:14.519 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-2[53255]: 2024-05-08T20:00:14.229+0000 7eff15bf87c0 -1 osd.2 0 log_to_monitors true 2024-05-08T20:00:14.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:14 smithi033 ceph-mon[42490]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:14.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:14 smithi033 ceph-mon[42490]: from='osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T20:00:14.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:14 smithi033 ceph-mon[42490]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T20:00:14.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:14 smithi082 ceph-mon[46774]: pgmap v58: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:14.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:14 smithi082 ceph-mon[46774]: from='osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T20:00:14.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:14 smithi082 ceph-mon[46774]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T20:00:14.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2024-05-08T20:00:15.093 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:00:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T20:00:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T20:00:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:00:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:00:15.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:15.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:15.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:15.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.624 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-2[53255]: 2024-05-08T20:00:15.339+0000 7eff0b25c700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T20:00:15.624 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-2[53255]: 2024-05-08T20:00:15.343+0000 7eff07051700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:00:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T20:00:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T20:00:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.166+0000 7fa84caaf700 1 -- 172.21.15.33:0/3624010642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 msgr2=0x7fa848101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.166+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3624010642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848101400 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa8380099c0 tx=0x7fa838009cd0 comp rx=0 tx=0).stop 2024-05-08T20:00:16.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 -- 172.21.15.33:0/3624010642 shutdown_connections 2024-05-08T20:00:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3624010642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa848102b80 0x7fa848109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3624010642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848101400 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3624010642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8481021e0 0x7fa848102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 -- 172.21.15.33:0/3624010642 >> 172.21.15.33:0/3624010642 conn(0x7fa8480fc580 msgr2=0x7fa8480fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:00:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 -- 172.21.15.33:0/3624010642 shutdown_connections 2024-05-08T20:00:16.157 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 -- 172.21.15.33:0/3624010642 wait complete. 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.167+0000 7fa84caaf700 1 Processor -- start 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84caaf700 1 -- start start 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84caaf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84caaf700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8481021e0 0x7fa8481974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84caaf700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa848102b80 0x7fa84819e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84caaf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84819ead0 con 0x7fa848100fe0 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84caaf700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84819ec10 con 0x7fa8481021e0 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84caaf700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84819eda0 con 0x7fa848102b80 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55488/0 (socket says 172.21.15.33:55488) 2024-05-08T20:00:16.159 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 -- 172.21.15.33:0/3215646229 learned_addr learned my addr 172.21.15.33:0/3215646229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa845d9b700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8481021e0 0x7fa8481974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa846d9d700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa848102b80 0x7fa84819e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 -- 172.21.15.33:0/3215646229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa848102b80 msgr2=0x7fa84819e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa848102b80 0x7fa84819e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 -- 172.21.15.33:0/3215646229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8481021e0 msgr2=0x7fa8481974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8481021e0 0x7fa8481974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 -- 172.21.15.33:0/3215646229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380095f0 con 0x7fa848100fe0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.168+0000 7fa84659c700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848196f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8380098e0 tx=0x7fa838004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.169+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83801d070 con 0x7fa848100fe0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.169+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa8380040a0 con 0x7fa848100fe0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.169+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84819f020 con 0x7fa848100fe0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.169+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838022ea0 con 0x7fa848100fe0 2024-05-08T20:00:16.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.169+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84819f490 con 0x7fa848100fe0 2024-05-08T20:00:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.170+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8481083c0 con 0x7fa848100fe0 2024-05-08T20:00:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.171+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 15) v1 ==== 135817+0+0 (secure 0 0 0) 0x7fa838022600 con 0x7fa848100fe0 2024-05-08T20:00:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.171+0000 7fa83f7fe700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa8340a1110 0x7fa8340a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:16.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.172+0000 7fa845d9b700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa8340a1110 0x7fa8340a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.172+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 2571+0+0 (secure 0 0 0) 0x7fa8380cc310 con 0x7fa848100fe0 2024-05-08T20:00:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.172+0000 7fa845d9b700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa8340a1110 0x7fa8340a35d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa83000ac50 tx=0x7fa83000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:00:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.176+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa8380973a0 con 0x7fa848100fe0 2024-05-08T20:00:16.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:16.401+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8480613e0 con 0x7fa8340a1110 2024-05-08T20:00:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:16 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi132 2024-05-08T20:00:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:16 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi132 to 17114M 2024-05-08T20:00:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:16 smithi082 ceph-mon[46774]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:16 smithi082 ceph-mon[46774]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:00:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:16 smithi082 ceph-mon[46774]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T20:00:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:16 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi132 2024-05-08T20:00:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:16 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi132 to 17114M 2024-05-08T20:00:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:16 smithi132 ceph-mon[47484]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:16 smithi132 ceph-mon[47484]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:00:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:16 smithi132 ceph-mon[47484]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T20:00:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:16.809 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:16 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi132 2024-05-08T20:00:16.809 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:16 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi132 to 17114M 2024-05-08T20:00:16.810 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:16 smithi033 ceph-mon[42490]: pgmap v60: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:16.810 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:16 smithi033 ceph-mon[42490]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:00:16.810 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:16 smithi033 ceph-mon[42490]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T20:00:16.810 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:16.810 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:17 smithi033 ceph-mon[42490]: osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] boot 2024-05-08T20:00:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:17 smithi033 ceph-mon[42490]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T20:00:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:17 smithi082 ceph-mon[46774]: osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] boot 2024-05-08T20:00:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:17 smithi082 ceph-mon[46774]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T20:00:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:17.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:17 smithi132 ceph-mon[47484]: osd.2 [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] boot 2024-05-08T20:00:17.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:17 smithi132 ceph-mon[47484]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T20:00:17.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:00:17.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:17.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:17.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T20:00:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:00:18.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2751412923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6988c00-180e-459e-aabb-96b918684e46"}]: dispatch 2024-05-08T20:00:18.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T20:00:18.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2751412923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6988c00-180e-459e-aabb-96b918684e46"}]': finished 2024-05-08T20:00:18.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T20:00:18.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:00:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2751412923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6988c00-180e-459e-aabb-96b918684e46"}]: dispatch 2024-05-08T20:00:18.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T20:00:18.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2751412923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6988c00-180e-459e-aabb-96b918684e46"}]': finished 2024-05-08T20:00:18.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T20:00:18.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:19.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:00:19.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2751412923' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f6988c00-180e-459e-aabb-96b918684e46"}]: dispatch 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2751412923' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f6988c00-180e-459e-aabb-96b918684e46"}]': finished 2024-05-08T20:00:19.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: osdmap e20: 4 total, 3 up, 4 in 2024-05-08T20:00:19.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:19.555 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67391]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T20:00:19.555 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67391]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:19.555 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67391]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:19.555 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67391]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:19.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:19 smithi033 ceph-mon[42490]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:19.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:19 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2120874506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:19.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:19 smithi033 ceph-mon[42490]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T20:00:19.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:19.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:19.822 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67444]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T20:00:19.822 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67444]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:19.822 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67444]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:19.822 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:00:19 smithi033 sudo[67444]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:19 smithi082 ceph-mon[46774]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:19 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2120874506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:19 smithi082 ceph-mon[46774]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T20:00:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:19.872 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:19 smithi082 sudo[57355]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T20:00:19.872 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:19 smithi082 sudo[57355]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:19.872 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:19 smithi082 sudo[57355]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:19.872 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:19 smithi082 sudo[57355]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:19 smithi132 ceph-mon[47484]: pgmap v66: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:19 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2120874506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:19 smithi132 ceph-mon[47484]: osdmap e21: 4 total, 3 up, 4 in 2024-05-08T20:00:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:20.371 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:20 smithi082 sudo[57358]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T20:00:20.372 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:20 smithi082 sudo[57358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:20.372 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:20 smithi082 sudo[57358]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:20.372 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:00:20 smithi082 sudo[57358]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:20.624 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57897]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T20:00:20.624 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57897]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:20.625 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57897]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:20.625 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57897]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:20.625 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57900]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T20:00:20.625 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57900]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:20.625 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57900]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:20.625 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:00:20 smithi132 sudo[57900]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:21.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68188]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T20:00:21.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68188]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:21.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68188]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:21.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68188]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:21.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:21.559+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fa838097770 con 0x7fa848100fe0 2024-05-08T20:00:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68565]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T20:00:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68565]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68565]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 sudo[68565]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:21 smithi033 ceph-mon[42490]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:21.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:21.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:21.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:21 smithi082 ceph-mon[46774]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:21 smithi132 ceph-mon[47484]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:21 smithi132 sudo[57903]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T20:00:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:21 smithi132 sudo[57903]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:21 smithi132 sudo[57903]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:21 smithi132 sudo[57903]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:22.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 sudo[57906]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T20:00:22.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 sudo[57906]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:22.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 sudo[57906]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:22.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 sudo[57906]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:22.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57361]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T20:00:22.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57361]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:22.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57361]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:22.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57361]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:22.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57364]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T20:00:22.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57364]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T20:00:22.560 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57364]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T20:00:22.561 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 sudo[57364]: pam_unix(sudo:session): session closed for user root 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: mgrmap e16: x(active, since 114s), standbys: z, y 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:22 smithi033 ceph-mon[42490]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: mgrmap e16: x(active, since 114s), standbys: z, y 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:22 smithi082 ceph-mon[46774]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: mgrmap e16: x(active, since 114s), standbys: z, y 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T20:00:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:00:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:00:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:00:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:22 smithi132 ceph-mon[47484]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T20:00:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:23 smithi033 ceph-mon[42490]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:23.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:23 smithi082 ceph-mon[46774]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:23 smithi132 ceph-mon[47484]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T20:00:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:24.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T20:00:24.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:24.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T20:00:24.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:25 smithi082 ceph-mon[46774]: Deploying daemon osd.3 on smithi033 2024-05-08T20:00:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:25 smithi082 ceph-mon[46774]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:25.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:25 smithi132 ceph-mon[47484]: Deploying daemon osd.3 on smithi033 2024-05-08T20:00:25.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:25 smithi132 ceph-mon[47484]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:26.022 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:25 smithi033 ceph-mon[42490]: Deploying daemon osd.3 on smithi033 2024-05-08T20:00:26.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:25 smithi033 ceph-mon[42490]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T20:00:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:28 smithi033 ceph-mon[42490]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T20:00:28.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:28 smithi082 ceph-mon[46774]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T20:00:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:28 smithi132 ceph-mon[47484]: pgmap v71: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-05-08T20:00:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:29 smithi033 ceph-mon[42490]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-05-08T20:00:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:29 smithi082 ceph-mon[46774]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-05-08T20:00:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:29 smithi132 ceph-mon[47484]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2024-05-08T20:00:30.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.801+0000 7fa83f7fe700 1 -- 172.21.15.33:0/3215646229 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa8480613e0 con 0x7fa8340a1110 2024-05-08T20:00:30.791 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 3 on host 'smithi033' 2024-05-08T20:00:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.804+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa8340a1110 msgr2=0x7fa8340a35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.804+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa8340a1110 0x7fa8340a35d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa83000ac50 tx=0x7fa83000a380 comp rx=0 tx=0).stop 2024-05-08T20:00:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.804+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 msgr2=0x7fa848196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.804+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848196f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8380098e0 tx=0x7fa838004730 comp rx=0 tx=0).stop 2024-05-08T20:00:30.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 shutdown_connections 2024-05-08T20:00:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa8340a1110 0x7fa8340a35d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa848102b80 0x7fa84819e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa848100fe0 0x7fa848196f90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 --2- 172.21.15.33:0/3215646229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa8481021e0 0x7fa8481974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 >> 172.21.15.33:0/3215646229 conn(0x7fa8480fc580 msgr2=0x7fa848105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:00:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 shutdown_connections 2024-05-08T20:00:30.795 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:00:30.805+0000 7fa84caaf700 1 -- 172.21.15.33:0/3215646229 wait complete. 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:30.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:31.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:31.194 DEBUG:teuthology.orchestra.run.smithi033:osd.3> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.3.service 2024-05-08T20:00:31.196 INFO:tasks.cephadm:Deploying osd.4 on smithi082 with /dev/vg_nvme/lv_3... 2024-05-08T20:00:31.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T20:00:31.233 INFO:journalctl@ceph.osd.3.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T20:00:31.427 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:00:32.036 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:31 smithi033 ceph-mon[42490]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T20:00:32.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:31 smithi082 ceph-mon[46774]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T20:00:32.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:31 smithi132 ceph-mon[47484]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T20:00:32.710 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T20:00:32.711 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T20:00:32.711 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T20:00:32.711 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T20:00:32.711 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0149907 s, 699 MB/s 2024-05-08T20:00:32.711 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T20:00:32.821 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:00:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-3[69600]: 2024-05-08T20:00:32.424+0000 7fd8244127c0 -1 osd.3 0 log_to_monitors true 2024-05-08T20:00:33.091 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:32 smithi082 ceph-mon[46774]: from='osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T20:00:33.091 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:32 smithi082 ceph-mon[46774]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T20:00:33.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-05-08T20:00:33.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:32 smithi132 ceph-mon[47484]: from='osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T20:00:33.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:32 smithi132 ceph-mon[47484]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T20:00:33.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:32 smithi033 ceph-mon[42490]: from='osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T20:00:33.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:32 smithi033 ceph-mon[42490]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T20:00:33.311 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:00:34.082 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T20:00:34.082 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T20:00:34.082 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:34.082 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:00:34.082 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:00:34.082 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T20:00:34.082 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.083 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.083 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:34.083 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:34.083 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.083 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:34.083 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:34.083 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:33 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T20:00:34.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T20:00:34.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:34.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:00:34.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:34.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:33 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 -- 172.21.15.82:0/1913658927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 msgr2=0x7f1418109510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:34.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 --2- 172.21.15.82:0/1913658927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f1418109510 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f141000b0a0 tx=0x7f141000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 -- 172.21.15.82:0/1913658927 shutdown_connections 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 --2- 172.21.15.82:0/1913658927 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f1418109510 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 --2- 172.21.15.82:0/1913658927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14180ff2e0 0x7f14180ff700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 --2- 172.21.15.82:0/1913658927 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14181022c0 0x7f1418102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 -- 172.21.15.82:0/1913658927 >> 172.21.15.82:0/1913658927 conn(0x7f14180fac40 msgr2=0x7f14180fd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 -- 172.21.15.82:0/1913658927 shutdown_connections 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.278+0000 7f141e39a700 1 -- 172.21.15.82:0/1913658927 wait complete. 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 Processor -- start 2024-05-08T20:00:34.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 -- start start 2024-05-08T20:00:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14180ff2e0 0x7f14181970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14181022c0 0x7f14181975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:34.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f141819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141819ebe0 con 0x7f14181022c0 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141819ed20 con 0x7f1418102c60 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141e39a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141819eeb0 con 0x7f14180ff2e0 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141c937700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f141819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141c937700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f141819e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43870/0 (socket says 172.21.15.82:43870) 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f141c937700 1 -- 172.21.15.82:0/3282991535 learned_addr learned my addr 172.21.15.82:0/3282991535 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.279+0000 7f14177fe700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14181022c0 0x7f14181975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f1417fff700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14180ff2e0 0x7f14181970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141c937700 1 -- 172.21.15.82:0/3282991535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14180ff2e0 msgr2=0x7f14181970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141c937700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14180ff2e0 0x7f14181970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141c937700 1 -- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14181022c0 msgr2=0x7f14181975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:34.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141c937700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14181022c0 0x7f14181975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141c937700 1 -- 172.21.15.82:0/3282991535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410009d00 con 0x7f1418102c60 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141c937700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f141819e610 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f141000bd60 tx=0x7f141000bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f14157fa700 1 -- 172.21.15.82:0/3282991535 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141000e040 con 0x7f1418102c60 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141819f130 con 0x7f1418102c60 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f14157fa700 1 -- 172.21.15.82:0/3282991535 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1410004c60 con 0x7f1418102c60 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141819f5f0 con 0x7f1418102c60 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.280+0000 7f14157fa700 1 -- 172.21.15.82:0/3282991535 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410005310 con 0x7f1418102c60 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.281+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14181083b0 con 0x7f1418102c60 2024-05-08T20:00:34.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.282+0000 7f14157fa700 1 -- 172.21.15.82:0/3282991535 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f141001d9e0 con 0x7f1418102c60 2024-05-08T20:00:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.283+0000 7f14157fa700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14040a1120 0x7f14040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.283+0000 7f14157fa700 1 -- 172.21.15.82:0/3282991535 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3389+0+0 (secure 0 0 0) 0x7f14100cc890 con 0x7f1418102c60 2024-05-08T20:00:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.283+0000 7f1417fff700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14040a1120 0x7f14040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:34.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.283+0000 7f1417fff700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14040a1120 0x7f14040a35e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1418069420 tx=0x7f1400009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:00:34.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.287+0000 7f14157fa700 1 -- 172.21.15.82:0/3282991535 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1410097350 con 0x7f1418102c60 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: osdmap e22: 4 total, 3 up, 4 in 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:33 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:34.489+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f141802ce10 con 0x7f14040a1120 2024-05-08T20:00:34.821 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:00:34 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-3[69600]: 2024-05-08T20:00:34.357+0000 7fd81a277700 -1 osd.3 0 waiting for initial osdmap 2024-05-08T20:00:34.821 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:00:34 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-3[69600]: 2024-05-08T20:00:34.363+0000 7fd811863700 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi033 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi033 to 8559M 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='osd.3 ' entity='osd.3' 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:35.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] boot 2024-05-08T20:00:35.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: osdmap e24: 4 total, 4 up, 4 in 2024-05-08T20:00:35.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi033 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi033 to 8559M 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='osd.3 ' entity='osd.3' 2024-05-08T20:00:35.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:35.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:35.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:35.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] boot 2024-05-08T20:00:35.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: osdmap e24: 4 total, 4 up, 4 in 2024-05-08T20:00:35.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi033 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi033 to 8559M 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='osd.3 ' entity='osd.3' 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: osd.3 [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] boot 2024-05-08T20:00:35.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: osdmap e24: 4 total, 4 up, 4 in 2024-05-08T20:00:35.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:00:36.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:35 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:00:36.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:35 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:00:36.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:35 smithi082 ceph-mon[46774]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:36.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:35 smithi082 ceph-mon[46774]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:36.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:35 smithi082 ceph-mon[46774]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T20:00:36.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:35 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:00:36.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:35 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:00:36.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:35 smithi132 ceph-mon[47484]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:36.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:35 smithi132 ceph-mon[47484]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:36.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:35 smithi132 ceph-mon[47484]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T20:00:36.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:35 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:00:36.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:35 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:00:36.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:35 smithi033 ceph-mon[42490]: from='client.24236 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:36.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:35 smithi033 ceph-mon[42490]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:36.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:35 smithi033 ceph-mon[42490]: osdmap e25: 4 total, 4 up, 4 in 2024-05-08T20:00:37.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:36 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/272538113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]: dispatch 2024-05-08T20:00:37.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:36 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]: dispatch 2024-05-08T20:00:37.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:36 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]': finished 2024-05-08T20:00:37.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:36 smithi082 ceph-mon[46774]: osdmap e26: 5 total, 4 up, 5 in 2024-05-08T20:00:37.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:36 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:37.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:36 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/272538113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]: dispatch 2024-05-08T20:00:37.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:36 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]: dispatch 2024-05-08T20:00:37.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:36 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]': finished 2024-05-08T20:00:37.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:36 smithi132 ceph-mon[47484]: osdmap e26: 5 total, 4 up, 5 in 2024-05-08T20:00:37.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:36 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:37.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:36 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/272538113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]: dispatch 2024-05-08T20:00:37.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:36 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]: dispatch 2024-05-08T20:00:37.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:36 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9922f2c4-b26d-42b1-94af-f8875d7b499b"}]': finished 2024-05-08T20:00:37.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:36 smithi033 ceph-mon[42490]: osdmap e26: 5 total, 4 up, 5 in 2024-05-08T20:00:37.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:36 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:38.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:37 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/2338063823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:38.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:37 smithi082 ceph-mon[46774]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:38.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:37 smithi082 ceph-mon[46774]: osdmap e27: 5 total, 4 up, 5 in 2024-05-08T20:00:38.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:38.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:37 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/2338063823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:38.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:37 smithi132 ceph-mon[47484]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:38.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:37 smithi132 ceph-mon[47484]: osdmap e27: 5 total, 4 up, 5 in 2024-05-08T20:00:38.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:38.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:37 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/2338063823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:38.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:37 smithi033 ceph-mon[42490]: pgmap v81: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:38.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:37 smithi033 ceph-mon[42490]: osdmap e27: 5 total, 4 up, 5 in 2024-05-08T20:00:38.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:39.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:39 smithi082 ceph-mon[46774]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T20:00:39.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:39 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:39.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:39 smithi132 ceph-mon[47484]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T20:00:39.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:39 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:39 smithi033 ceph-mon[42490]: osdmap e28: 5 total, 4 up, 5 in 2024-05-08T20:00:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:39 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:40.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:40 smithi082 ceph-mon[46774]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:40.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:40 smithi132 ceph-mon[47484]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:40 smithi033 ceph-mon[42490]: pgmap v84: 1 pgs: 1 remapped+peering; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:42.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:42 smithi082 ceph-mon[46774]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-05-08T20:00:42.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T20:00:42.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:42.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:42 smithi132 ceph-mon[47484]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-05-08T20:00:42.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T20:00:42.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:42.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:42 smithi033 ceph-mon[42490]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-05-08T20:00:42.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T20:00:42.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:43.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:43 smithi082 ceph-mon[46774]: Deploying daemon osd.4 on smithi082 2024-05-08T20:00:43.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:43 smithi132 ceph-mon[47484]: Deploying daemon osd.4 on smithi082 2024-05-08T20:00:43.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:43 smithi033 ceph-mon[42490]: Deploying daemon osd.4 on smithi082 2024-05-08T20:00:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:44 smithi082 ceph-mon[46774]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-08T20:00:44.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:44 smithi132 ceph-mon[47484]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-08T20:00:44.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:44 smithi033 ceph-mon[42490]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-05-08T20:00:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:46 smithi082 ceph-mon[46774]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:00:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:46 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:46 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:46 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:46 smithi132 ceph-mon[47484]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:00:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:46 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:46 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:46 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:46 smithi033 ceph-mon[42490]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:00:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:47.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.696+0000 7f14157fa700 1 -- 172.21.15.82:0/3282991535 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f141802ce10 con 0x7f14040a1120 2024-05-08T20:00:47.686 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 4 on host 'smithi082' 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14040a1120 msgr2=0x7f14040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14040a1120 0x7f14040a35e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1418069420 tx=0x7f1400009260 comp rx=0 tx=0).stop 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 msgr2=0x7f141819e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f141819e610 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f141000bd60 tx=0x7f141000bd90 comp rx=0 tx=0).stop 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 shutdown_connections 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1418102c60 0x7f141819e610 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14040a1120 0x7f14040a35e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14180ff2e0 0x7f14181970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:47.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 --2- 172.21.15.82:0/3282991535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14181022c0 0x7f14181975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:47.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 >> 172.21.15.82:0/3282991535 conn(0x7f14180fac40 msgr2=0x7f14181054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:00:47.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 shutdown_connections 2024-05-08T20:00:47.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:00:47.698+0000 7f141e39a700 1 -- 172.21.15.82:0/3282991535 wait complete. 2024-05-08T20:00:48.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:48.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:48.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-08T20:00:48.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:48.156 DEBUG:teuthology.orchestra.run.smithi082:osd.4> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.4.service 2024-05-08T20:00:48.159 INFO:tasks.cephadm:Deploying osd.5 on smithi132 with /dev/vg_nvme/lv_3... 2024-05-08T20:00:48.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T20:00:48.189 INFO:journalctl@ceph.osd.4.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:48.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:48.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:00:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:00:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T20:00:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T20:00:49.692 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2024-05-08T20:00:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2024-05-08T20:00:49.692 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0152964 s, 686 MB/s 2024-05-08T20:00:49.692 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2024-05-08T20:00:49.872 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:00:49 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4[60475]: 2024-05-08T20:00:49.542+0000 7f43a7f397c0 -1 osd.4 0 log_to_monitors true 2024-05-08T20:00:50.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_3 2024-05-08T20:00:50.197 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:50 smithi082 ceph-mon[46774]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-05-08T20:00:50.197 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:50 smithi082 ceph-mon[46774]: from='osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T20:00:50.197 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:50 smithi082 ceph-mon[46774]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T20:00:50.254 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:00:50.372 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:50 smithi132 ceph-mon[47484]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-05-08T20:00:50.372 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:50 smithi132 ceph-mon[47484]: from='osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T20:00:50.372 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:50 smithi132 ceph-mon[47484]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T20:00:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:50 smithi033 ceph-mon[42490]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-05-08T20:00:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:50 smithi033 ceph-mon[42490]: from='osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T20:00:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:50 smithi033 ceph-mon[42490]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T20:00:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 -- 172.21.15.132:0/308389720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 msgr2=0x7fab581014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 --2- 172.21.15.132:0/308389720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab581014e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fab54009990 tx=0x7fab54009ca0 comp rx=0 tx=0).stop 2024-05-08T20:00:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 -- 172.21.15.132:0/308389720 shutdown_connections 2024-05-08T20:00:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 --2- 172.21.15.132:0/308389720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab58101a20 0x7fab58108340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 --2- 172.21.15.132:0/308389720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab580fff00 0x7fab58100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 --2- 172.21.15.132:0/308389720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab581014e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 -- 172.21.15.132:0/308389720 >> 172.21.15.132:0/308389720 conn(0x7fab580fb4a0 msgr2=0x7fab580fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 -- 172.21.15.132:0/308389720 shutdown_connections 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.252+0000 7fab60351700 1 -- 172.21.15.132:0/308389720 wait complete. 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 Processor -- start 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 -- start start 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab580fff00 0x7fab58069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab5819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab58101a20 0x7fab5819e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819ea60 con 0x7fab58101a20 2024-05-08T20:00:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819ebd0 con 0x7fab580fff00 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab60351700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819ed90 con 0x7fab58101060 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab5d8ec700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab5819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab5d8ec700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab5819bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49196/0 (socket says 172.21.15.132:49196) 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab5d8ec700 1 -- 172.21.15.132:0/1974325384 learned_addr learned my addr 172.21.15.132:0/1974325384 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.253+0000 7fab5e0ed700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab580fff00 0x7fab58069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab5d8ec700 1 -- 172.21.15.132:0/1974325384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab580fff00 msgr2=0x7fab58069460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab5e8ee700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab58101a20 0x7fab5819e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab5d8ec700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab580fff00 0x7fab58069460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab5d8ec700 1 -- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab58101a20 msgr2=0x7fab5819e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab5d8ec700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab58101a20 0x7fab5819e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab5d8ec700 1 -- 172.21.15.132:0/1974325384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540095f0 con 0x7fab58101060 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab5d8ec700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab5819bcf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab5400b5c0 tx=0x7fab5400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:00:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab4f7fe700 1 -- 172.21.15.132:0/1974325384 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5401d070 con 0x7fab58101060 2024-05-08T20:00:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab4f7fe700 1 -- 172.21.15.132:0/1974325384 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fab54004cb0 con 0x7fab58101060 2024-05-08T20:00:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5819f010 con 0x7fab58101060 2024-05-08T20:00:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab4f7fe700 1 -- 172.21.15.132:0/1974325384 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54005470 con 0x7fab58101060 2024-05-08T20:00:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.254+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab5819f480 con 0x7fab58101060 2024-05-08T20:00:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.255+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab581072b0 con 0x7fab58101060 2024-05-08T20:00:51.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.256+0000 7fab4f7fe700 1 -- 172.21.15.132:0/1974325384 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fab540055d0 con 0x7fab58101060 2024-05-08T20:00:51.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.257+0000 7fab4f7fe700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fab440a1120 0x7fab440a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:00:51.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.257+0000 7fab4f7fe700 1 -- 172.21.15.132:0/1974325384 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3821+0+0 (secure 0 0 0) 0x7fab540ccb70 con 0x7fab58101060 2024-05-08T20:00:51.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.257+0000 7fab5e0ed700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fab440a1120 0x7fab440a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:00:51.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.258+0000 7fab5e0ed700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fab440a1120 0x7fab440a35e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab48005950 tx=0x7fab4800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:00:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.261+0000 7fab4f7fe700 1 -- 172.21.15.132:0/1974325384 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fab54097520 con 0x7fab58101060 2024-05-08T20:00:51.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T20:00:51.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T20:00:51.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:51.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:00:51.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi082 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi082 to 8556M 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:51.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:00:51.460+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fab580613e0 con 0x7fab440a1120 2024-05-08T20:00:51.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T20:00:51.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T20:00:51.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:51.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:00:51.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:00:51.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi082 2024-05-08T20:00:51.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi082 to 8556M 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:51.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi082 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.578 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:51.579 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:00:51.579 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi082 to 8556M 2024-05-08T20:00:51.579 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.579 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:51.579 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:00:51.579 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:00:51.871 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:00:51 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4[60475]: 2024-05-08T20:00:51.588+0000 7f439d59d700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T20:00:51.872 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:00:51 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4[60475]: 2024-05-08T20:00:51.594+0000 7f439538a700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:00:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:00:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T20:00:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:52.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:52.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:52.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:52 smithi132 ceph-mon[47484]: from='osd.4 ' entity='osd.4' 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:52 smithi033 ceph-mon[42490]: from='osd.4 ' entity='osd.4' 2024-05-08T20:00:52.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:52 smithi082 ceph-mon[46774]: from='osd.4 ' entity='osd.4' 2024-05-08T20:00:53.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:53 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:00:53.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:53 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:00:53.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:53 smithi033 ceph-mon[42490]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:53.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:53.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:53 smithi033 ceph-mon[42490]: osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] boot 2024-05-08T20:00:53.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:53 smithi033 ceph-mon[42490]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T20:00:53.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:53.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:53 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:00:53.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:53 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:00:53.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:53 smithi082 ceph-mon[46774]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:53.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:53 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:53.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:53 smithi082 ceph-mon[46774]: osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] boot 2024-05-08T20:00:53.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:53 smithi082 ceph-mon[46774]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T20:00:53.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:53 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:53.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:53 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:00:53.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:53 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:00:53.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:53 smithi132 ceph-mon[47484]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:00:53.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:53 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:53.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:53 smithi132 ceph-mon[47484]: osd.4 [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] boot 2024-05-08T20:00:53.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:53 smithi132 ceph-mon[47484]: osdmap e31: 5 total, 5 up, 5 in 2024-05-08T20:00:53.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:53 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:00:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:54 smithi033 ceph-mon[42490]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:54 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/3930470404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]: dispatch 2024-05-08T20:00:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:54 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]: dispatch 2024-05-08T20:00:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:54 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]': finished 2024-05-08T20:00:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:54 smithi033 ceph-mon[42490]: osdmap e32: 6 total, 5 up, 6 in 2024-05-08T20:00:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:00:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:54 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/746976664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:54.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:54 smithi082 ceph-mon[46774]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:54 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/3930470404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]: dispatch 2024-05-08T20:00:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:54 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]: dispatch 2024-05-08T20:00:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:54 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]': finished 2024-05-08T20:00:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:54 smithi082 ceph-mon[46774]: osdmap e32: 6 total, 5 up, 6 in 2024-05-08T20:00:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:00:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:54 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/746976664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:54 smithi132 ceph-mon[47484]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 115 MiB used, 357 GiB / 358 GiB avail 2024-05-08T20:00:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:54 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/3930470404' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]: dispatch 2024-05-08T20:00:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:54 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]: dispatch 2024-05-08T20:00:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:54 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f86a281b-beaa-426a-b519-f1585214fb67"}]': finished 2024-05-08T20:00:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:54 smithi132 ceph-mon[47484]: osdmap e32: 6 total, 5 up, 6 in 2024-05-08T20:00:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:00:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:54 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/746976664' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:00:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:55 smithi033 ceph-mon[42490]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T20:00:55.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:00:55.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:55 smithi082 ceph-mon[46774]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T20:00:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:00:55.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:55 smithi132 ceph-mon[47484]: osdmap e33: 6 total, 5 up, 6 in 2024-05-08T20:00:55.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:00:56.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:56 smithi033 ceph-mon[42490]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:00:56.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:56 smithi082 ceph-mon[46774]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:00:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:56 smithi132 ceph-mon[47484]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:00:58.462 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:58 smithi132 ceph-mon[47484]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:00:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:58 smithi033 ceph-mon[42490]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:00:58.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:58 smithi082 ceph-mon[46774]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:00:59.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T20:00:59.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:00:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:59.601 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T20:00:59.601 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:00:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:00:59.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T20:00:59.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:00:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:00 smithi033 ceph-mon[42490]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:00.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:00 smithi033 ceph-mon[42490]: Deploying daemon osd.5 on smithi132 2024-05-08T20:01:00.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:00 smithi082 ceph-mon[46774]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:00 smithi082 ceph-mon[46774]: Deploying daemon osd.5 on smithi132 2024-05-08T20:01:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:00 smithi132 ceph-mon[47484]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:00 smithi132 ceph-mon[47484]: Deploying daemon osd.5 on smithi132 2024-05-08T20:01:02.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:02 smithi033 ceph-mon[42490]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:02.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:02 smithi082 ceph-mon[46774]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:02.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:02 smithi132 ceph-mon[47484]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:04.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:04.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:04.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:04.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:03 smithi132 ceph-mon[47484]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:04.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:04.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:04.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:04.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:03 smithi033 ceph-mon[42490]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:04.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:04.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:04.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:04.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:03 smithi082 ceph-mon[46774]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:05.256 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.267+0000 7fab4f7fe700 1 -- 172.21.15.132:0/1974325384 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fab580613e0 con 0x7fab440a1120 2024-05-08T20:01:05.257 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 5 on host 'smithi132' 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fab440a1120 msgr2=0x7fab440a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fab440a1120 0x7fab440a35e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab48005950 tx=0x7fab4800b410 comp rx=0 tx=0).stop 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 msgr2=0x7fab5819bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab5819bcf0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab5400b5c0 tx=0x7fab5400f690 comp rx=0 tx=0).stop 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 shutdown_connections 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fab58101a20 0x7fab5819e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fab580fff00 0x7fab58069460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fab440a1120 0x7fab440a35e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 --2- 172.21.15.132:0/1974325384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab58101060 0x7fab5819bcf0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:05.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 >> 172.21.15.132:0/1974325384 conn(0x7fab580fb4a0 msgr2=0x7fab581043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:01:05.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 shutdown_connections 2024-05-08T20:01:05.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:05.270+0000 7fab60351700 1 -- 172.21.15.132:0/1974325384 wait complete. 2024-05-08T20:01:05.667 DEBUG:teuthology.orchestra.run.smithi132:osd.5> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.5.service 2024-05-08T20:01:05.671 INFO:tasks.cephadm:Deploying osd.6 on smithi033 with /dev/vg_nvme/lv_2... 2024-05-08T20:01:05.671 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T20:01:05.702 INFO:journalctl@ceph.osd.5.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:01:05.759 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.760 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:05 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:05 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:05 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:05.925 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:01:07.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:07 smithi033 ceph-mon[42490]: from='osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T20:01:07.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:07 smithi033 ceph-mon[42490]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T20:01:07.327 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:07 smithi132 ceph-mon[47484]: from='osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T20:01:07.327 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:07 smithi132 ceph-mon[47484]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T20:01:07.327 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:01:06 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:01:06.965+0000 7f07ff3217c0 -1 osd.5 0 log_to_monitors true 2024-05-08T20:01:07.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:07 smithi082 ceph-mon[46774]: from='osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T20:01:07.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:07 smithi082 ceph-mon[46774]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T20:01:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T20:01:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T20:01:07.445 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-05-08T20:01:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-05-08T20:01:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120558 s, 870 MB/s 2024-05-08T20:01:07.445 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-05-08T20:01:07.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2024-05-08T20:01:08.211 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:08.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:08.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:08.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T20:01:08.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T20:01:08.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:08.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:01:08.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:01:08.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:08.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.374 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:01:08 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:01:08.034+0000 7f07f4985700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T20:01:08.374 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:01:08 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:01:08.041+0000 7f07f077a700 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:01:08.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T20:01:08.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 145 MiB used, 447 GiB / 447 GiB avail 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:08.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:08.376 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:08.376 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:08.376 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:09.282 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi132 2024-05-08T20:01:09.282 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi132 to 8557M 2024-05-08T20:01:09.282 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:01:09.282 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T20:01:09.282 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:09.283 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] boot 2024-05-08T20:01:09.283 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T20:01:09.283 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi132 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi132 to 8557M 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] boot 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T20:01:09.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi132 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi132 to 8557M 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: osd.5 [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] boot 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: osdmap e36: 6 total, 6 up, 6 in 2024-05-08T20:01:09.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:01:09.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.473+0000 7f8500679700 1 -- 172.21.15.33:0/260773345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f81043c0 msgr2=0x7f84f81067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.473+0000 7f8500679700 1 --2- 172.21.15.33:0/260773345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f81043c0 0x7f84f81067b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84f4009990 tx=0x7f84f4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 -- 172.21.15.33:0/260773345 shutdown_connections 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 --2- 172.21.15.33:0/260773345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f8106cf0 0x7f84f8109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 --2- 172.21.15.33:0/260773345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84f8101a90 0x7f84f8103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 --2- 172.21.15.33:0/260773345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f81043c0 0x7f84f81067b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 -- 172.21.15.33:0/260773345 >> 172.21.15.33:0/260773345 conn(0x7f84f80fb4a0 msgr2=0x7f84f80fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 -- 172.21.15.33:0/260773345 shutdown_connections 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 -- 172.21.15.33:0/260773345 wait complete. 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 Processor -- start 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.474+0000 7f8500679700 1 -- start start 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f8500679700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f8101a90 0x7f84f81013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:09.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f8500679700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84f81043c0 0x7f84f80ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f8500679700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f8106cf0 0x7f84f80fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f8500679700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8100720 con 0x7f84f8101a90 2024-05-08T20:01:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f8500679700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f8100890 con 0x7f84f81043c0 2024-05-08T20:01:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f8500679700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f81a1050 con 0x7f84f8106cf0 2024-05-08T20:01:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f8101a90 0x7f84f81013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f8101a90 0x7f84f81013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34608/0 (socket says 172.21.15.33:34608) 2024-05-08T20:01:09.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 -- 172.21.15.33:0/1171951347 learned_addr learned my addr 172.21.15.33:0/1171951347 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fdc14700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84f81043c0 0x7f84f80ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fec16700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f8106cf0 0x7f84f80fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 -- 172.21.15.33:0/1171951347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f8106cf0 msgr2=0x7f84f80fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f8106cf0 0x7f84f80fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 -- 172.21.15.33:0/1171951347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84f81043c0 msgr2=0x7f84f80ffa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84f81043c0 0x7f84f80ffa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 -- 172.21.15.33:0/1171951347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f40095f0 con 0x7f84f8101a90 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84fe415700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f8101a90 0x7f84f81013a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00d980 tx=0x7f84ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:01:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84eb7fe700 1 -- 172.21.15.33:0/1171951347 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec004220 con 0x7f84f8101a90 2024-05-08T20:01:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f84eb7fe700 1 -- 172.21.15.33:0/1171951347 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f84ec007640 con 0x7f84f8101a90 2024-05-08T20:01:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.475+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f81a12e0 con 0x7f84f8101a90 2024-05-08T20:01:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.476+0000 7f84eb7fe700 1 -- 172.21.15.33:0/1171951347 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec00f690 con 0x7f84f8101a90 2024-05-08T20:01:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.476+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f81a17e0 con 0x7f84f8101a90 2024-05-08T20:01:09.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.476+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f80fd020 con 0x7f84f8101a90 2024-05-08T20:01:09.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.478+0000 7f84eb7fe700 1 -- 172.21.15.33:0/1171951347 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f84ec004410 con 0x7f84f8101a90 2024-05-08T20:01:09.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.478+0000 7f84eb7fe700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84e40a1120 0x7f84e40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:09.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.478+0000 7f84fdc14700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84e40a1120 0x7f84e40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:09.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.479+0000 7f84eb7fe700 1 -- 172.21.15.33:0/1171951347 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4566+0+0 (secure 0 0 0) 0x7f84ec0cbdc0 con 0x7f84f8101a90 2024-05-08T20:01:09.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.479+0000 7f84fdc14700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84e40a1120 0x7f84e40a35e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f84f400b2e0 tx=0x7f84f4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:01:09.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.482+0000 7f84eb7fe700 1 -- 172.21.15.33:0/1171951347 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f84ec0963f0 con 0x7f84f8101a90 2024-05-08T20:01:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:09.704+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f84f80613e0 con 0x7f84e40a1120 2024-05-08T20:01:10.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:10 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:01:10.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:10 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:01:10.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:10 smithi033 ceph-mon[42490]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:10.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:10 smithi033 ceph-mon[42490]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T20:01:10.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:10 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:10.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:10 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:10.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:10 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:10.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:10 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:01:10.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:10 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:01:10.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:10 smithi082 ceph-mon[46774]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:10.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:10 smithi082 ceph-mon[46774]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T20:01:10.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:10 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:10.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:10 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:10.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:10 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:10.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:10 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:01:10.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:10 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:01:10.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:10 smithi132 ceph-mon[47484]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:10.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:10 smithi132 ceph-mon[47484]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T20:01:10.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:10 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:10.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:10 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:10.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:10 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:11.070 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:11 smithi033 ceph-mon[42490]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:11.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:11 smithi033 ceph-mon[42490]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T20:01:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:11 smithi082 ceph-mon[46774]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:11.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:11 smithi082 ceph-mon[46774]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T20:01:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:11 smithi132 ceph-mon[47484]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:11.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:11 smithi132 ceph-mon[47484]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T20:01:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:12 smithi033 ceph-mon[42490]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:12 smithi033 ceph-mon[42490]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T20:01:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:12 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3602237613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87f5ea9e-6467-4b4e-8aa4-8769b53650ac"}]: dispatch 2024-05-08T20:01:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:12 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3602237613' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87f5ea9e-6467-4b4e-8aa4-8769b53650ac"}]': finished 2024-05-08T20:01:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:12 smithi033 ceph-mon[42490]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T20:01:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:12 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:12.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:12 smithi082 ceph-mon[46774]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:12 smithi082 ceph-mon[46774]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T20:01:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:12 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3602237613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87f5ea9e-6467-4b4e-8aa4-8769b53650ac"}]: dispatch 2024-05-08T20:01:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:12 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3602237613' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87f5ea9e-6467-4b4e-8aa4-8769b53650ac"}]': finished 2024-05-08T20:01:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:12 smithi082 ceph-mon[46774]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T20:01:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:12 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:12 smithi132 ceph-mon[47484]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:12 smithi132 ceph-mon[47484]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T20:01:12.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:12 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3602237613' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87f5ea9e-6467-4b4e-8aa4-8769b53650ac"}]: dispatch 2024-05-08T20:01:12.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:12 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3602237613' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87f5ea9e-6467-4b4e-8aa4-8769b53650ac"}]': finished 2024-05-08T20:01:12.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:12 smithi132 ceph-mon[47484]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T20:01:12.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:12 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:13.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:13 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/470615145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:13.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:13 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/470615145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:13.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:13 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/470615145' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:14.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:14 smithi033 ceph-mon[42490]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:14.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:14 smithi082 ceph-mon[46774]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:14.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:14 smithi132 ceph-mon[47484]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 172 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:16.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:16 smithi033 ceph-mon[42490]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:16 smithi082 ceph-mon[46774]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:16 smithi132 ceph-mon[47484]: pgmap v114: 1 pgs: 1 remapped+peering; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:18.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:18 smithi033 ceph-mon[42490]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-05-08T20:01:18.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T20:01:18.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:18.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:18 smithi082 ceph-mon[46774]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-05-08T20:01:18.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T20:01:18.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:18 smithi132 ceph-mon[47484]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-05-08T20:01:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T20:01:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:19.426 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:19 smithi033 ceph-mon[42490]: Deploying daemon osd.6 on smithi033 2024-05-08T20:01:19.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:19 smithi082 ceph-mon[46774]: Deploying daemon osd.6 on smithi033 2024-05-08T20:01:19.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:19 smithi132 ceph-mon[47484]: Deploying daemon osd.6 on smithi033 2024-05-08T20:01:20.414 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:20 smithi033 ceph-mon[42490]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:01:20.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:20 smithi082 ceph-mon[46774]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:01:20.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:20 smithi132 ceph-mon[47484]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:01:22.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:22 smithi033 ceph-mon[42490]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T20:01:22.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:22.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:22.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:22.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:22 smithi082 ceph-mon[46774]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T20:01:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:22.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:22 smithi132 ceph-mon[47484]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T20:01:22.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:22.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:22.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:23.941 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 6 on host 'smithi033' 2024-05-08T20:01:23.941 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.950+0000 7f84eb7fe700 1 -- 172.21.15.33:0/1171951347 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f84f80613e0 con 0x7f84e40a1120 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84e40a1120 msgr2=0x7f84e40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84e40a1120 0x7f84e40a35e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f84f400b2e0 tx=0x7f84f4005fd0 comp rx=0 tx=0).stop 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f8101a90 msgr2=0x7f84f81013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f8101a90 0x7f84f81013a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00d980 tx=0x7f84ec00dc90 comp rx=0 tx=0).stop 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 shutdown_connections 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84e40a1120 0x7f84e40a35e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f8106cf0 0x7f84f80fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84f8101a90 0x7f84f81013a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 --2- 172.21.15.33:0/1171951347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84f81043c0 0x7f84f80ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 >> 172.21.15.33:0/1171951347 conn(0x7f84f80fb4a0 msgr2=0x7f84f8102550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 shutdown_connections 2024-05-08T20:01:23.943 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:01:23.953+0000 7f8500679700 1 -- 172.21.15.33:0/1171951347 wait complete. 2024-05-08T20:01:24.354 DEBUG:teuthology.orchestra.run.smithi033:osd.6> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.6.service 2024-05-08T20:01:24.356 INFO:tasks.cephadm:Deploying osd.7 on smithi082 with /dev/vg_nvme/lv_2... 2024-05-08T20:01:24.356 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T20:01:24.394 INFO:journalctl@ceph.osd.6.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:24.588 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:01:24.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T20:01:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T20:01:25.844 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T20:01:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T20:01:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154734 s, 678 MB/s 2024-05-08T20:01:25.844 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T20:01:26.072 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:01:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:01:25.648+0000 7f3e99f377c0 -1 osd.6 0 log_to_monitors true 2024-05-08T20:01:26.272 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-05-08T20:01:26.491 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:01:26.594 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:26 smithi082 ceph-mon[46774]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T20:01:26.594 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:26 smithi082 ceph-mon[46774]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T20:01:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:26 smithi132 ceph-mon[47484]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T20:01:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:26 smithi132 ceph-mon[47484]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T20:01:26.628 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:26 smithi033 ceph-mon[42490]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-05-08T20:01:26.628 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:26 smithi033 ceph-mon[42490]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 -- 172.21.15.82:0/3041712672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100150 msgr2=0x7fb61c1005d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 --2- 172.21.15.82:0/3041712672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100150 0x7fb61c1005d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009990 tx=0x7fb60c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 -- 172.21.15.82:0/3041712672 shutdown_connections 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 --2- 172.21.15.82:0/3041712672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61c100b10 0x7fb61c1083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 --2- 172.21.15.82:0/3041712672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c101580 0x7fb61c1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 --2- 172.21.15.82:0/3041712672 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100150 0x7fb61c1005d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 -- 172.21.15.82:0/3041712672 >> 172.21.15.82:0/3041712672 conn(0x7fb61c0fac40 msgr2=0x7fb61c0fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 -- 172.21.15.82:0/3041712672 shutdown_connections 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 -- 172.21.15.82:0/3041712672 wait complete. 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 Processor -- start 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.473+0000 7fb623c96700 1 -- start start 2024-05-08T20:01:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb623c96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c100150 0x7fb61c103ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb623c96700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100b10 0x7fb61c102540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb623c96700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61c101580 0x7fb61c102a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb623c96700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c103220 con 0x7fb61c100150 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb623c96700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c103390 con 0x7fb61c100b10 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb623c96700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61c1a10d0 con 0x7fb61c101580 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100b10 0x7fb61c102540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100b10 0x7fb61c102540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38034/0 (socket says 172.21.15.82:38034) 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 -- 172.21.15.82:0/2710206336 learned_addr learned my addr 172.21.15.82:0/2710206336 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621a32700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c100150 0x7fb61c103ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb622233700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61c101580 0x7fb61c102a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 -- 172.21.15.82:0/2710206336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61c101580 msgr2=0x7fb61c102a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61c101580 0x7fb61c102a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:27.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 -- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c100150 msgr2=0x7fb61c103ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c100150 0x7fb61c103ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 -- 172.21.15.82:0/2710206336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0095f0 con 0x7fb61c100b10 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb621231700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100b10 0x7fb61c102540 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00b5c0 tx=0x7fb60c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb612ffd700 1 -- 172.21.15.82:0/2710206336 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c01d070 con 0x7fb61c100b10 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61c1a1300 con 0x7fb61c100b10 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb612ffd700 1 -- 172.21.15.82:0/2710206336 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb60c022470 con 0x7fb61c100b10 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.474+0000 7fb612ffd700 1 -- 172.21.15.82:0/2710206336 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c017650 con 0x7fb61c100b10 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.475+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61c1a1770 con 0x7fb61c100b10 2024-05-08T20:01:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.475+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61c04ec60 con 0x7fb61c100b10 2024-05-08T20:01:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.476+0000 7fb612ffd700 1 -- 172.21.15.82:0/2710206336 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb60c0225e0 con 0x7fb61c100b10 2024-05-08T20:01:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.477+0000 7fb612ffd700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6080a1120 0x7fb6080a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.477+0000 7fb612ffd700 1 -- 172.21.15.82:0/2710206336 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4685+0+0 (secure 0 0 0) 0x7fb60c0cd570 con 0x7fb61c100b10 2024-05-08T20:01:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.477+0000 7fb621a32700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6080a1120 0x7fb6080a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:27.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.478+0000 7fb621a32700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6080a1120 0x7fb6080a35e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb618009a10 tx=0x7fb618009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:01:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.481+0000 7fb612ffd700 1 -- 172.21.15.82:0/2710206336 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb60c097ba0 con 0x7fb61c100b10 2024-05-08T20:01:27.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T20:01:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T20:01:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:01:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:27.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:27.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:27.681+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb61c0fcdf0 con 0x7fb6080a1120 2024-05-08T20:01:27.821 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:01:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:01:27.380+0000 7f3e8f59b700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T20:01:27.821 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:01:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:01:27.393+0000 7f3e8b390700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:01:27.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T20:01:27.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T20:01:27.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:27.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:01:27.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:28.668 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi033 2024-05-08T20:01:28.668 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi033 to 5706M 2024-05-08T20:01:28.668 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:28.668 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:01:28.668 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T20:01:28.669 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:28.669 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:28.669 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:28.669 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:28.669 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:28.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi033 2024-05-08T20:01:28.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi033 to 5706M 2024-05-08T20:01:28.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:28.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:01:28.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T20:01:28.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:28.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:28.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:28.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:28.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:28.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi033 2024-05-08T20:01:28.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi033 to 5706M 2024-05-08T20:01:28.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:28.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: from='osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:01:28.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T20:01:28.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:28.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:28.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:28.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:28.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:29 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:01:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:29 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:01:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:29 smithi033 ceph-mon[42490]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:29 smithi033 ceph-mon[42490]: osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] boot 2024-05-08T20:01:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:29 smithi033 ceph-mon[42490]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T20:01:29.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:29 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:01:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:29 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:01:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:29 smithi082 ceph-mon[46774]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:29 smithi082 ceph-mon[46774]: osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] boot 2024-05-08T20:01:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:29 smithi082 ceph-mon[46774]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T20:01:29.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:29 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:01:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:29 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:01:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:29 smithi132 ceph-mon[47484]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:29 smithi132 ceph-mon[47484]: osd.6 [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] boot 2024-05-08T20:01:29.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:29 smithi132 ceph-mon[47484]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T20:01:29.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:01:30.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:30.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T20:01:30.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/434379687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]: dispatch 2024-05-08T20:01:30.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]: dispatch 2024-05-08T20:01:30.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]': finished 2024-05-08T20:01:30.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T20:01:30.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:30.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:30 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/3637430088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:30.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:30.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T20:01:30.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/434379687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]: dispatch 2024-05-08T20:01:30.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]: dispatch 2024-05-08T20:01:30.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]': finished 2024-05-08T20:01:30.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T20:01:30.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:30.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:30 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/3637430088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:30.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 173 MiB used, 536 GiB / 536 GiB avail 2024-05-08T20:01:30.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T20:01:30.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/434379687' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]: dispatch 2024-05-08T20:01:30.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]: dispatch 2024-05-08T20:01:30.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6700de25-138d-4cb4-bd2c-6935b873816a"}]': finished 2024-05-08T20:01:30.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T20:01:30.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:30.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:30 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/3637430088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:32.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:32 smithi033 ceph-mon[42490]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:32.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:32 smithi082 ceph-mon[46774]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:32.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:32 smithi132 ceph-mon[47484]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:34.509 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:34 smithi082 ceph-mon[46774]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:34 smithi033 ceph-mon[42490]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:34.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:34 smithi132 ceph-mon[47484]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:35.651 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:35 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T20:01:35.651 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:35 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:35.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:35 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T20:01:35.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:35 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:35.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:35 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T20:01:35.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:35 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:36 smithi082 ceph-mon[46774]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:36 smithi082 ceph-mon[46774]: Deploying daemon osd.7 on smithi082 2024-05-08T20:01:36.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:36 smithi033 ceph-mon[42490]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:36.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:36 smithi033 ceph-mon[42490]: Deploying daemon osd.7 on smithi082 2024-05-08T20:01:36.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:36 smithi132 ceph-mon[47484]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:36.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:36 smithi132 ceph-mon[47484]: Deploying daemon osd.7 on smithi082 2024-05-08T20:01:37.469 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:37 smithi082 ceph-mon[46774]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:37 smithi033 ceph-mon[42490]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:37.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:37 smithi132 ceph-mon[47484]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:40.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:39 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:40.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:39 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:40.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:39 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:40.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:39 smithi082 ceph-mon[46774]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:39 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:39 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:39 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:39 smithi033 ceph-mon[42490]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:39 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:39 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:39 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:39 smithi132 ceph-mon[47484]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:41.276 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 7 on host 'smithi082' 2024-05-08T20:01:41.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.285+0000 7fb612ffd700 1 -- 172.21.15.82:0/2710206336 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb61c0fcdf0 con 0x7fb6080a1120 2024-05-08T20:01:41.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6080a1120 msgr2=0x7fb6080a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6080a1120 0x7fb6080a35e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb618009a10 tx=0x7fb618009190 comp rx=0 tx=0).stop 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100b10 msgr2=0x7fb61c102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100b10 0x7fb61c102540 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00b5c0 tx=0x7fb60c00f690 comp rx=0 tx=0).stop 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 shutdown_connections 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6080a1120 0x7fb6080a35e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb61c101580 0x7fb61c102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61c100150 0x7fb61c103ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 --2- 172.21.15.82:0/2710206336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb61c100b10 0x7fb61c102540 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 >> 172.21.15.82:0/2710206336 conn(0x7fb61c0fac40 msgr2=0x7fb61c0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 shutdown_connections 2024-05-08T20:01:41.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:01:41.288+0000 7fb623c96700 1 -- 172.21.15.82:0/2710206336 wait complete. 2024-05-08T20:01:41.287 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.287 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.287 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:41.287 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:41.287 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.288 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.288 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.288 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:41.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:41.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:41.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:41.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:41.680 DEBUG:teuthology.orchestra.run.smithi082:osd.7> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.7.service 2024-05-08T20:01:41.682 INFO:tasks.cephadm:Deploying osd.8 on smithi132 with /dev/vg_nvme/lv_2... 2024-05-08T20:01:41.682 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T20:01:41.726 INFO:journalctl@ceph.osd.7.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T20:01:41.927 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:01:42.516 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:42 smithi082 ceph-mon[46774]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:42.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:42 smithi033 ceph-mon[42490]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:42.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:42 smithi132 ceph-mon[47484]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:43.213 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T20:01:43.213 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T20:01:43.213 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2024-05-08T20:01:43.213 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2024-05-08T20:01:43.213 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0162962 s, 643 MB/s 2024-05-08T20:01:43.214 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2024-05-08T20:01:43.315 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:01:42 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:01:42.914+0000 7fc9767477c0 -1 osd.7 0 log_to_monitors true 2024-05-08T20:01:43.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:43 smithi132 ceph-mon[47484]: from='osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T20:01:43.549 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:43 smithi132 ceph-mon[47484]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T20:01:43.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:43 smithi033 ceph-mon[42490]: from='osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T20:01:43.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:43 smithi033 ceph-mon[42490]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T20:01:43.576 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_2 2024-05-08T20:01:43.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:43 smithi082 ceph-mon[46774]: from='osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T20:01:43.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:43 smithi082 ceph-mon[46774]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T20:01:43.798 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:01:44.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:44.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T20:01:44.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T20:01:44.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:44.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:01:44.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:01:44.555 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:44.556 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:44 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:44.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:44.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:44 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.622 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:01:44 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:01:44.334+0000 7fc96bdab700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T20:01:44.622 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:01:44 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:01:44.343+0000 7fc967ba0700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:01:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:44 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 -- 172.21.15.132:0/1811502011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101a20 msgr2=0x7f84c0108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/1811502011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101a20 0x7f84c0108340 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f84b800b0a0 tx=0x7f84b800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 -- 172.21.15.132:0/1811502011 shutdown_connections 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/1811502011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101a20 0x7f84c0108340 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/1811502011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84c00fff00 0x7f84c0100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/1811502011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c0101060 0x7f84c01014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 -- 172.21.15.132:0/1811502011 >> 172.21.15.132:0/1811502011 conn(0x7f84c00fb4a0 msgr2=0x7f84c00fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 -- 172.21.15.132:0/1811502011 shutdown_connections 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.745+0000 7f84c6bb5700 1 -- 172.21.15.132:0/1811502011 wait complete. 2024-05-08T20:01:44.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 Processor -- start 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 -- start start 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84c00fff00 0x7f84c0069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101060 0x7f84c019bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c0101a20 0x7f84c019e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c019e950 con 0x7f84c0101a20 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c019eac0 con 0x7f84c00fff00 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c6bb5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c019ec80 con 0x7f84c0101060 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101060 0x7f84c019bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101060 0x7f84c019bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41814/0 (socket says 172.21.15.132:41814) 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 -- 172.21.15.132:0/311328643 learned_addr learned my addr 172.21.15.132:0/311328643 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c4951700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84c00fff00 0x7f84c0069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c5152700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c0101a20 0x7f84c019e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:44.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 -- 172.21.15.132:0/311328643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84c00fff00 msgr2=0x7f84c0069480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84c00fff00 0x7f84c0069480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 -- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c0101a20 msgr2=0x7f84c019e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c0101a20 0x7f84c019e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 -- 172.21.15.132:0/311328643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8009d00 con 0x7f84c0101060 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c5152700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c0101a20 0x7f84c019e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84c4951700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84c00fff00 0x7f84c0069480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.746+0000 7f84bffff700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101060 0x7f84c019bbc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00d980 tx=0x7f84ac00dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.747+0000 7f84bdffb700 1 -- 172.21.15.132:0/311328643 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00bb60 con 0x7f84c0101060 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.747+0000 7f84bdffb700 1 -- 172.21.15.132:0/311328643 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f84ac007640 con 0x7f84c0101060 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.747+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c019ef60 con 0x7f84c0101060 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.747+0000 7f84bdffb700 1 -- 172.21.15.132:0/311328643 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac005020 con 0x7f84c0101060 2024-05-08T20:01:44.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.747+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c019f3d0 con 0x7f84c0101060 2024-05-08T20:01:44.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.748+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c01072b0 con 0x7f84c0101060 2024-05-08T20:01:44.739 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.749+0000 7f84bdffb700 1 -- 172.21.15.132:0/311328643 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f84ac004020 con 0x7f84c0101060 2024-05-08T20:01:44.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.749+0000 7f84bdffb700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84b00a1120 0x7f84b00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:01:44.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.749+0000 7f84bdffb700 1 -- 172.21.15.132:0/311328643 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5117+0+0 (secure 0 0 0) 0x7f84ac0cbad0 con 0x7f84c0101060 2024-05-08T20:01:44.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.750+0000 7f84c4951700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84b00a1120 0x7f84b00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:01:44.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.750+0000 7f84c4951700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84b00a1120 0x7f84b00a35e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009be0 tx=0x7f84b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:01:44.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.754+0000 7f84bdffb700 1 -- 172.21.15.132:0/311328643 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f84ac095ee0 con 0x7f84c0101060 2024-05-08T20:01:44.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:44.952+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f84c002ceb0 con 0x7f84b00a1120 2024-05-08T20:01:45.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi082 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi082 to 5704M 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:45.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:45 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi082 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi082 to 5704M 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:45.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:45 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:45.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi082 2024-05-08T20:01:45.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi082 to 5704M 2024-05-08T20:01:45.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:01:45.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T20:01:45.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:45.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:45.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:01:45.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:01:45.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:45 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:46.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:46 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:01:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:46 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:01:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:46 smithi082 ceph-mon[46774]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:46 smithi082 ceph-mon[46774]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:46 smithi082 ceph-mon[46774]: osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] boot 2024-05-08T20:01:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:46 smithi082 ceph-mon[46774]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T20:01:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:46 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:46 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:01:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:46 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:01:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:46 smithi132 ceph-mon[47484]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:46 smithi132 ceph-mon[47484]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:46 smithi132 ceph-mon[47484]: osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] boot 2024-05-08T20:01:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:46 smithi132 ceph-mon[47484]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T20:01:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:46 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:46 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:01:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:46 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:01:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:46 smithi033 ceph-mon[42490]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:01:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:46 smithi033 ceph-mon[42490]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T20:01:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:46 smithi033 ceph-mon[42490]: osd.7 [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] boot 2024-05-08T20:01:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:46 smithi033 ceph-mon[42490]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T20:01:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:01:47.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:47 smithi082 ceph-mon[46774]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T20:01:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:47 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/2573588688' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]: dispatch 2024-05-08T20:01:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:47 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]: dispatch 2024-05-08T20:01:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:47 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]': finished 2024-05-08T20:01:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:47 smithi082 ceph-mon[46774]: osdmap e50: 9 total, 8 up, 9 in 2024-05-08T20:01:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:47 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:47 smithi132 ceph-mon[47484]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T20:01:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:47 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/2573588688' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]: dispatch 2024-05-08T20:01:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:47 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]: dispatch 2024-05-08T20:01:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:47 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]': finished 2024-05-08T20:01:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:47 smithi132 ceph-mon[47484]: osdmap e50: 9 total, 8 up, 9 in 2024-05-08T20:01:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:47 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:47.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:47 smithi033 ceph-mon[42490]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T20:01:47.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:47 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/2573588688' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]: dispatch 2024-05-08T20:01:47.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:47 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]: dispatch 2024-05-08T20:01:47.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:47 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "af5ad8e0-189d-4f89-a802-a3cd2efd0428"}]': finished 2024-05-08T20:01:47.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:47 smithi033 ceph-mon[42490]: osdmap e50: 9 total, 8 up, 9 in 2024-05-08T20:01:47.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:47 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:48.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:48 smithi082 ceph-mon[46774]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:48 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/522108593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:48 smithi082 ceph-mon[46774]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T20:01:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:48 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:48 smithi132 ceph-mon[47484]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:48 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/522108593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:48 smithi132 ceph-mon[47484]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T20:01:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:48 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:48.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:48 smithi033 ceph-mon[42490]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:48.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:48 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/522108593' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:01:48.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:48 smithi033 ceph-mon[42490]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T20:01:48.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:48 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:50.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:49 smithi033 ceph-mon[42490]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T20:01:50.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:49 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:50.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:49 smithi033 ceph-mon[42490]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:50.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:49 smithi082 ceph-mon[46774]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T20:01:50.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:49 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:50.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:49 smithi082 ceph-mon[46774]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:50.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:49 smithi132 ceph-mon[47484]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T20:01:50.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:49 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:01:50.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:49 smithi132 ceph-mon[47484]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:52.412 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:52 smithi132 ceph-mon[47484]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:52 smithi033 ceph-mon[42490]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:52.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:52 smithi082 ceph-mon[46774]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:53.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:53 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T20:01:53.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:53 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:53.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T20:01:53.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:53 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:53.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:53 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T20:01:53.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:53 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:54 smithi132 ceph-mon[47484]: Deploying daemon osd.8 on smithi132 2024-05-08T20:01:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:54 smithi132 ceph-mon[47484]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:54 smithi033 ceph-mon[42490]: Deploying daemon osd.8 on smithi132 2024-05-08T20:01:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:54 smithi033 ceph-mon[42490]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:54.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:54 smithi082 ceph-mon[46774]: Deploying daemon osd.8 on smithi132 2024-05-08T20:01:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:54 smithi082 ceph-mon[46774]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:56.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:56 smithi033 ceph-mon[42490]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:56.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:56 smithi082 ceph-mon[46774]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:56 smithi132 ceph-mon[47484]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:57.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:57 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:57.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:57 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:57.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:57 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:57 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:57 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:57 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:57 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:57 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:57 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:58.431 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:58 smithi132 ceph-mon[47484]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:58.431 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.431 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.431 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:58.431 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:58.431 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:58 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:58 smithi033 ceph-mon[42490]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:58.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:58 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.604+0000 7f84bdffb700 1 -- 172.21.15.132:0/311328643 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f84c002ceb0 con 0x7f84b00a1120 2024-05-08T20:01:58.594 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 8 on host 'smithi132' 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84b00a1120 msgr2=0x7f84b00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84b00a1120 0x7f84b00a35e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009be0 tx=0x7f84b4009260 comp rx=0 tx=0).stop 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101060 msgr2=0x7f84c019bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101060 0x7f84c019bbc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00d980 tx=0x7f84ac00dd40 comp rx=0 tx=0).stop 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 shutdown_connections 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c0101a20 0x7f84c019e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f84c00fff00 0x7f84c0069480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84b00a1120 0x7f84b00a35e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 --2- 172.21.15.132:0/311328643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84c0101060 0x7f84c019bbc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 >> 172.21.15.132:0/311328643 conn(0x7f84c00fb4a0 msgr2=0x7f84c01043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:01:58.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 shutdown_connections 2024-05-08T20:01:58.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:01:58.607+0000 7f84c6bb5700 1 -- 172.21.15.132:0/311328643 wait complete. 2024-05-08T20:01:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:58 smithi082 ceph-mon[46774]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:01:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:01:58.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:58 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:58.954 DEBUG:teuthology.orchestra.run.smithi132:osd.8> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.8.service 2024-05-08T20:01:58.957 INFO:tasks.cephadm:Deploying osd.9 on smithi033 with /dev/vg_nvme/lv_1... 2024-05-08T20:01:58.957 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T20:01:58.987 INFO:journalctl@ceph.osd.8.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:01:59.241 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:01:59.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:59.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:59.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:59 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:59.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:01:59 smithi132 ceph-mon[47484]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:59.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:59.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:59.684 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:59 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:59.685 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:01:59 smithi033 ceph-mon[42490]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:01:59.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:59.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:01:59.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:59 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:01:59.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:01:59 smithi082 ceph-mon[46774]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:02:00.622 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:00 smithi132 ceph-mon[47484]: from='osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T20:02:00.622 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:00 smithi132 ceph-mon[47484]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T20:02:00.623 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:02:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:02:00.312+0000 7f40f70047c0 -1 osd.8 0 log_to_monitors true 2024-05-08T20:02:00.711 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T20:02:00.712 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T20:02:00.712 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2024-05-08T20:02:00.712 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2024-05-08T20:02:00.712 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0119431 s, 878 MB/s 2024-05-08T20:02:00.712 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2024-05-08T20:02:00.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:00 smithi033 ceph-mon[42490]: from='osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T20:02:00.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:00 smithi033 ceph-mon[42490]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T20:02:00.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:00 smithi082 ceph-mon[46774]: from='osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T20:02:00.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:00 smithi082 ceph-mon[46774]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T20:02:01.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi033:vg_nvme/lv_1 2024-05-08T20:02:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:02:01.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T20:02:01.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T20:02:01.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:01.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:01.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:01.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi132 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi132 to 5704M 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:01.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:01 smithi033 ceph-mon[42490]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi132 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi132 to 5704M 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:01 smithi082 ceph-mon[46774]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi132 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:01.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi132 to 5704M 2024-05-08T20:02:01.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:01.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:01.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:01.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:01 smithi132 ceph-mon[47484]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:02:02.374 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:02:02 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:02:02.053+0000 7f40ec668700 -1 osd.8 0 waiting for initial osdmap 2024-05-08T20:02:02.374 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:02:02 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:02:02.065+0000 7f40e4455700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:02:02.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 -- 172.21.15.33:0/3474505779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270101af0 msgr2=0x7f5270103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:02.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 --2- 172.21.15.33:0/3474505779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270101af0 0x7f5270103ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5260009990 tx=0x7f5260009ca0 comp rx=0 tx=0).stop 2024-05-08T20:02:02.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 -- 172.21.15.33:0/3474505779 shutdown_connections 2024-05-08T20:02:02.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 --2- 172.21.15.33:0/3474505779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5270106d50 0x7f5270109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:02.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 --2- 172.21.15.33:0/3474505779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270101af0 0x7f5270103ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:02.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 --2- 172.21.15.33:0/3474505779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5270104420 0x7f5270106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:02.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 -- 172.21.15.33:0/3474505779 >> 172.21.15.33:0/3474505779 conn(0x7f52700fb4a0 msgr2=0x7f52700fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:02.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.444+0000 7f5274eb2700 1 -- 172.21.15.33:0/3474505779 shutdown_connections 2024-05-08T20:02:02.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.445+0000 7f5274eb2700 1 -- 172.21.15.33:0/3474505779 wait complete. 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.445+0000 7f5274eb2700 1 Processor -- start 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f5274eb2700 1 -- start start 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f5274eb2700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5270101af0 0x7f52701992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f5274eb2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5270104420 0x7f52701997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f5274eb2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270106d50 0x7f52701a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f5274eb2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701a0df0 con 0x7f5270106d50 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f5274eb2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701a0f30 con 0x7f5270104420 2024-05-08T20:02:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f5274eb2700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701a10c0 con 0x7f5270101af0 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270106d50 0x7f52701a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270106d50 0x7f52701a0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56248/0 (socket says 172.21.15.33:56248) 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 -- 172.21.15.33:0/2787737364 learned_addr learned my addr 172.21.15.33:0/2787737364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526e59c700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5270101af0 0x7f52701992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526dd9b700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5270104420 0x7f52701997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 -- 172.21.15.33:0/2787737364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5270101af0 msgr2=0x7f52701992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5270101af0 0x7f52701992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 -- 172.21.15.33:0/2787737364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5270104420 msgr2=0x7f52701997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5270104420 0x7f52701997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 -- 172.21.15.33:0/2787737364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52600095f0 con 0x7f5270106d50 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.446+0000 7f526ed9d700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270106d50 0x7f52701a0820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5268007ef0 tx=0x7f526800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.447+0000 7f525f7fe700 1 -- 172.21.15.33:0/2787737364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268017070 con 0x7f5270106d50 2024-05-08T20:02:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.447+0000 7f525f7fe700 1 -- 172.21.15.33:0/2787737364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f526800f040 con 0x7f5270106d50 2024-05-08T20:02:02.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.447+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52701a13a0 con 0x7f5270106d50 2024-05-08T20:02:02.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.447+0000 7f525f7fe700 1 -- 172.21.15.33:0/2787737364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5268004280 con 0x7f5270106d50 2024-05-08T20:02:02.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.447+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52701a18f0 con 0x7f5270106d50 2024-05-08T20:02:02.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.448+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52701088d0 con 0x7f5270106d50 2024-05-08T20:02:02.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.449+0000 7f525f7fe700 1 -- 172.21.15.33:0/2787737364 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f5268003a00 con 0x7f5270106d50 2024-05-08T20:02:02.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.450+0000 7f525f7fe700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f52580a11a0 0x7f52580a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:02.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.450+0000 7f526e59c700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f52580a11a0 0x7f52580a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:02.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.450+0000 7f525f7fe700 1 -- 172.21.15.33:0/2787737364 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5549+0+0 (secure 0 0 0) 0x7f52680cb970 con 0x7f5270106d50 2024-05-08T20:02:02.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.450+0000 7f526e59c700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f52580a11a0 0x7f52580a3660 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f526000b5c0 tx=0x7f5260005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:02.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.454+0000 7f525f7fe700 1 -- 172.21.15.33:0/2787737364 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f52680996f0 con 0x7f5270106d50 2024-05-08T20:02:02.672 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:02.682+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f52700613e0 con 0x7f52580a11a0 2024-05-08T20:02:02.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:02 smithi082 ceph-mon[46774]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:02:02.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:02 smithi082 ceph-mon[46774]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T20:02:02.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:02 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:02.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:02 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:02.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:02 smithi082 ceph-mon[46774]: from='osd.8 ' entity='osd.8' 2024-05-08T20:02:02.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:02 smithi132 ceph-mon[47484]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:02:02.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:02 smithi132 ceph-mon[47484]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T20:02:02.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:02 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:02.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:02 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:02.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:02 smithi132 ceph-mon[47484]: from='osd.8 ' entity='osd.8' 2024-05-08T20:02:03.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:02 smithi033 ceph-mon[42490]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:02:03.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:02 smithi033 ceph-mon[42490]: osdmap e54: 9 total, 8 up, 9 in 2024-05-08T20:02:03.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:02 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:03.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:02 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:03.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:02 smithi033 ceph-mon[42490]: from='osd.8 ' entity='osd.8' 2024-05-08T20:02:03.695 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] boot 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:03.696 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:03 smithi033 ceph-mon[42490]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:02:03.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] boot 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:03.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:03 smithi082 ceph-mon[46774]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: osd.8 [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] boot 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:03.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:03 smithi132 ceph-mon[47484]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T20:02:04.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:04 smithi082 ceph-mon[46774]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T20:02:04.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:04 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1031162996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3c11e7d-ffde-4056-81df-8f6816c9c085"}]: dispatch 2024-05-08T20:02:04.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:04 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1031162996' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3c11e7d-ffde-4056-81df-8f6816c9c085"}]': finished 2024-05-08T20:02:04.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:04 smithi082 ceph-mon[46774]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T20:02:04.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:04.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:04 smithi132 ceph-mon[47484]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T20:02:04.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:04 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1031162996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3c11e7d-ffde-4056-81df-8f6816c9c085"}]: dispatch 2024-05-08T20:02:04.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:04 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1031162996' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3c11e7d-ffde-4056-81df-8f6816c9c085"}]': finished 2024-05-08T20:02:04.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:04 smithi132 ceph-mon[47484]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T20:02:04.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:05.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:04 smithi033 ceph-mon[42490]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T20:02:05.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:04 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1031162996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b3c11e7d-ffde-4056-81df-8f6816c9c085"}]: dispatch 2024-05-08T20:02:05.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:04 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1031162996' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b3c11e7d-ffde-4056-81df-8f6816c9c085"}]': finished 2024-05-08T20:02:05.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:04 smithi033 ceph-mon[42490]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T20:02:05.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:05 smithi082 ceph-mon[46774]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:05.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/253412587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:05.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:05 smithi132 ceph-mon[47484]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:05.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:05 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/253412587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:06.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:05 smithi033 ceph-mon[42490]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:06.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:05 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/253412587' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:06.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:06 smithi082 ceph-mon[46774]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T20:02:06.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:06 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:06.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:06 smithi132 ceph-mon[47484]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T20:02:06.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:06 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:07.070 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:06 smithi033 ceph-mon[42490]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T20:02:07.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:06 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:07.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:07 smithi082 ceph-mon[46774]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T20:02:07.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:07 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:07.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:07 smithi082 ceph-mon[46774]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T20:02:07.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:07 smithi132 ceph-mon[47484]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T20:02:07.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:07 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:07.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:07 smithi132 ceph-mon[47484]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T20:02:08.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:07 smithi033 ceph-mon[42490]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T20:02:08.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:07 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:08.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:07 smithi033 ceph-mon[42490]: pgmap v159: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 258 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T20:02:10.421 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:10 smithi033 ceph-mon[42490]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-08T20:02:10.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:10 smithi082 ceph-mon[46774]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-08T20:02:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:10 smithi132 ceph-mon[47484]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-08T20:02:11.291 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T20:02:11.291 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:11.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T20:02:11.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:11.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T20:02:11.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:12.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:12 smithi033 ceph-mon[42490]: Deploying daemon osd.9 on smithi033 2024-05-08T20:02:12.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:12 smithi033 ceph-mon[42490]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-05-08T20:02:12.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:12 smithi082 ceph-mon[46774]: Deploying daemon osd.9 on smithi033 2024-05-08T20:02:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:12 smithi082 ceph-mon[46774]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-05-08T20:02:12.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:12 smithi132 ceph-mon[47484]: Deploying daemon osd.9 on smithi033 2024-05-08T20:02:12.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:12 smithi132 ceph-mon[47484]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-05-08T20:02:14.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:14 smithi033 ceph-mon[42490]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:02:14.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:14 smithi082 ceph-mon[46774]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:02:14.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:14 smithi132 ceph-mon[47484]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T20:02:15.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:15.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:15.450 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:15.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:16 smithi033 ceph-mon[42490]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:16.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:16.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:16.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:16 smithi082 ceph-mon[46774]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:16 smithi132 ceph-mon[47484]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:16.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:16.823 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 9 on host 'smithi033' 2024-05-08T20:02:16.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.833+0000 7f525f7fe700 1 -- 172.21.15.33:0/2787737364 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f52700613e0 con 0x7f52580a11a0 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f52580a11a0 msgr2=0x7f52580a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f52580a11a0 0x7f52580a3660 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f526000b5c0 tx=0x7f5260005fb0 comp rx=0 tx=0).stop 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270106d50 msgr2=0x7f52701a0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270106d50 0x7f52701a0820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5268007ef0 tx=0x7f526800d3b0 comp rx=0 tx=0).stop 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 shutdown_connections 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5270106d50 0x7f52701a0820 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f52580a11a0 0x7f52580a3660 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5270101af0 0x7f52701992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:16.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 --2- 172.21.15.33:0/2787737364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5270104420 0x7f52701997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 >> 172.21.15.33:0/2787737364 conn(0x7f52700fb4a0 msgr2=0x7f52701012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 shutdown_connections 2024-05-08T20:02:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:16.836+0000 7f5274eb2700 1 -- 172.21.15.33:0/2787737364 wait complete. 2024-05-08T20:02:17.200 DEBUG:teuthology.orchestra.run.smithi033:osd.9> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.9.service 2024-05-08T20:02:17.203 INFO:tasks.cephadm:Deploying osd.10 on smithi082 with /dev/vg_nvme/lv_1... 2024-05-08T20:02:17.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T20:02:17.241 INFO:journalctl@ceph.osd.9.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T20:02:17.434 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:02:17.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:17.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:17.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:17 smithi082 ceph-mon[46774]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:17.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:17.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:17.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:17.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:17 smithi033 ceph-mon[42490]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:18.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:18.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:18.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:18.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:17 smithi132 ceph-mon[47484]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:18.761 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T20:02:18.762 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T20:02:18.762 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T20:02:18.762 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T20:02:18.762 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116409 s, 901 MB/s 2024-05-08T20:02:18.762 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T20:02:18.785 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:02:18 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:02:18.439+0000 7f724464d7c0 -1 osd.9 0 log_to_monitors true 2024-05-08T20:02:19.059 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:18 smithi082 ceph-mon[46774]: from='osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T20:02:19.060 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:18 smithi082 ceph-mon[46774]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T20:02:19.070 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:18 smithi033 ceph-mon[42490]: from='osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T20:02:19.070 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:18 smithi033 ceph-mon[42490]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T20:02:19.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:18 smithi132 ceph-mon[47484]: from='osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T20:02:19.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:18 smithi132 ceph-mon[47484]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T20:02:19.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-05-08T20:02:19.382 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:02:20.071 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:02:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:02:19.816+0000 7f7239cb1700 -1 osd.9 0 waiting for initial osdmap 2024-05-08T20:02:20.072 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:02:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:02:19.834+0000 7f7235aa6700 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:20.073 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T20:02:20.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T20:02:20.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:20.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:02:20.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:02:20.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:20.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:20.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:20.124 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T20:02:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: osdmap e60: 10 total, 9 up, 10 in 2024-05-08T20:02:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:02:20.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.126 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:20.127 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:20.129 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 -- 172.21.15.82:0/1991623242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec102ba0 msgr2=0x7f65ec109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 --2- 172.21.15.82:0/1991623242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec102ba0 0x7f65ec109450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65e400b0d0 tx=0x7f65e400b3e0 comp rx=0 tx=0).stop 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 -- 172.21.15.82:0/1991623242 shutdown_connections 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 --2- 172.21.15.82:0/1991623242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec102ba0 0x7f65ec109450 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 --2- 172.21.15.82:0/1991623242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65ec101000 0x7f65ec101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 --2- 172.21.15.82:0/1991623242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 0x7f65ec102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 -- 172.21.15.82:0/1991623242 >> 172.21.15.82:0/1991623242 conn(0x7f65ec0fc5c0 msgr2=0x7f65ec0fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:20.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 -- 172.21.15.82:0/1991623242 shutdown_connections 2024-05-08T20:02:20.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.371+0000 7f65f2db6700 1 -- 172.21.15.82:0/1991623242 wait complete. 2024-05-08T20:02:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 Processor -- start 2024-05-08T20:02:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 -- start start 2024-05-08T20:02:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec101000 0x7f65ec197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 0x7f65ec197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65ec102ba0 0x7f65ec19e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec19ec10 con 0x7f65ec102ba0 2024-05-08T20:02:20.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec19ed50 con 0x7f65ec101000 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f2db6700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec19eee0 con 0x7f65ec102200 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 0x7f65ec197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 0x7f65ec197660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.82:33444/0 (socket says 172.21.15.82:33444) 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65ebfff700 1 -- 172.21.15.82:0/2423321051 learned_addr learned my addr 172.21.15.82:0/2423321051 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f1353700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65ec102ba0 0x7f65ec19e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.372+0000 7f65f0b52700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec101000 0x7f65ec197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65ebfff700 1 -- 172.21.15.82:0/2423321051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec101000 msgr2=0x7f65ec197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:20.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65ebfff700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec101000 0x7f65ec197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65ebfff700 1 -- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65ec102ba0 msgr2=0x7f65ec19e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65ebfff700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65ec102ba0 0x7f65ec19e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65ebfff700 1 -- 172.21.15.82:0/2423321051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e4009d00 con 0x7f65ec102200 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65ebfff700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 0x7f65ec197660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65d800d9b0 tx=0x7f65d800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65e9ffb700 1 -- 172.21.15.82:0/2423321051 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8004220 con 0x7f65ec102200 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec19f1c0 con 0x7f65ec102200 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65e9ffb700 1 -- 172.21.15.82:0/2423321051 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f65d8007640 con 0x7f65ec102200 2024-05-08T20:02:20.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65e9ffb700 1 -- 172.21.15.82:0/2423321051 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8005650 con 0x7f65ec102200 2024-05-08T20:02:20.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.373+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec19f710 con 0x7f65ec102200 2024-05-08T20:02:20.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.374+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec1083c0 con 0x7f65ec102200 2024-05-08T20:02:20.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.375+0000 7f65e9ffb700 1 -- 172.21.15.82:0/2423321051 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f65d8004750 con 0x7f65ec102200 2024-05-08T20:02:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.376+0000 7f65e9ffb700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f65dc0a1120 0x7f65dc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.376+0000 7f65e9ffb700 1 -- 172.21.15.82:0/2423321051 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5981+0+0 (secure 0 0 0) 0x7f65d80cc330 con 0x7f65ec102200 2024-05-08T20:02:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.376+0000 7f65f0b52700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f65dc0a1120 0x7f65dc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:20.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.377+0000 7f65f0b52700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f65dc0a1120 0x7f65dc0a35e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65ec102060 tx=0x7f65e000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:20.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.380+0000 7f65e9ffb700 1 -- 172.21.15.82:0/2423321051 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f65d8096340 con 0x7f65ec102200 2024-05-08T20:02:20.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:20.580+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f65ec0613e0 con 0x7f65dc0a1120 2024-05-08T20:02:21.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi033 2024-05-08T20:02:21.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi033 to 4279M 2024-05-08T20:02:21.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:02:21.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T20:02:21.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:21.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:21.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:21.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:21.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi033 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi033 to 4279M 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:21.098 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:21.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi033 2024-05-08T20:02:21.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi033 to 4279M 2024-05-08T20:02:21.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2024-05-08T20:02:21.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: osdmap e61: 10 total, 9 up, 10 in 2024-05-08T20:02:21.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:21.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:21.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:21.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:21.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:22.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:21 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:02:22.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:21 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:02:22.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:21 smithi033 ceph-mon[42490]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:22.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:21 smithi033 ceph-mon[42490]: osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] boot 2024-05-08T20:02:22.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:21 smithi033 ceph-mon[42490]: osdmap e62: 10 total, 10 up, 10 in 2024-05-08T20:02:22.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:22.072 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:21 smithi033 ceph-mon[42490]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:22.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:21 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:02:22.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:21 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:02:22.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:21 smithi082 ceph-mon[46774]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:22.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:21 smithi082 ceph-mon[46774]: osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] boot 2024-05-08T20:02:22.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:21 smithi082 ceph-mon[46774]: osdmap e62: 10 total, 10 up, 10 in 2024-05-08T20:02:22.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:22.123 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:21 smithi082 ceph-mon[46774]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:22.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:21 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:02:22.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:21 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:02:22.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:21 smithi132 ceph-mon[47484]: from='client.24370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:22.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:21 smithi132 ceph-mon[47484]: osd.9 [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] boot 2024-05-08T20:02:22.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:21 smithi132 ceph-mon[47484]: osdmap e62: 10 total, 10 up, 10 in 2024-05-08T20:02:22.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:02:22.125 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:21 smithi132 ceph-mon[47484]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-05-08T20:02:23.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:22 smithi033 ceph-mon[42490]: osdmap e63: 10 total, 10 up, 10 in 2024-05-08T20:02:23.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:22 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/1745047982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]: dispatch 2024-05-08T20:02:23.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:22 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]: dispatch 2024-05-08T20:02:23.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:22 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]': finished 2024-05-08T20:02:23.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:22 smithi033 ceph-mon[42490]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T20:02:23.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:23.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:22 smithi082 ceph-mon[46774]: osdmap e63: 10 total, 10 up, 10 in 2024-05-08T20:02:23.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:22 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/1745047982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]: dispatch 2024-05-08T20:02:23.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:22 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]: dispatch 2024-05-08T20:02:23.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:22 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]': finished 2024-05-08T20:02:23.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:22 smithi082 ceph-mon[46774]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T20:02:23.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:23.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:22 smithi132 ceph-mon[47484]: osdmap e63: 10 total, 10 up, 10 in 2024-05-08T20:02:23.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:22 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/1745047982' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]: dispatch 2024-05-08T20:02:23.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:22 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]: dispatch 2024-05-08T20:02:23.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:22 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "39c38ffb-6a12-406e-a8ec-c0e2b3b51204"}]': finished 2024-05-08T20:02:23.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:22 smithi132 ceph-mon[47484]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T20:02:23.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:24.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:23 smithi033 ceph-mon[42490]: from='client.? 172.21.15.82:0/3612933756' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:24.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:23 smithi033 ceph-mon[42490]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:24.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:23 smithi082 ceph-mon[46774]: from='client.? 172.21.15.82:0/3612933756' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:24.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:23 smithi082 ceph-mon[46774]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:24.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:23 smithi132 ceph-mon[47484]: from='client.? 172.21.15.82:0/3612933756' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:24.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:23 smithi132 ceph-mon[47484]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:26.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:26 smithi082 ceph-mon[46774]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:26 smithi033 ceph-mon[42490]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:26 smithi132 ceph-mon[47484]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:28.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:28 smithi082 ceph-mon[46774]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:28.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:28 smithi033 ceph-mon[42490]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:28 smithi132 ceph-mon[47484]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:29.328 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T20:02:29.328 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:29.328 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:29 smithi082 ceph-mon[46774]: Deploying daemon osd.10 on smithi082 2024-05-08T20:02:29.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T20:02:29.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:29.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:29 smithi033 ceph-mon[42490]: Deploying daemon osd.10 on smithi082 2024-05-08T20:02:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T20:02:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:29 smithi132 ceph-mon[47484]: Deploying daemon osd.10 on smithi082 2024-05-08T20:02:30.304 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:30 smithi082 ceph-mon[46774]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:30.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:30 smithi033 ceph-mon[42490]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:30.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:30 smithi132 ceph-mon[47484]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:32.416 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:32 smithi082 ceph-mon[46774]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:32.416 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:32 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:32.416 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:32 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:32.416 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:32 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:32.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:32 smithi033 ceph-mon[42490]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:32.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:32 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:32.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:32 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:32.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:32 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:32 smithi132 ceph-mon[47484]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:32 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:32 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:32 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:33.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.983+0000 7f65e9ffb700 1 -- 172.21.15.82:0/2423321051 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f65ec0613e0 con 0x7f65dc0a1120 2024-05-08T20:02:33.973 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 10 on host 'smithi082' 2024-05-08T20:02:33.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f65dc0a1120 msgr2=0x7f65dc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f65dc0a1120 0x7f65dc0a35e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f65ec102060 tx=0x7f65e000a380 comp rx=0 tx=0).stop 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 msgr2=0x7f65ec197660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 0x7f65ec197660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f65d800d9b0 tx=0x7f65d800dcc0 comp rx=0 tx=0).stop 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 shutdown_connections 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65ec102ba0 0x7f65ec19e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f65ec101000 0x7f65ec197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f65dc0a1120 0x7f65dc0a35e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 --2- 172.21.15.82:0/2423321051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65ec102200 0x7f65ec197660 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 >> 172.21.15.82:0/2423321051 conn(0x7f65ec0fc5c0 msgr2=0x7f65ec105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 shutdown_connections 2024-05-08T20:02:33.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T20:02:33.985+0000 7f65f2db6700 1 -- 172.21.15.82:0/2423321051 wait complete. 2024-05-08T20:02:34.355 DEBUG:teuthology.orchestra.run.smithi082:osd.10> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.10.service 2024-05-08T20:02:34.357 INFO:tasks.cephadm:Deploying osd.11 on smithi132 with /dev/vg_nvme/lv_1... 2024-05-08T20:02:34.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T20:02:34.388 INFO:journalctl@ceph.osd.10.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T20:02:34.443 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:34.443 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.443 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.443 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:34.443 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:34.444 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.444 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.444 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.444 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:34 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:34.588 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:02:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:34 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:34.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:34 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:35.975 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T20:02:35.975 INFO:teuthology.orchestra.run.smithi132.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T20:02:35.975 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10+0 records in 2024-05-08T20:02:35.975 INFO:teuthology.orchestra.run.smithi132.stderr:10+0 records out 2024-05-08T20:02:35.975 INFO:teuthology.orchestra.run.smithi132.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0184029 s, 570 MB/s 2024-05-08T20:02:35.975 INFO:teuthology.orchestra.run.smithi132.stderr:--> Zapping successful for: 2024-05-08T20:02:36.121 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:02:35 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:02:35.854+0000 7f151e3627c0 -1 osd.10 0 log_to_monitors true 2024-05-08T20:02:36.376 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi132:vg_nvme/lv_1 2024-05-08T20:02:36.598 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:02:36.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:36 smithi082 ceph-mon[46774]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:36 smithi082 ceph-mon[46774]: from='osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T20:02:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:36 smithi082 ceph-mon[46774]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T20:02:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:36 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:36 smithi132 ceph-mon[47484]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:36 smithi132 ceph-mon[47484]: from='osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T20:02:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:36 smithi132 ceph-mon[47484]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T20:02:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:36 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:36.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:36 smithi033 ceph-mon[42490]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:36.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:36 smithi033 ceph-mon[42490]: from='osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T20:02:36.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:36 smithi033 ceph-mon[42490]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T20:02:36.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:36 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 -- 172.21.15.132:0/2977521083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13781021e0 msgr2=0x7f1378102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:37.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 --2- 172.21.15.132:0/2977521083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13781021e0 0x7f1378102640 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1368009990 tx=0x7f1368009ca0 comp rx=0 tx=0).stop 2024-05-08T20:02:37.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 -- 172.21.15.132:0/2977521083 shutdown_connections 2024-05-08T20:02:37.636 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 --2- 172.21.15.132:0/2977521083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1378102b80 0x7f1378109430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 --2- 172.21.15.132:0/2977521083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1378100fe0 0x7f1378101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 --2- 172.21.15.132:0/2977521083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13781021e0 0x7f1378102640 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 -- 172.21.15.132:0/2977521083 >> 172.21.15.132:0/2977521083 conn(0x7f13780fc5a0 msgr2=0x7f13780fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 -- 172.21.15.132:0/2977521083 shutdown_connections 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 -- 172.21.15.132:0/2977521083 wait complete. 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.644+0000 7f137d38d700 1 Processor -- start 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f137d38d700 1 -- start start 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f137d38d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1378100fe0 0x7f1378199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f137d38d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13781021e0 0x7f13781997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f137d38d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1378102b80 0x7f13781a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f137d38d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13781a0d80 con 0x7f13781021e0 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f137d38d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13781a0ec0 con 0x7f1378100fe0 2024-05-08T20:02:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f137d38d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13781a1050 con 0x7f1378102b80 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1378102b80 0x7f13781a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1378102b80 0x7f13781a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36544/0 (socket says 172.21.15.132:36544) 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 -- 172.21.15.132:0/3761336146 learned_addr learned my addr 172.21.15.132:0/3761336146 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f1376ffd700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1378100fe0 0x7f1378199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13767fc700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13781021e0 0x7f13781997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 -- 172.21.15.132:0/3761336146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1378100fe0 msgr2=0x7f1378199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1378100fe0 0x7f1378199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 -- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13781021e0 msgr2=0x7f13781997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13781021e0 0x7f13781997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 -- 172.21.15.132:0/3761336146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680095f0 con 0x7f1378102b80 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13767fc700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13781021e0 0x7f13781997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f13777fe700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1378102b80 0x7f13781a07b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f137000add0 tx=0x7f137000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:37.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.645+0000 7f135ffff700 1 -- 172.21.15.132:0/3761336146 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137000f070 con 0x7f1378102b80 2024-05-08T20:02:37.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.646+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13781a1330 con 0x7f1378102b80 2024-05-08T20:02:37.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.646+0000 7f135ffff700 1 -- 172.21.15.132:0/3761336146 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1370007b30 con 0x7f1378102b80 2024-05-08T20:02:37.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.646+0000 7f135ffff700 1 -- 172.21.15.132:0/3761336146 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700053e0 con 0x7f1378102b80 2024-05-08T20:02:37.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.646+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13781a1830 con 0x7f1378102b80 2024-05-08T20:02:37.639 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.647+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137804ec60 con 0x7f1378102b80 2024-05-08T20:02:37.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.647+0000 7f135ffff700 1 -- 172.21.15.132:0/3761336146 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1370005580 con 0x7f1378102b80 2024-05-08T20:02:37.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.648+0000 7f135ffff700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f13600a1120 0x7f13600a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:37.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.648+0000 7f135ffff700 1 -- 172.21.15.132:0/3761336146 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f13700cb7f0 con 0x7f1378102b80 2024-05-08T20:02:37.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.649+0000 7f1376ffd700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f13600a1120 0x7f13600a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:37.640 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.649+0000 7f1376ffd700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f13600a1120 0x7f13600a35e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1378102040 tx=0x7f136c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:37.642 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.653+0000 7f135ffff700 1 -- 172.21.15.132:0/3761336146 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1370095780 con 0x7f1378102b80 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi082 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:02:37.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi082 to 4278M 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:37.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:37 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:37.852+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f13780748f0 con 0x7f13600a1120 2024-05-08T20:02:37.853 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi082 2024-05-08T20:02:37.853 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T20:02:37.853 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T20:02:37.853 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.853 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:37.853 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:02:37.853 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi082 to 4278M 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:37.854 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:37 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi082 2024-05-08T20:02:37.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T20:02:37.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T20:02:37.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:37.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:02:37.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T20:02:37.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:37.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi082 to 4278M 2024-05-08T20:02:37.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:37.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:37.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:37.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:37 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:38.121 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:02:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:02:37.863+0000 7f15139c6700 -1 osd.10 0 waiting for initial osdmap 2024-05-08T20:02:38.122 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:02:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:02:37.876+0000 7f150b7b3700 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:02:38.512 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:38.512 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: osdmap e66: 11 total, 10 up, 11 in 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='osd.10 ' entity='osd.10' 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] boot 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T20:02:38.513 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:38 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:38.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:02:38.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: osdmap e66: 11 total, 10 up, 11 in 2024-05-08T20:02:38.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:38.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:38.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:38.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='osd.10 ' entity='osd.10' 2024-05-08T20:02:38.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] boot 2024-05-08T20:02:38.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T20:02:38.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:38 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-05-08T20:02:38.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T20:02:38.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: osdmap e66: 11 total, 10 up, 11 in 2024-05-08T20:02:38.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:38.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T20:02:38.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T20:02:38.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:38.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='osd.10 ' entity='osd.10' 2024-05-08T20:02:38.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: osd.10 [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] boot 2024-05-08T20:02:38.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T20:02:38.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:38 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:02:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:39 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:02:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:39 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:02:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:39 smithi033 ceph-mon[42490]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:39 smithi033 ceph-mon[42490]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T20:02:39.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:39 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:02:39.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:39 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:02:39.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:39 smithi082 ceph-mon[46774]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:39.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:39 smithi082 ceph-mon[46774]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T20:02:39.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:39 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:02:39.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:39 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:02:39.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:39 smithi132 ceph-mon[47484]: from='client.24394 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi132:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:02:39.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:39 smithi132 ceph-mon[47484]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: osdmap e69: 11 total, 11 up, 11 in 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/4111148199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]: dispatch 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]: dispatch 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]': finished 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:40 smithi033 ceph-mon[42490]: from='client.? 172.21.15.132:0/4262084420' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:40.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: osdmap e69: 11 total, 11 up, 11 in 2024-05-08T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/4111148199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]: dispatch 2024-05-08T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]: dispatch 2024-05-08T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]': finished 2024-05-08T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:40.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:40 smithi082 ceph-mon[46774]: from='client.? 172.21.15.132:0/4262084420' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:40.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:40.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: osdmap e69: 11 total, 11 up, 11 in 2024-05-08T20:02:40.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/4111148199' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]: dispatch 2024-05-08T20:02:40.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]: dispatch 2024-05-08T20:02:40.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c"}]': finished 2024-05-08T20:02:40.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T20:02:40.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:40.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:40 smithi132 ceph-mon[47484]: from='client.? 172.21.15.132:0/4262084420' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T20:02:42.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:41 smithi033 ceph-mon[42490]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T20:02:42.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:41 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:42.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:41 smithi033 ceph-mon[42490]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail; 213 KiB/s, 0 objects/s recovering 2024-05-08T20:02:42.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:41 smithi082 ceph-mon[46774]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T20:02:42.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:41 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:42.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:41 smithi082 ceph-mon[46774]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail; 213 KiB/s, 0 objects/s recovering 2024-05-08T20:02:42.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:41 smithi132 ceph-mon[47484]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T20:02:42.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:41 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:42.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:41 smithi132 ceph-mon[47484]: pgmap v188: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail; 213 KiB/s, 0 objects/s recovering 2024-05-08T20:02:43.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:42 smithi033 ceph-mon[42490]: osdmap e72: 12 total, 11 up, 12 in 2024-05-08T20:02:43.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:42 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:43.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:42 smithi082 ceph-mon[46774]: osdmap e72: 12 total, 11 up, 12 in 2024-05-08T20:02:43.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:42 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:43.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:42 smithi132 ceph-mon[47484]: osdmap e72: 12 total, 11 up, 12 in 2024-05-08T20:02:43.124 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:42 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:43.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:43 smithi132 ceph-mon[47484]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T20:02:44.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:43 smithi033 ceph-mon[42490]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T20:02:44.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:43 smithi082 ceph-mon[46774]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 354 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T20:02:46.303 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:46 smithi132 ceph-mon[47484]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-08T20:02:46.303 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:46 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T20:02:46.303 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:46 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:46 smithi033 ceph-mon[42490]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-08T20:02:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T20:02:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:46 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:46.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:46 smithi082 ceph-mon[46774]: pgmap v191: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2024-05-08T20:02:46.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:46 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T20:02:46.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:46 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:47.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:47 smithi132 ceph-mon[47484]: Deploying daemon osd.11 on smithi132 2024-05-08T20:02:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:47 smithi033 ceph-mon[42490]: Deploying daemon osd.11 on smithi132 2024-05-08T20:02:47.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:47 smithi082 ceph-mon[46774]: Deploying daemon osd.11 on smithi132 2024-05-08T20:02:48.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:48 smithi132 ceph-mon[47484]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T20:02:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:48 smithi033 ceph-mon[42490]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T20:02:48.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:48 smithi082 ceph-mon[46774]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T20:02:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:50 smithi033 ceph-mon[42490]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:50 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:50 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:50.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:50 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:50.596 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:50 smithi132 ceph-mon[47484]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:50.596 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:50 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:50.596 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:50 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:50.596 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:50 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:50.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:50 smithi082 ceph-mon[46774]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:50.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:50 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:50.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:50 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:50.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:50 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:51.547 INFO:teuthology.orchestra.run.smithi132.stdout:Created osd(s) 11 on host 'smithi132' 2024-05-08T20:02:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.557+0000 7f135ffff700 1 -- 172.21.15.132:0/3761336146 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f13780748f0 con 0x7f13600a1120 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f13600a1120 msgr2=0x7f13600a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f13600a1120 0x7f13600a35e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1378102040 tx=0x7f136c009260 comp rx=0 tx=0).stop 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1378102b80 msgr2=0x7f13781a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1378102b80 0x7f13781a07b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f137000add0 tx=0x7f137000c330 comp rx=0 tx=0).stop 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 shutdown_connections 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f13600a1120 0x7f13600a35e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1378102b80 0x7f13781a07b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1378100fe0 0x7f1378199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 --2- 172.21.15.132:0/3761336146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13781021e0 0x7f13781997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 >> 172.21.15.132:0/3761336146 conn(0x7f13780fc5a0 msgr2=0x7f13780731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 shutdown_connections 2024-05-08T20:02:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:02:51.560+0000 7f137d38d700 1 -- 172.21.15.132:0/3761336146 wait complete. 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:52.030 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:51 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.032 DEBUG:teuthology.orchestra.run.smithi132:osd.11> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.11.service 2024-05-08T20:02:52.034 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-08T20:02:52.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-08T20:02:52.066 INFO:journalctl@ceph.osd.11.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:02:52.294 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:52.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:51 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:02:52.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:51 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:53.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.279+0000 7f6e07db2700 1 -- 172.21.15.33:0/2159583650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00101000 msgr2=0x7f6e00101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:53.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.279+0000 7f6e07db2700 1 --2- 172.21.15.33:0/2159583650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00101000 0x7f6e00101420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc0099c0 tx=0x7f6dfc009cd0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.279+0000 7f6e07db2700 1 -- 172.21.15.33:0/2159583650 shutdown_connections 2024-05-08T20:02:53.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.279+0000 7f6e07db2700 1 --2- 172.21.15.33:0/2159583650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e00102ba0 0x7f6e00109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.279+0000 7f6e07db2700 1 --2- 172.21.15.33:0/2159583650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00101000 0x7f6e00101420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.279+0000 7f6e07db2700 1 --2- 172.21.15.33:0/2159583650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e00102200 0x7f6e00102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.279+0000 7f6e07db2700 1 -- 172.21.15.33:0/2159583650 >> 172.21.15.33:0/2159583650 conn(0x7f6e000fc5a0 msgr2=0x7f6e000fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.280+0000 7f6e07db2700 1 -- 172.21.15.33:0/2159583650 shutdown_connections 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.280+0000 7f6e07db2700 1 -- 172.21.15.33:0/2159583650 wait complete. 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.280+0000 7f6e07db2700 1 Processor -- start 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.280+0000 7f6e07db2700 1 -- start start 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e07db2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e00101000 0x7f6e00074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e07db2700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e00102200 0x7f6e00073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e07db2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00102ba0 0x7f6e000738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e07db2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e00074070 con 0x7f6e00102ba0 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e07db2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000741e0 con 0x7f6e00101000 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e07db2700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e001a1070 con 0x7f6e00102200 2024-05-08T20:02:53.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00102ba0 0x7f6e000738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00102ba0 0x7f6e000738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48414/0 (socket says 172.21.15.33:48414) 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0534d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e00102200 0x7f6e00073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 -- 172.21.15.33:0/759602176 learned_addr learned my addr 172.21.15.33:0/759602176 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e05b4e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e00101000 0x7f6e00074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 -- 172.21.15.33:0/759602176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e00102200 msgr2=0x7f6e00073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e00102200 0x7f6e00073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 -- 172.21.15.33:0/759602176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e00101000 msgr2=0x7f6e00074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e00101000 0x7f6e00074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 -- 172.21.15.33:0/759602176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0095f0 con 0x7f6e00102ba0 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.281+0000 7f6e0634f700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00102ba0 0x7f6e000738d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6df800ef30 tx=0x7f6df800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.282+0000 7f6df6ffd700 1 -- 172.21.15.33:0/759602176 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df8018070 con 0x7f6e00102ba0 2024-05-08T20:02:53.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.282+0000 7f6df6ffd700 1 -- 172.21.15.33:0/759602176 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6df800f040 con 0x7f6e00102ba0 2024-05-08T20:02:53.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.282+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e001a12a0 con 0x7f6e00102ba0 2024-05-08T20:02:53.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.282+0000 7f6df6ffd700 1 -- 172.21.15.33:0/759602176 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df800cd50 con 0x7f6e00102ba0 2024-05-08T20:02:53.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.282+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e001a17a0 con 0x7f6e00102ba0 2024-05-08T20:02:53.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.283+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e00108500 con 0x7f6e00102ba0 2024-05-08T20:02:53.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.285+0000 7f6df6ffd700 1 -- 172.21.15.33:0/759602176 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6df8003a00 con 0x7f6e00102ba0 2024-05-08T20:02:53.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.285+0000 7f6df6ffd700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6dec0a11a0 0x7f6dec0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:53.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.285+0000 7f6e05b4e700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6dec0a11a0 0x7f6dec0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:53.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.285+0000 7f6df6ffd700 1 -- 172.21.15.33:0/759602176 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6df80cc7c0 con 0x7f6e00102ba0 2024-05-08T20:02:53.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.286+0000 7f6e05b4e700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6dec0a11a0 0x7f6dec0a3660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00b580 tx=0x7f6dfc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:53.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.289+0000 7f6df6ffd700 1 -- 172.21.15.33:0/759602176 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6df80965c0 con 0x7f6e00102ba0 2024-05-08T20:02:53.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.502+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f6e0004ec60 con 0x7f6e00102ba0 2024-05-08T20:02:53.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.502+0000 7f6df6ffd700 1 -- 172.21.15.33:0/759602176 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) v1 ==== 74+0+133 (secure 0 0 0) 0x7f6df8099be0 con 0x7f6e00102ba0 2024-05-08T20:02:53.492 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:02:53.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6dec0a11a0 msgr2=0x7f6dec0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:53.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6dec0a11a0 0x7f6dec0a3660 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00b580 tx=0x7f6dfc005fb0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00102ba0 msgr2=0x7f6e000738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00102ba0 0x7f6e000738d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6df800ef30 tx=0x7f6df800c3a0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 shutdown_connections 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e00102ba0 0x7f6e000738d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e00101000 0x7f6e00074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6dec0a11a0 0x7f6dec0a3660 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 --2- 172.21.15.33:0/759602176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e00102200 0x7f6e00073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 >> 172.21.15.33:0/759602176 conn(0x7f6e000fc5a0 msgr2=0x7f6e00105640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 shutdown_connections 2024-05-08T20:02:53.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:53.505+0000 7f6e07db2700 1 -- 172.21.15.33:0/759602176 wait complete. 2024-05-08T20:02:53.624 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:02:53 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:02:53.270+0000 7fe0d94c37c0 -1 osd.11 0 log_to_monitors true 2024-05-08T20:02:53.871 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1715198558,"num_in_osds":12,"osd_in_since":1715198559,"num_remapped_pgs":0} 2024-05-08T20:02:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T20:02:54.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/759602176' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:54.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:54 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T20:02:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T20:02:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/759602176' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T20:02:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:54.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:54 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:54.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T20:02:54.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/759602176' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:02:54.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:54 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:02:54.873 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-08T20:02:55.131 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:02:55.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:55 smithi033 ceph-mon[42490]: Detected new or changed devices on smithi132 2024-05-08T20:02:55.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:55 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi132 to 4278M 2024-05-08T20:02:55.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:55 smithi033 ceph-mon[42490]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T20:02:55.165 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:55 smithi033 ceph-mon[42490]: osdmap e73: 12 total, 11 up, 12 in 2024-05-08T20:02:55.166 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:55 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:55.166 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:55 smithi033 ceph-mon[42490]: from='osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:55.166 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:55 smithi033 ceph-mon[42490]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:55 smithi082 ceph-mon[46774]: Detected new or changed devices on smithi132 2024-05-08T20:02:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:55 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi132 to 4278M 2024-05-08T20:02:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:55 smithi082 ceph-mon[46774]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T20:02:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:55 smithi082 ceph-mon[46774]: osdmap e73: 12 total, 11 up, 12 in 2024-05-08T20:02:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:55 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:55 smithi082 ceph-mon[46774]: from='osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:55.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:55 smithi082 ceph-mon[46774]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:55.624 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:02:55 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:02:55.182+0000 7fe0ceb27700 -1 osd.11 0 waiting for initial osdmap 2024-05-08T20:02:55.624 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:02:55 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:02:55.199+0000 7fe0ca91c700 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T20:02:55.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:55 smithi132 ceph-mon[47484]: Detected new or changed devices on smithi132 2024-05-08T20:02:55.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:55 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi132 to 4278M 2024-05-08T20:02:55.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:55 smithi132 ceph-mon[47484]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T20:02:55.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:55 smithi132 ceph-mon[47484]: osdmap e73: 12 total, 11 up, 12 in 2024-05-08T20:02:55.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:55 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:55.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:55 smithi132 ceph-mon[47484]: from='osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:55.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:55 smithi132 ceph-mon[47484]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]: dispatch 2024-05-08T20:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.136+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3832053879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8101af0 msgr2=0x7f82b8103ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:56.128 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.136+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3832053879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8101af0 0x7f82b8103ee0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f82b4009990 tx=0x7f82b4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3832053879 shutdown_connections 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3832053879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b8106d50 0x7f82b8109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3832053879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8101af0 0x7f82b8103ee0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3832053879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82b8104420 0x7f82b8106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3832053879 >> 172.21.15.33:0/3832053879 conn(0x7f82b80fb4a0 msgr2=0x7f82b80fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3832053879 shutdown_connections 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3832053879 wait complete. 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 Processor -- start 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.137+0000 7f82bfb1f700 1 -- start start 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bfb1f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82b8101af0 0x7f82b8196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bfb1f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b8104420 0x7f82b8197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bfb1f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8106d50 0x7f82b819e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:56.129 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bfb1f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b819eb30 con 0x7f82b8106d50 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bfb1f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b819ec70 con 0x7f82b8104420 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bfb1f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b819ee00 con 0x7f82b8101af0 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8106d50 0x7f82b819e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bd0ba700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b8104420 0x7f82b8197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8106d50 0x7f82b819e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48440/0 (socket says 172.21.15.33:48440) 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 -- 172.21.15.33:0/3910217083 learned_addr learned my addr 172.21.15.33:0/3910217083 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bd8bb700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82b8101af0 0x7f82b8196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 -- 172.21.15.33:0/3910217083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82b8101af0 msgr2=0x7f82b8196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82b8101af0 0x7f82b8196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 -- 172.21.15.33:0/3910217083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b8104420 msgr2=0x7f82b8197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b8104420 0x7f82b8197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 -- 172.21.15.33:0/3910217083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b40095f0 con 0x7f82b8106d50 2024-05-08T20:02:56.130 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bd8bb700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82b8101af0 0x7f82b8196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82be0bc700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8106d50 0x7f82b819e560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82b0007ee0 tx=0x7f82b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82aeffd700 1 -- 172.21.15.33:0/3910217083 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0004db0 con 0x7f82b8106d50 2024-05-08T20:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82aeffd700 1 -- 172.21.15.33:0/3910217083 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f82b000f040 con 0x7f82b8106d50 2024-05-08T20:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b819f0e0 con 0x7f82b8106d50 2024-05-08T20:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.138+0000 7f82aeffd700 1 -- 172.21.15.33:0/3910217083 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b00059d0 con 0x7f82b8106d50 2024-05-08T20:02:56.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.139+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b819f590 con 0x7f82b8106d50 2024-05-08T20:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.139+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b80fd020 con 0x7f82b8106d50 2024-05-08T20:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.141+0000 7f82aeffd700 1 -- 172.21.15.33:0/3910217083 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f82b000dbd0 con 0x7f82b8106d50 2024-05-08T20:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.142+0000 7f82aeffd700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f82a40a1120 0x7f82a40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:56.132 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.142+0000 7f82bd8bb700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f82a40a1120 0x7f82a40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.142+0000 7f82aeffd700 1 -- 172.21.15.33:0/3910217083 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f82b00cc500 con 0x7f82b8106d50 2024-05-08T20:02:56.133 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.142+0000 7f82bd8bb700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f82a40a1120 0x7f82a40a35e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f82b400b5c0 tx=0x7f82b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:56.135 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.146+0000 7f82aeffd700 1 -- 172.21.15.33:0/3910217083 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f82b0096250 con 0x7f82b8106d50 2024-05-08T20:02:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:56 smithi033 ceph-mon[42490]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:56 smithi033 ceph-mon[42490]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:02:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:56 smithi033 ceph-mon[42490]: osdmap e74: 12 total, 11 up, 12 in 2024-05-08T20:02:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:56 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:56.173 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:56 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:56.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.361+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f82b804ec60 con 0x7f82b8106d50 2024-05-08T20:02:56.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.361+0000 7f82aeffd700 1 -- 172.21.15.33:0/3910217083 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) v1 ==== 74+0+133 (secure 0 0 0) 0x7f82b0099870 con 0x7f82b8106d50 2024-05-08T20:02:56.351 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:02:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f82a40a1120 msgr2=0x7f82a40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f82a40a1120 0x7f82a40a35e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f82b400b5c0 tx=0x7f82b4005fb0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8106d50 msgr2=0x7f82b819e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8106d50 0x7f82b819e560 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82b0007ee0 tx=0x7f82b000d3b0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 shutdown_connections 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82b8106d50 0x7f82b819e560 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f82a40a1120 0x7f82a40a35e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82b8101af0 0x7f82b8196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 --2- 172.21.15.33:0/3910217083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f82b8104420 0x7f82b8197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 >> 172.21.15.33:0/3910217083 conn(0x7f82b80fb4a0 msgr2=0x7f82b8102630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 shutdown_connections 2024-05-08T20:02:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:56.364+0000 7f82bfb1f700 1 -- 172.21.15.33:0/3910217083 wait complete. 2024-05-08T20:02:56.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:56 smithi082 ceph-mon[46774]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:56.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:56 smithi082 ceph-mon[46774]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:02:56.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:56 smithi082 ceph-mon[46774]: osdmap e74: 12 total, 11 up, 12 in 2024-05-08T20:02:56.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:56 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:56.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:56 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:56 smithi132 ceph-mon[47484]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 318 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:56 smithi132 ceph-mon[47484]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi132", "root=default"]}]': finished 2024-05-08T20:02:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:56 smithi132 ceph-mon[47484]: osdmap e74: 12 total, 11 up, 12 in 2024-05-08T20:02:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:56 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:56 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:56.730 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1715198576,"num_in_osds":12,"osd_in_since":1715198559,"num_remapped_pgs":0} 2024-05-08T20:02:56.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T20:02:56.983 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:02:57.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:57 smithi033 ceph-mon[42490]: purged_snaps scrub starts 2024-05-08T20:02:57.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:57 smithi033 ceph-mon[42490]: purged_snaps scrub ok 2024-05-08T20:02:57.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:57 smithi033 ceph-mon[42490]: osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] boot 2024-05-08T20:02:57.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:57 smithi033 ceph-mon[42490]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T20:02:57.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:57 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:57.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:57 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3910217083' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T20:02:57.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:57 smithi082 ceph-mon[46774]: purged_snaps scrub starts 2024-05-08T20:02:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:57 smithi082 ceph-mon[46774]: purged_snaps scrub ok 2024-05-08T20:02:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:57 smithi082 ceph-mon[46774]: osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] boot 2024-05-08T20:02:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:57 smithi082 ceph-mon[46774]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T20:02:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:57 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:57.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:57 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3910217083' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T20:02:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:57 smithi132 ceph-mon[47484]: purged_snaps scrub starts 2024-05-08T20:02:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:57 smithi132 ceph-mon[47484]: purged_snaps scrub ok 2024-05-08T20:02:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:57 smithi132 ceph-mon[47484]: osd.11 [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] boot 2024-05-08T20:02:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:57 smithi132 ceph-mon[47484]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T20:02:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:57 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:02:57.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:57 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3910217083' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T20:02:57.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.926+0000 7f777e7e2700 1 -- 172.21.15.33:0/503537434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778068950 msgr2=0x7f7778068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:57.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.926+0000 7f777e7e2700 1 --2- 172.21.15.33:0/503537434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778068950 0x7f7778068db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f776c009990 tx=0x7f776c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:02:57.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 -- 172.21.15.33:0/503537434 shutdown_connections 2024-05-08T20:02:57.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 --2- 172.21.15.33:0/503537434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77780692f0 0x7f777810de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:57.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 --2- 172.21.15.33:0/503537434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7778107020 0x7f7778107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:57.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 --2- 172.21.15.33:0/503537434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778068950 0x7f7778068db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:57.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 -- 172.21.15.33:0/503537434 >> 172.21.15.33:0/503537434 conn(0x7f7778075f80 msgr2=0x7f7778076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:57.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 -- 172.21.15.33:0/503537434 shutdown_connections 2024-05-08T20:02:57.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 -- 172.21.15.33:0/503537434 wait complete. 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 Processor -- start 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.927+0000 7f777e7e2700 1 -- start start 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777e7e2700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778068950 0x7f77781974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777e7e2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77780692f0 0x7f7778197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777e7e2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778107020 0x7f777819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777e7e2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777819c380 con 0x7f7778107020 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777e7e2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777819c4f0 con 0x7f77780692f0 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777e7e2700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777819c6b0 con 0x7f7778068950 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778107020 0x7f777819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778107020 0x7f777819bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48468/0 (socket says 172.21.15.33:48468) 2024-05-08T20:02:57.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 -- 172.21.15.33:0/2645616301 learned_addr learned my addr 172.21.15.33:0/2645616301 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f7777fff700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778068950 0x7f77781974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f77777fe700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77780692f0 0x7f7778197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 -- 172.21.15.33:0/2645616301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778068950 msgr2=0x7f77781974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778068950 0x7f77781974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 -- 172.21.15.33:0/2645616301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77780692f0 msgr2=0x7f7778197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77780692f0 0x7f7778197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 -- 172.21.15.33:0/2645616301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0095f0 con 0x7f7778107020 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.928+0000 7f777cd7f700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778107020 0x7f777819bd70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f777000ef30 tx=0x7f777000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.929+0000 7f77757fa700 1 -- 172.21.15.33:0/2645616301 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770018070 con 0x7f7778107020 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.929+0000 7f77757fa700 1 -- 172.21.15.33:0/2645616301 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f777000f040 con 0x7f7778107020 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.929+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777819c930 con 0x7f7778107020 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.929+0000 7f77757fa700 1 -- 172.21.15.33:0/2645616301 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777000ce00 con 0x7f7778107020 2024-05-08T20:02:57.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.929+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77781a41f0 con 0x7f7778107020 2024-05-08T20:02:57.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.930+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7778109540 con 0x7f7778107020 2024-05-08T20:02:57.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.931+0000 7f77757fa700 1 -- 172.21.15.33:0/2645616301 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7770003a00 con 0x7f7778107020 2024-05-08T20:02:57.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.932+0000 7f77757fa700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f77600a1120 0x7f77600a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:57.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.932+0000 7f7777fff700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f77600a1120 0x7f77600a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:57.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.932+0000 7f77757fa700 1 -- 172.21.15.33:0/2645616301 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f77700cca80 con 0x7f7778107020 2024-05-08T20:02:57.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.932+0000 7f7777fff700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f77600a1120 0x7f77600a35e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7768005950 tx=0x7f776800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:57.935+0000 7f77757fa700 1 -- 172.21.15.33:0/2645616301 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f77700966a0 con 0x7f7778107020 2024-05-08T20:02:58.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.150+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7778198790 con 0x7f7778107020 2024-05-08T20:02:58.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.151+0000 7f77757fa700 1 -- 172.21.15.33:0/2645616301 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f7770099cc0 con 0x7f7778107020 2024-05-08T20:02:58.141 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:02:58.141 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":76,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:02:57.184553+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.153+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f77600a1120 msgr2=0x7f77600a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.153+0000 7f777e7e2700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f77600a1120 0x7f77600a35e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7768005950 tx=0x7f776800b410 comp rx=0 tx=0).stop 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.153+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778107020 msgr2=0x7f777819bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.153+0000 7f777e7e2700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778107020 0x7f777819bd70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f777000ef30 tx=0x7f777000c3a0 comp rx=0 tx=0).stop 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 shutdown_connections 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7778107020 0x7f777819bd70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f77600a1120 0x7f77600a35e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:58.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7778068950 0x7f77781974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:58.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 --2- 172.21.15.33:0/2645616301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77780692f0 0x7f7778197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:58.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 >> 172.21.15.33:0/2645616301 conn(0x7f7778075f80 msgr2=0x7f77780fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:58.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 shutdown_connections 2024-05-08T20:02:58.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:58.154+0000 7f777e7e2700 1 -- 172.21.15.33:0/2645616301 wait complete. 2024-05-08T20:02:58.437 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:58 smithi033 ceph-mon[42490]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:58.437 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:58 smithi033 ceph-mon[42490]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T20:02:58.438 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:02:58 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2645616301' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:02:58.521 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:02:58.522 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-08T20:02:58.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:58 smithi082 ceph-mon[46774]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:58 smithi082 ceph-mon[46774]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T20:02:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:02:58 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2645616301' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:02:58.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:58 smithi132 ceph-mon[47484]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-05-08T20:02:58.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:58 smithi132 ceph-mon[47484]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T20:02:58.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:02:58 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2645616301' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:02:58.778 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 -- 172.21.15.33:0/1680270545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 msgr2=0x7f7cbc0735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 --2- 172.21.15.33:0/1680270545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc0735b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009990 tx=0x7f7cac009ca0 comp rx=0 tx=0).stop 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 -- 172.21.15.33:0/1680270545 shutdown_connections 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 --2- 172.21.15.33:0/1680270545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc10d9a0 0x7f7cbc10fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 --2- 172.21.15.33:0/1680270545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc0735b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 --2- 172.21.15.33:0/1680270545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cbc073af0 0x7f7cbc10d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 -- 172.21.15.33:0/1680270545 >> 172.21.15.33:0/1680270545 conn(0x7f7cbc078100 msgr2=0x7f7cbc078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 -- 172.21.15.33:0/1680270545 shutdown_connections 2024-05-08T20:02:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.798+0000 7f7cc0815700 1 -- 172.21.15.33:0/1680270545 wait complete. 2024-05-08T20:02:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.799+0000 7f7cc0815700 1 Processor -- start 2024-05-08T20:02:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.799+0000 7f7cc0815700 1 -- start start 2024-05-08T20:02:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cc0815700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cc0815700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cbc073af0 0x7f7cbc199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cc0815700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc10d9a0 0x7f7cbc19dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cc0815700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc19e5c0 con 0x7f7cbc0731d0 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cc0815700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc19e730 con 0x7f7cbc10d9a0 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cc0815700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc19e8f0 con 0x7f7cbc073af0 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc1996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48476/0 (socket says 172.21.15.33:48476) 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 -- 172.21.15.33:0/2615400009 learned_addr learned my addr 172.21.15.33:0/2615400009 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cbad9d700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc10d9a0 0x7f7cbc19dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:59.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cb9d9b700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cbc073af0 0x7f7cbc199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 -- 172.21.15.33:0/2615400009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cbc073af0 msgr2=0x7f7cbc199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cbc073af0 0x7f7cbc199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 -- 172.21.15.33:0/2615400009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc10d9a0 msgr2=0x7f7cbc19dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc10d9a0 0x7f7cbc19dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cba59c700 1 -- 172.21.15.33:0/2615400009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0095f0 con 0x7f7cbc0731d0 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.800+0000 7f7cbad9d700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc10d9a0 0x7f7cbc19dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.801+0000 7f7cba59c700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc1996c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0098e0 tx=0x7f7cac00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.801+0000 7f7cab7fe700 1 -- 172.21.15.33:0/2615400009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac01d070 con 0x7f7cbc0731d0 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.801+0000 7f7cab7fe700 1 -- 172.21.15.33:0/2615400009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7cac003680 con 0x7f7cbc0731d0 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.801+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cbc19eb70 con 0x7f7cbc0731d0 2024-05-08T20:02:59.792 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.801+0000 7f7cab7fe700 1 -- 172.21.15.33:0/2615400009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac017650 con 0x7f7cbc0731d0 2024-05-08T20:02:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.801+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cbc1a6430 con 0x7f7cbc0731d0 2024-05-08T20:02:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.802+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cbc108bb0 con 0x7f7cbc0731d0 2024-05-08T20:02:59.793 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.803+0000 7f7cab7fe700 1 -- 172.21.15.33:0/2615400009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7cac022470 con 0x7f7cbc0731d0 2024-05-08T20:02:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.804+0000 7f7cab7fe700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ca40a1120 0x7f7ca40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:02:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.804+0000 7f7cb9d9b700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ca40a1120 0x7f7ca40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:02:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.804+0000 7f7cab7fe700 1 -- 172.21.15.33:0/2615400009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7cac0cd720 con 0x7f7cbc0731d0 2024-05-08T20:02:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.804+0000 7f7cb9d9b700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ca40a1120 0x7f7ca40a35e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0005950 tx=0x7f7cb00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:02:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:02:59.809+0000 7f7cab7fe700 1 -- 172.21.15.33:0/2615400009 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7cac0973e0 con 0x7f7cbc0731d0 2024-05-08T20:03:00.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.019+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cbc04ec60 con 0x7f7cbc0731d0 2024-05-08T20:03:00.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.020+0000 7f7cab7fe700 1 -- 172.21.15.33:0/2615400009 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cac09aa00 con 0x7f7cbc0731d0 2024-05-08T20:03:00.009 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ca40a1120 msgr2=0x7f7ca40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ca40a1120 0x7f7ca40a35e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0005950 tx=0x7f7cb00058e0 comp rx=0 tx=0).stop 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 msgr2=0x7f7cbc1996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc1996c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0098e0 tx=0x7f7cac00f690 comp rx=0 tx=0).stop 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 shutdown_connections 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7cbc10d9a0 0x7f7cbc19dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cbc0731d0 0x7f7cbc1996c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ca40a1120 0x7f7ca40a35e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 --2- 172.21.15.33:0/2615400009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cbc073af0 0x7f7cbc199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 >> 172.21.15.33:0/2615400009 conn(0x7f7cbc078100 msgr2=0x7f7cbc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:00.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 shutdown_connections 2024-05-08T20:03:00.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:00.022+0000 7f7cc0815700 1 -- 172.21.15.33:0/2615400009 wait complete. 2024-05-08T20:03:00.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:00 smithi033 ceph-mon[42490]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:00.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:00 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2615400009' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.a on smithi033 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.d on smithi033 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.g on smithi033 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.j on smithi033 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.b on smithi082 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.e on smithi082 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.h on smithi082 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.k on smithi082 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.c on smithi132 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.f on smithi132 2024-05-08T20:03:00.380 INFO:tasks.cephadm:Adding mds.i on smithi132 2024-05-08T20:03:00.381 INFO:tasks.cephadm:Adding mds.l on smithi132 2024-05-08T20:03:00.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l' 2024-05-08T20:03:00.617 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:03:00.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:00 smithi082 ceph-mon[46774]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:00.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:00 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2615400009' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:00.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:00 smithi132 ceph-mon[47484]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:00 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2615400009' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:01.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3540860233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d441001a0 msgr2=0x7f0d44100620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:01.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3540860233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d441001a0 0x7f0d44100620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009990 tx=0x7f0d30009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3540860233 shutdown_connections 2024-05-08T20:03:01.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3540860233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d44100b60 0x7f0d44108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3540860233 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d44101540 0x7f0d44101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3540860233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d441001a0 0x7f0d44100620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3540860233 >> 172.21.15.132:0/3540860233 conn(0x7f0d440facb0 msgr2=0x7f0d440fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:01.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3540860233 shutdown_connections 2024-05-08T20:03:01.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3540860233 wait complete. 2024-05-08T20:03:01.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 Processor -- start 2024-05-08T20:03:01.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 -- start start 2024-05-08T20:03:01.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.575+0000 7f0d4ac3d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441001a0 0x7f0d44195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:01.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d4ac3d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d44100b60 0x7f0d441964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:01.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d4ac3d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d44101540 0x7f0d4419d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:01.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d4ac3d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4419dad0 con 0x7f0d44101540 2024-05-08T20:03:01.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d4ac3d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4419dc10 con 0x7f0d441001a0 2024-05-08T20:03:01.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d4ac3d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4419dda0 con 0x7f0d44100b60 2024-05-08T20:03:01.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d44100b60 0x7f0d441964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:01.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d44100b60 0x7f0d441964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49964/0 (socket says 172.21.15.132:49964) 2024-05-08T20:03:01.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 -- 172.21.15.132:0/3586111917 learned_addr learned my addr 172.21.15.132:0/3586111917 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-05-08T20:03:01.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d489d9700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441001a0 0x7f0d44195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:01.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d491da700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d44101540 0x7f0d4419d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:01.570 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 -- 172.21.15.132:0/3586111917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441001a0 msgr2=0x7f0d44195f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:01.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441001a0 0x7f0d44195f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 -- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d44101540 msgr2=0x7f0d4419d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:01.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d44101540 0x7f0d4419d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 -- 172.21.15.132:0/3586111917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300095f0 con 0x7f0d44100b60 2024-05-08T20:03:01.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d43fff700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d44100b60 0x7f0d441964d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d30005910 tx=0x7f0d3000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:01.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d41ffb700 1 -- 172.21.15.132:0/3586111917 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3001d070 con 0x7f0d44100b60 2024-05-08T20:03:01.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4419e020 con 0x7f0d44100b60 2024-05-08T20:03:01.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d41ffb700 1 -- 172.21.15.132:0/3586111917 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d3000fb80 con 0x7f0d44100b60 2024-05-08T20:03:01.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d41ffb700 1 -- 172.21.15.132:0/3586111917 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30017650 con 0x7f0d44100b60 2024-05-08T20:03:01.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.576+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4419e490 con 0x7f0d44100b60 2024-05-08T20:03:01.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.577+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d44107370 con 0x7f0d44100b60 2024-05-08T20:03:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.579+0000 7f0d41ffb700 1 -- 172.21.15.132:0/3586111917 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0d30022470 con 0x7f0d44100b60 2024-05-08T20:03:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.580+0000 7f0d41ffb700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0d340a1120 0x7f0d340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.580+0000 7f0d41ffb700 1 -- 172.21.15.132:0/3586111917 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0d300ce1b0 con 0x7f0d44100b60 2024-05-08T20:03:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.580+0000 7f0d489d9700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0d340a1120 0x7f0d340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.580+0000 7f0d489d9700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0d340a1120 0x7f0d340a35e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d38005950 tx=0x7f0d3800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.583+0000 7f0d41ffb700 1 -- 172.21.15.132:0/3586111917 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0d30097e70 con 0x7f0d44100b60 2024-05-08T20:03:01.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.786+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d440614e0 con 0x7f0d340a1120 2024-05-08T20:03:01.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.796+0000 7f0d41ffb700 1 -- 172.21.15.132:0/3586111917 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f0d440614e0 con 0x7f0d340a1120 2024-05-08T20:03:01.785 INFO:teuthology.orchestra.run.smithi132.stdout:Scheduled mds.all update... 2024-05-08T20:03:01.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.798+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0d340a1120 msgr2=0x7f0d340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:01.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.798+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0d340a1120 0x7f0d340a35e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0d38005950 tx=0x7f0d3800a300 comp rx=0 tx=0).stop 2024-05-08T20:03:01.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.798+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d44100b60 msgr2=0x7f0d441964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:01.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.798+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d44100b60 0x7f0d441964d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0d30005910 tx=0x7f0d3000f690 comp rx=0 tx=0).stop 2024-05-08T20:03:01.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 shutdown_connections 2024-05-08T20:03:01.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d44101540 0x7f0d4419d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d441001a0 0x7f0d44195f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0d340a1120 0x7f0d340a35e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 --2- 172.21.15.132:0/3586111917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d44100b60 0x7f0d441964d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:01.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 >> 172.21.15.132:0/3586111917 conn(0x7f0d440facb0 msgr2=0x7f0d441044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:01.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 shutdown_connections 2024-05-08T20:03:01.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-05-08T20:03:01.799+0000 7f0d4ac3d700 1 -- 172.21.15.132:0/3586111917 wait complete. 2024-05-08T20:03:02.163 DEBUG:teuthology.orchestra.run.smithi033:mds.a> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.a.service 2024-05-08T20:03:02.165 DEBUG:teuthology.orchestra.run.smithi033:mds.d> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.d.service 2024-05-08T20:03:02.202 INFO:journalctl@ceph.mds.a.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T20:03:02.203 DEBUG:teuthology.orchestra.run.smithi033:mds.g> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.g.service 2024-05-08T20:03:02.234 INFO:journalctl@ceph.mds.d.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T20:03:02.235 DEBUG:teuthology.orchestra.run.smithi033:mds.j> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.j.service 2024-05-08T20:03:02.267 INFO:journalctl@ceph.mds.g.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T20:03:02.268 DEBUG:teuthology.orchestra.run.smithi082:mds.b> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.b.service 2024-05-08T20:03:02.270 DEBUG:teuthology.orchestra.run.smithi082:mds.e> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.e.service 2024-05-08T20:03:02.298 INFO:journalctl@ceph.mds.j.smithi033.stdout:-- Logs begin at Wed 2024-05-08 19:40:53 UTC. -- 2024-05-08T20:03:02.308 INFO:journalctl@ceph.mds.b.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T20:03:02.310 DEBUG:teuthology.orchestra.run.smithi082:mds.h> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h.service 2024-05-08T20:03:02.339 INFO:journalctl@ceph.mds.e.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T20:03:02.340 DEBUG:teuthology.orchestra.run.smithi082:mds.k> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.k.service 2024-05-08T20:03:02.368 INFO:journalctl@ceph.mds.h.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T20:03:02.369 DEBUG:teuthology.orchestra.run.smithi132:mds.c> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.c.service 2024-05-08T20:03:02.371 DEBUG:teuthology.orchestra.run.smithi132:mds.f> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.f.service 2024-05-08T20:03:02.395 INFO:journalctl@ceph.mds.k.smithi082.stdout:-- Logs begin at Wed 2024-05-08 19:41:16 UTC. -- 2024-05-08T20:03:02.401 INFO:journalctl@ceph.mds.c.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:03:02.402 DEBUG:teuthology.orchestra.run.smithi132:mds.i> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.i.service 2024-05-08T20:03:02.422 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:02 smithi132 ceph-mon[47484]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:02.422 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:02 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:02.423 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:02 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:02.423 DEBUG:teuthology.orchestra.run.smithi132:mds.l> sudo journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.l.service 2024-05-08T20:03:02.428 INFO:journalctl@ceph.mds.f.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:03:02.429 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-08T20:03:02.429 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:03:02.451 INFO:journalctl@ceph.mds.i.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:03:02.454 INFO:journalctl@ceph.mds.l.smithi132.stdout:-- Logs begin at Wed 2024-05-08 19:41:11 UTC. -- 2024-05-08T20:03:02.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:02 smithi033 ceph-mon[42490]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:02.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:02 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:02.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:02 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 -- 172.21.15.33:0/3234645837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 msgr2=0x7f3354100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 --2- 172.21.15.33:0/3234645837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354100180 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f33440099c0 tx=0x7f3344009cd0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 -- 172.21.15.33:0/3234645837 shutdown_connections 2024-05-08T20:03:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 --2- 172.21.15.33:0/3234645837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33541018f0 0x7f33541081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 --2- 172.21.15.33:0/3234645837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354100180 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 --2- 172.21.15.33:0/3234645837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 0x7f33541013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 -- 172.21.15.33:0/3234645837 >> 172.21.15.33:0/3234645837 conn(0x7f33540fb2f0 msgr2=0x7f33540fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 -- 172.21.15.33:0/3234645837 shutdown_connections 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.625+0000 7f3358deb700 1 -- 172.21.15.33:0/3234645837 wait complete. 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 Processor -- start 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 -- start start 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 0x7f3354197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33541018f0 0x7f335419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335419e9f0 con 0x7f33540ffd60 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335419eb30 con 0x7f33541018f0 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.626+0000 7f3358deb700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335419ecc0 con 0x7f3354100f50 2024-05-08T20:03:02.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f3351d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 0x7f3354197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48242/0 (socket says 172.21.15.33:48242) 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 -- 172.21.15.33:0/3310452114 learned_addr learned my addr 172.21.15.33:0/3310452114 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f3351d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 0x7f3354197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:38498/0 (socket says 172.21.15.33:38498) 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f3352d9d700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33541018f0 0x7f335419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 -- 172.21.15.33:0/3310452114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 msgr2=0x7f3354197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 0x7f3354197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 -- 172.21.15.33:0/3310452114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33541018f0 msgr2=0x7f335419e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33541018f0 0x7f335419e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 -- 172.21.15.33:0/3310452114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440095f0 con 0x7f33540ffd60 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f3351d9b700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 0x7f3354197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:03:02.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f335259c700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354196ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f334400c010 tx=0x7f334400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f33437fe700 1 -- 172.21.15.33:0/3310452114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334401d070 con 0x7f33540ffd60 2024-05-08T20:03:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f335419ef40 con 0x7f33540ffd60 2024-05-08T20:03:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f33437fe700 1 -- 172.21.15.33:0/3310452114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3344005940 con 0x7f33540ffd60 2024-05-08T20:03:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f33437fe700 1 -- 172.21.15.33:0/3310452114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33440173f0 con 0x7f33540ffd60 2024-05-08T20:03:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.627+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335419f300 con 0x7f33540ffd60 2024-05-08T20:03:02.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.629+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3354067c10 con 0x7f33540ffd60 2024-05-08T20:03:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:02 smithi082 ceph-mon[46774]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:02 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:02 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.630+0000 7f33437fe700 1 -- 172.21.15.33:0/3310452114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f334400fc10 con 0x7f33540ffd60 2024-05-08T20:03:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.631+0000 7f33437fe700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f333c0a1120 0x7f333c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.631+0000 7f33437fe700 1 -- 172.21.15.33:0/3310452114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f33440cdaf0 con 0x7f33540ffd60 2024-05-08T20:03:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.631+0000 7f3351d9b700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f333c0a1120 0x7f333c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.631+0000 7f3351d9b700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f333c0a1120 0x7f333c0a35e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3348011490 tx=0x7f3348009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:02.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.634+0000 7f33437fe700 1 -- 172.21.15.33:0/3310452114 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f33440977b0 con 0x7f33540ffd60 2024-05-08T20:03:02.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.856+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f335410b6b0 con 0x7f33540ffd60 2024-05-08T20:03:02.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.857+0000 7f33437fe700 1 -- 172.21.15.33:0/3310452114 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f334409add0 con 0x7f33540ffd60 2024-05-08T20:03:02.847 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:02.847 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":76,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:02:57.184553+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:03:02.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f333c0a1120 msgr2=0x7f333c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:02.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f333c0a1120 0x7f333c0a35e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3348011490 tx=0x7f3348009260 comp rx=0 tx=0).stop 2024-05-08T20:03:02.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 msgr2=0x7f3354196ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:02.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354196ec0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f334400c010 tx=0x7f334400f710 comp rx=0 tx=0).stop 2024-05-08T20:03:02.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 shutdown_connections 2024-05-08T20:03:02.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33541018f0 0x7f335419e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33540ffd60 0x7f3354196ec0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f333c0a1120 0x7f333c0a35e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 --2- 172.21.15.33:0/3310452114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3354100f50 0x7f3354197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.859+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 >> 172.21.15.33:0/3310452114 conn(0x7f33540fb2f0 msgr2=0x7f33540fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.860+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 shutdown_connections 2024-05-08T20:03:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:02.860+0000 7f3358deb700 1 -- 172.21.15.33:0/3310452114 wait complete. 2024-05-08T20:03:02.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:03:02.864 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:03:03.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.057+0000 7f54571f4700 1 -- 172.21.15.33:0/3005856517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54500ffe80 msgr2=0x7f54501002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.057+0000 7f54571f4700 1 --2- 172.21.15.33:0/3005856517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54500ffe80 0x7f54501002a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f544c009990 tx=0x7f544c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 -- 172.21.15.33:0/3005856517 shutdown_connections 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 --2- 172.21.15.33:0/3005856517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5450101990 0x7f54501082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 --2- 172.21.15.33:0/3005856517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54500ffe80 0x7f54501002a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 --2- 172.21.15.33:0/3005856517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5450100fd0 0x7f5450101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 -- 172.21.15.33:0/3005856517 >> 172.21.15.33:0/3005856517 conn(0x7f54500fb3f0 msgr2=0x7f54500fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 -- 172.21.15.33:0/3005856517 shutdown_connections 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 -- 172.21.15.33:0/3005856517 wait complete. 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 Processor -- start 2024-05-08T20:03:03.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 -- start start 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.058+0000 7f54571f4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54500ffe80 0x7f5450197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f54571f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5450100fd0 0x7f5450197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f54571f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5450101990 0x7f545019e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f54571f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545019eb30 con 0x7f5450100fd0 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f54571f4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545019ec70 con 0x7f5450101990 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f54571f4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545019ee00 con 0x7f54500ffe80 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5447fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5450100fd0 0x7f5450197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54500ffe80 0x7f5450197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54500ffe80 0x7f5450197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:38522/0 (socket says 172.21.15.33:38522) 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5447fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5450100fd0 0x7f5450197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48260/0 (socket says 172.21.15.33:48260) 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 -- 172.21.15.33:0/3625310665 learned_addr learned my addr 172.21.15.33:0/3625310665 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5455791700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5450101990 0x7f545019e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 -- 172.21.15.33:0/3625310665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5450101990 msgr2=0x7f545019e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5450101990 0x7f545019e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 -- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5450100fd0 msgr2=0x7f5450197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5450100fd0 0x7f5450197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 -- 172.21.15.33:0/3625310665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c0095f0 con 0x7f54500ffe80 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5455791700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5450101990 0x7f545019e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5447fff700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5450100fd0 0x7f5450197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5454f90700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54500ffe80 0x7f5450197050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5445ffb700 1 -- 172.21.15.33:0/3625310665 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c01d070 con 0x7f54500ffe80 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545019f080 con 0x7f54500ffe80 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5445ffb700 1 -- 172.21.15.33:0/3625310665 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f544c005030 con 0x7f54500ffe80 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.059+0000 7f5445ffb700 1 -- 172.21.15.33:0/3625310665 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c004c40 con 0x7f54500ffe80 2024-05-08T20:03:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.060+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545019f4a0 con 0x7f54500ffe80 2024-05-08T20:03:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.061+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5450067460 con 0x7f54500ffe80 2024-05-08T20:03:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.062+0000 7f5445ffb700 1 -- 172.21.15.33:0/3625310665 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f544c005510 con 0x7f54500ffe80 2024-05-08T20:03:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.063+0000 7f5445ffb700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54380a1120 0x7f54380a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.063+0000 7f5447fff700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54380a1120 0x7f54380a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.063+0000 7f5445ffb700 1 -- 172.21.15.33:0/3625310665 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f544c0cd570 con 0x7f54500ffe80 2024-05-08T20:03:03.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.063+0000 7f5447fff700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54380a1120 0x7f54380a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5440011490 tx=0x7f5440009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:03.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.066+0000 7f5445ffb700 1 -- 172.21.15.33:0/3625310665 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f544c097190 con 0x7f54500ffe80 2024-05-08T20:03:03.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.286+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f545010b9d0 con 0x7f54500ffe80 2024-05-08T20:03:03.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.287+0000 7f5445ffb700 1 -- 172.21.15.33:0/3625310665 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f544c09a7b0 con 0x7f54500ffe80 2024-05-08T20:03:03.277 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:03:03.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54380a1120 msgr2=0x7f54380a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54380a1120 0x7f54380a35e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5440011490 tx=0x7f5440009260 comp rx=0 tx=0).stop 2024-05-08T20:03:03.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54500ffe80 msgr2=0x7f5450197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54500ffe80 0x7f5450197050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c004730 comp rx=0 tx=0).stop 2024-05-08T20:03:03.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 shutdown_connections 2024-05-08T20:03:03.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5450101990 0x7f545019e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54380a1120 0x7f54380a35e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54500ffe80 0x7f5450197050 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 --2- 172.21.15.33:0/3625310665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5450100fd0 0x7f5450197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 >> 172.21.15.33:0/3625310665 conn(0x7f54500fb3f0 msgr2=0x7f54500fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:03.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.289+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 shutdown_connections 2024-05-08T20:03:03.280 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.290+0000 7f54571f4700 1 -- 172.21.15.33:0/3625310665 wait complete. 2024-05-08T20:03:03.293 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:03.345 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:03.345 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-05-08T20:03:03.345 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:03.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:03.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:03.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:03.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:03.346 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:03.347 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: Deploying daemon mds.l on smithi132 2024-05-08T20:03:03.347 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3310452114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:03.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 -- 172.21.15.33:0/2742191803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2000100f20 msgr2=0x7f2000101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 --2- 172.21.15.33:0/2742191803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2000100f20 0x7f2000101380 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00099c0 tx=0x7f1ff0009cd0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 -- 172.21.15.33:0/2742191803 shutdown_connections 2024-05-08T20:03:03.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 --2- 172.21.15.33:0/2742191803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20001018c0 0x7f2000108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 --2- 172.21.15.33:0/2742191803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20000ffd30 0x7f2000100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 --2- 172.21.15.33:0/2742191803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2000100f20 0x7f2000101380 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 -- 172.21.15.33:0/2742191803 >> 172.21.15.33:0/2742191803 conn(0x7f20000fb2c0 msgr2=0x7f20000fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 -- 172.21.15.33:0/2742191803 shutdown_connections 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.440+0000 7f2006b9e700 1 -- 172.21.15.33:0/2742191803 wait complete. 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 Processor -- start 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 -- start start 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20000ffd30 0x7f2000068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2000100f20 0x7f200019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20001018c0 0x7f200019e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200019e990 con 0x7f20000ffd30 2024-05-08T20:03:03.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200019eb00 con 0x7f20001018c0 2024-05-08T20:03:03.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2006b9e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200019ecc0 con 0x7f2000100f20 2024-05-08T20:03:03.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2005b9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20000ffd30 0x7f2000068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2005b9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20000ffd30 0x7f2000068b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48270/0 (socket says 172.21.15.33:48270) 2024-05-08T20:03:03.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.441+0000 7f2005b9c700 1 -- 172.21.15.33:0/676851294 learned_addr learned my addr 172.21.15.33:0/676851294 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:03.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f200639d700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20001018c0 0x7f200019e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f200539b700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2000100f20 0x7f200019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2005b9c700 1 -- 172.21.15.33:0/676851294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2000100f20 msgr2=0x7f200019bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2005b9c700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2000100f20 0x7f200019bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2005b9c700 1 -- 172.21.15.33:0/676851294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20001018c0 msgr2=0x7f200019e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2005b9c700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20001018c0 0x7f200019e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2005b9c700 1 -- 172.21.15.33:0/676851294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00095f0 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2005b9c700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20000ffd30 0x7f2000068b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00d980 tx=0x7f1ffc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f1ff6ffd700 1 -- 172.21.15.33:0/676851294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc004020 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f1ff6ffd700 1 -- 172.21.15.33:0/676851294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ffc00f690 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200019ef40 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f1ff6ffd700 1 -- 172.21.15.33:0/676851294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc003b40 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.442+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200019f3c0 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.443+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20001070e0 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.445+0000 7f1ff6ffd700 1 -- 172.21.15.33:0/676851294 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1ffc00fb20 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.445+0000 7f1ff6ffd700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1fec0a11a0 0x7f1fec0a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.446+0000 7f200539b700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1fec0a11a0 0x7f1fec0a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.446+0000 7f1ff6ffd700 1 -- 172.21.15.33:0/676851294 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1ffc0cbef0 con 0x7f20000ffd30 2024-05-08T20:03:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.446+0000 7f200539b700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1fec0a11a0 0x7f1fec0a3660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000b580 tx=0x7f1ff0009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:03.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.450+0000 7f1ff6ffd700 1 -- 172.21.15.33:0/676851294 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1ffc095b20 con 0x7f20000ffd30 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: Deploying daemon mds.l on smithi132 2024-05-08T20:03:03.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:03 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3310452114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:03.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='client.24442 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: Saving service mds.all spec with placement smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: Deploying daemon mds.l on smithi132 2024-05-08T20:03:03.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:03 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3310452114' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:03.624 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:03:03 smithi132 systemd[1]: Starting Ceph mds.l for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:03.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.717+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2000067ba0 con 0x7f20000ffd30 2024-05-08T20:03:03.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.717+0000 7f1ff6ffd700 1 -- 172.21.15.33:0/676851294 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f1ffc099140 con 0x7f20000ffd30 2024-05-08T20:03:03.707 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:03.707 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1fec0a11a0 msgr2=0x7f1fec0a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1fec0a11a0 0x7f1fec0a3660 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000b580 tx=0x7f1ff0009f10 comp rx=0 tx=0).stop 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20000ffd30 msgr2=0x7f2000068b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20000ffd30 0x7f2000068b30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00d980 tx=0x7f1ffc00dc90 comp rx=0 tx=0).stop 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 shutdown_connections 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20001018c0 0x7f200019e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20000ffd30 0x7f2000068b30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1fec0a11a0 0x7f1fec0a3660 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 --2- 172.21.15.33:0/676851294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2000100f20 0x7f200019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 >> 172.21.15.33:0/676851294 conn(0x7f20000fb2c0 msgr2=0x7f2000104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:03.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 shutdown_connections 2024-05-08T20:03:03.711 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:03.720+0000 7f2006b9e700 1 -- 172.21.15.33:0/676851294 wait complete. 2024-05-08T20:03:03.711 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 1 2024-05-08T20:03:04.124 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:03:03 smithi132 ceph-mds[82336]: -- 172.21.15.132:0/4169924516 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c6299881a0 con 0x55c62995f000 2024-05-08T20:03:04.124 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:03:03 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-l[82313]: starting mds.l at 2024-05-08T20:03:04.124 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:03:03 smithi132 bash[82298]: 462f643b907b58bb661fdd7ad4b82ef1103efd4e2c6c8451b423b27316e704e6 2024-05-08T20:03:04.124 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:03:03 smithi132 systemd[1]: Started Ceph mds.l for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3625310665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/676851294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.132:6832/2425560119,v1:172.21.15.132:6833/2425560119] up:boot 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: fsmap 1 up:standby 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:04.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:04.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:04 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:04.605 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:04.606 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3625310665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:04.606 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/676851294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:04.606 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.132:6832/2425560119,v1:172.21.15.132:6833/2425560119] up:boot 2024-05-08T20:03:04.606 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: fsmap 1 up:standby 2024-05-08T20:03:04.606 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T20:03:04.606 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.607 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.607 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.607 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:04.607 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:04.607 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:04 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3625310665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/676851294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.132:6832/2425560119,v1:172.21.15.132:6833/2425560119] up:boot 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: fsmap 1 up:standby 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:04 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:05.283 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:03:05 smithi082 systemd[1]: Starting Ceph mds.k for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:05.558 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:05 smithi082 ceph-mon[46774]: Deploying daemon mds.k on smithi082 2024-05-08T20:03:05.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:05 smithi033 ceph-mon[42490]: Deploying daemon mds.k on smithi082 2024-05-08T20:03:05.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:05 smithi132 ceph-mon[47484]: Deploying daemon mds.k on smithi082 2024-05-08T20:03:05.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 -- 172.21.15.33:0/1359090722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c10f2e0 msgr2=0x7fcb3c111730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 --2- 172.21.15.33:0/1359090722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c111730 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400b0a0 tx=0x7fcb3400b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 -- 172.21.15.33:0/1359090722 shutdown_connections 2024-05-08T20:03:05.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 --2- 172.21.15.33:0/1359090722 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c111730 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 --2- 172.21.15.33:0/1359090722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c072d10 0x7fcb3c107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 --2- 172.21.15.33:0/1359090722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3c1084e0 0x7fcb3c108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 -- 172.21.15.33:0/1359090722 >> 172.21.15.33:0/1359090722 conn(0x7fcb3c06e040 msgr2=0x7fcb3c070480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 -- 172.21.15.33:0/1359090722 shutdown_connections 2024-05-08T20:03:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.881+0000 7fcb414c9700 1 -- 172.21.15.33:0/1359090722 wait complete. 2024-05-08T20:03:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 Processor -- start 2024-05-08T20:03:05.872 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 -- start start 2024-05-08T20:03:05.873 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:03:05 smithi082 ceph-mds[82537]: -- 172.21.15.82:0/4006905580 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5593a680e1a0 con 0x5593a67e4800 2024-05-08T20:03:05.873 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:03:05 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-k[82514]: starting mds.k at 2024-05-08T20:03:05.873 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:03:05 smithi082 bash[82499]: ffb185bc9fe427d614b88e20d8b7f819c13193f79aa990618efffcdc51c120ed 2024-05-08T20:03:05.873 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:03:05 smithi082 systemd[1]: Started Ceph mds.k for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3c072d10 0x7fcb3c19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c1084e0 0x7fcb3c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c1a6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:05.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c1a7320 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c1a7460 con 0x7fcb3c1084e0 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb414c9700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3c1a75f0 con 0x7fcb3c072d10 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb3b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c1a6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb3b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c1a6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48286/0 (socket says 172.21.15.33:48286) 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb3b7fe700 1 -- 172.21.15.33:0/715191757 learned_addr learned my addr 172.21.15.33:0/715191757 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.882+0000 7fcb3a7fc700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c1084e0 0x7fcb3c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3affd700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3c072d10 0x7fcb3c19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3b7fe700 1 -- 172.21.15.33:0/715191757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3c072d10 msgr2=0x7fcb3c19f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3b7fe700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3c072d10 0x7fcb3c19f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3b7fe700 1 -- 172.21.15.33:0/715191757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c1084e0 msgr2=0x7fcb3c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3b7fe700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c1084e0 0x7fcb3c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:05.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3b7fe700 1 -- 172.21.15.33:0/715191757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb34009d00 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3affd700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3c072d10 0x7fcb3c19f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb3b7fe700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c1a6d50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcb340062a0 tx=0x7fcb3400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb23fff700 1 -- 172.21.15.33:0/715191757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400e040 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb23fff700 1 -- 172.21.15.33:0/715191757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcb34004c60 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3c1a7870 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb23fff700 1 -- 172.21.15.33:0/715191757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34004630 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.883+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3c1a7d80 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.885+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3c10e180 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.886+0000 7fcb23fff700 1 -- 172.21.15.33:0/715191757 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcb34004790 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.886+0000 7fcb23fff700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcb240a1120 0x7fcb240a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.886+0000 7fcb3affd700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcb240a1120 0x7fcb240a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.887+0000 7fcb23fff700 1 -- 172.21.15.33:0/715191757 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcb340cd460 con 0x7fcb3c10f2e0 2024-05-08T20:03:05.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.887+0000 7fcb3affd700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcb240a1120 0x7fcb240a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009cb0 tx=0x7fcb2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:05.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:05.894+0000 7fcb23fff700 1 -- 172.21.15.33:0/715191757 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcb34097080 con 0x7fcb3c10f2e0 2024-05-08T20:03:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.183+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb3c067c10 con 0x7fcb3c10f2e0 2024-05-08T20:03:06.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.183+0000 7fcb23fff700 1 -- 172.21.15.33:0/715191757 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7fcb3409a6a0 con 0x7fcb3c10f2e0 2024-05-08T20:03:06.173 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:06.173 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-08T20:03:06.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcb240a1120 msgr2=0x7fcb240a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcb240a1120 0x7fcb240a35e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009cb0 tx=0x7fcb2c009260 comp rx=0 tx=0).stop 2024-05-08T20:03:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c10f2e0 msgr2=0x7fcb3c1a6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c1a6d50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcb340062a0 tx=0x7fcb3400bce0 comp rx=0 tx=0).stop 2024-05-08T20:03:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 shutdown_connections 2024-05-08T20:03:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb3c10f2e0 0x7fcb3c1a6d50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:06.177 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcb240a1120 0x7fcb240a35e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3c072d10 0x7fcb3c19f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 --2- 172.21.15.33:0/715191757 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb3c1084e0 0x7fcb3c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.185+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 >> 172.21.15.33:0/715191757 conn(0x7fcb3c06e040 msgr2=0x7fcb3c10b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.186+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 shutdown_connections 2024-05-08T20:03:06.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:06.186+0000 7fcb414c9700 1 -- 172.21.15.33:0/715191757 wait complete. 2024-05-08T20:03:06.179 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:06 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/715191757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:06.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:06 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/715191757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:06 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/715191757' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:07.071 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:03:06 smithi033 systemd[1]: Starting Ceph mds.j for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:07.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:07 smithi033 ceph-mon[42490]: Deploying daemon mds.j on smithi033 2024-05-08T20:03:07.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:07 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6832/3776468536,v1:172.21.15.82:6833/3776468536] up:boot 2024-05-08T20:03:07.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:07 smithi033 ceph-mon[42490]: fsmap 2 up:standby 2024-05-08T20:03:07.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:07 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T20:03:07.571 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:03:07 smithi033 ceph-mds[92735]: -- 172.21.15.33:0/2624871933 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564d3f8d01a0 con 0x564d3f8a6800 2024-05-08T20:03:07.571 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:03:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-j[92712]: starting mds.j at 2024-05-08T20:03:07.571 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:03:07 smithi033 bash[92697]: b3fca6100c8c3a20488a82ddd4f714386a8feed5bd9eea9563ec3a2eb447a548 2024-05-08T20:03:07.571 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:03:07 smithi033 systemd[1]: Started Ceph mds.j for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:07.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:07 smithi082 ceph-mon[46774]: Deploying daemon mds.j on smithi033 2024-05-08T20:03:07.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:07 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6832/3776468536,v1:172.21.15.82:6833/3776468536] up:boot 2024-05-08T20:03:07.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:07 smithi082 ceph-mon[46774]: fsmap 2 up:standby 2024-05-08T20:03:07.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:07 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T20:03:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:07 smithi132 ceph-mon[47484]: Deploying daemon mds.j on smithi033 2024-05-08T20:03:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:07 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6832/3776468536,v1:172.21.15.82:6833/3776468536] up:boot 2024-05-08T20:03:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:07 smithi132 ceph-mon[47484]: fsmap 2 up:standby 2024-05-08T20:03:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:07 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T20:03:08.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 -- 172.21.15.33:0/4258862815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448101fc0 msgr2=0x7f1448102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 --2- 172.21.15.33:0/4258862815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448101fc0 0x7f1448102440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1438009990 tx=0x7f1438009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 -- 172.21.15.33:0/4258862815 shutdown_connections 2024-05-08T20:03:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 --2- 172.21.15.33:0/4258862815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1448102980 0x7f14481092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 --2- 172.21.15.33:0/4258862815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1448100e70 0x7f1448101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.348 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 --2- 172.21.15.33:0/4258862815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448101fc0 0x7f1448102440 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 -- 172.21.15.33:0/4258862815 >> 172.21.15.33:0/4258862815 conn(0x7f14480fc400 msgr2=0x7f14480fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 -- 172.21.15.33:0/4258862815 shutdown_connections 2024-05-08T20:03:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.358+0000 7f144d671700 1 -- 172.21.15.33:0/4258862815 wait complete. 2024-05-08T20:03:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 Processor -- start 2024-05-08T20:03:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 -- start start 2024-05-08T20:03:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1448100e70 0x7f1448074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1448101fc0 0x7f1448073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448102980 0x7f14480738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:08.351 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448074070 con 0x7f1448102980 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480741e0 con 0x7f1448100e70 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.359+0000 7f144d671700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14481a0e60 con 0x7f1448101fc0 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448102980 0x7f14480738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448102980 0x7f14480738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48308/0 (socket says 172.21.15.33:48308) 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 -- 172.21.15.33:0/1052481535 learned_addr learned my addr 172.21.15.33:0/1052481535 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f1446ffd700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1448100e70 0x7f1448074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14467fc700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1448101fc0 0x7f1448073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 -- 172.21.15.33:0/1052481535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1448101fc0 msgr2=0x7f1448073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:08.352 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1448101fc0 0x7f1448073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 -- 172.21.15.33:0/1052481535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1448100e70 msgr2=0x7f1448074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1448100e70 0x7f1448074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 -- 172.21.15.33:0/1052481535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14380095f0 con 0x7f1448102980 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f14477fe700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448102980 0x7f14480738d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f144000ef30 tx=0x7f144000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f143ffff700 1 -- 172.21.15.33:0/1052481535 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440018070 con 0x7f1448102980 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14481a1090 con 0x7f1448102980 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f143ffff700 1 -- 172.21.15.33:0/1052481535 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f144000f040 con 0x7f1448102980 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f143ffff700 1 -- 172.21.15.33:0/1052481535 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000cda0 con 0x7f1448102980 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.360+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14481a1550 con 0x7f1448102980 2024-05-08T20:03:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.361+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14481081b0 con 0x7f1448102980 2024-05-08T20:03:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.363+0000 7f143ffff700 1 -- 172.21.15.33:0/1052481535 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1440003a00 con 0x7f1448102980 2024-05-08T20:03:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.363+0000 7f143ffff700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14340a1120 0x7f14340a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:08.354 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.364+0000 7f143ffff700 1 -- 172.21.15.33:0/1052481535 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f14400cca80 con 0x7f1448102980 2024-05-08T20:03:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.364+0000 7f1446ffd700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14340a1120 0x7f14340a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:08.355 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.364+0000 7f1446ffd700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14340a1120 0x7f14340a35e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f143000ac50 tx=0x7f143000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:08.356 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.367+0000 7f143ffff700 1 -- 172.21.15.33:0/1052481535 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f14400966a0 con 0x7f1448102980 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.33:6834/737673799,v1:172.21.15.33:6835/737673799] up:boot 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: fsmap 3 up:standby 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:08.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:08 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:08.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.33:6834/737673799,v1:172.21.15.33:6835/737673799] up:boot 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: fsmap 3 up:standby 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:08 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.33:6834/737673799,v1:172.21.15.33:6835/737673799] up:boot 2024-05-08T20:03:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: fsmap 3 up:standby 2024-05-08T20:03:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T20:03:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:08.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:08.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:08.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:08 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:08.651 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.661+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1448068060 con 0x7f1448102980 2024-05-08T20:03:08.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.661+0000 7f143ffff700 1 -- 172.21.15.33:0/1052481535 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2771 (secure 0 0 0) 0x7f1440099cc0 con 0x7f1448102980 2024-05-08T20:03:08.652 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:08.652 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-08T20:03:08.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14340a1120 msgr2=0x7f14340a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:08.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14340a1120 0x7f14340a35e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f143000ac50 tx=0x7f143000a380 comp rx=0 tx=0).stop 2024-05-08T20:03:08.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448102980 msgr2=0x7f14480738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448102980 0x7f14480738d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f144000ef30 tx=0x7f144000c3a0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 shutdown_connections 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1448102980 0x7f14480738d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1448100e70 0x7f1448074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f14340a1120 0x7f14340a35e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 --2- 172.21.15.33:0/1052481535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1448101fc0 0x7f1448073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 >> 172.21.15.33:0/1052481535 conn(0x7f14480fc400 msgr2=0x7f14481052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 shutdown_connections 2024-05-08T20:03:08.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:08.664+0000 7f144d671700 1 -- 172.21.15.33:0/1052481535 wait complete. 2024-05-08T20:03:08.655 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 4 2024-05-08T20:03:08.997 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:03:08 smithi033 systemd[1]: Starting Ceph mds.d for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: Deploying daemon mds.d on smithi033 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1052481535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:09.571 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:03:09 smithi033 bash[93085]: 3ba253e19eaeb2e29de488539be3346656e983416c4d86135689659bcd740baa 2024-05-08T20:03:09.572 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:03:09 smithi033 systemd[1]: Started Ceph mds.d for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:09.572 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:03:09 smithi033 ceph-mds[93123]: -- 172.21.15.33:0/95459473 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5604158321a0 con 0x560415808c00 2024-05-08T20:03:09.572 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:03:09 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-d[93100]: starting mds.d at 2024-05-08T20:03:09.610 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: Deploying daemon mds.d on smithi033 2024-05-08T20:03:09.610 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1052481535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:09.610 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.610 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.611 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.611 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:09.611 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:09.611 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:09 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: Deploying daemon mds.d on smithi033 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1052481535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:09.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:09 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:10.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:10 smithi033 ceph-mon[42490]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:10 smithi033 ceph-mon[42490]: Deploying daemon mds.e on smithi082 2024-05-08T20:03:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:10 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.33:6836/2880897493,v1:172.21.15.33:6837/2880897493] up:boot 2024-05-08T20:03:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:10 smithi033 ceph-mon[42490]: fsmap 4 up:standby 2024-05-08T20:03:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:10 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T20:03:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:10 smithi082 ceph-mon[46774]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:10 smithi082 ceph-mon[46774]: Deploying daemon mds.e on smithi082 2024-05-08T20:03:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:10 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.33:6836/2880897493,v1:172.21.15.33:6837/2880897493] up:boot 2024-05-08T20:03:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:10 smithi082 ceph-mon[46774]: fsmap 4 up:standby 2024-05-08T20:03:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:10 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T20:03:10.623 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:03:10 smithi082 systemd[1]: Starting Ceph mds.e for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:10 smithi132 ceph-mon[47484]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:10 smithi132 ceph-mon[47484]: Deploying daemon mds.e on smithi082 2024-05-08T20:03:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:10 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.33:6836/2880897493,v1:172.21.15.33:6837/2880897493] up:boot 2024-05-08T20:03:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:10 smithi132 ceph-mon[47484]: fsmap 4 up:standby 2024-05-08T20:03:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:10 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T20:03:10.669 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 -- 172.21.15.33:0/2514921219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 msgr2=0x7f2e28102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/2514921219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28102440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e18009990 tx=0x7f2e18009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 -- 172.21.15.33:0/2514921219 shutdown_connections 2024-05-08T20:03:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/2514921219 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e28102980 0x7f2e281092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/2514921219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e28100e70 0x7f2e28101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/2514921219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28102440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 -- 172.21.15.33:0/2514921219 >> 172.21.15.33:0/2514921219 conn(0x7f2e280fc400 msgr2=0x7f2e280fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 -- 172.21.15.33:0/2514921219 shutdown_connections 2024-05-08T20:03:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.832+0000 7f2e2ce95700 1 -- 172.21.15.33:0/2514921219 wait complete. 2024-05-08T20:03:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.833+0000 7f2e2ce95700 1 Processor -- start 2024-05-08T20:03:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.833+0000 7f2e2ce95700 1 -- start start 2024-05-08T20:03:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.833+0000 7f2e2ce95700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e28100e70 0x7f2e28196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.833+0000 7f2e2ce95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.833+0000 7f2e2ce95700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e28102980 0x7f2e2819e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e2ce95700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2819ea30 con 0x7f2e28101fc0 2024-05-08T20:03:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e2ce95700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2819eb70 con 0x7f2e28100e70 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e2ce95700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2819ed00 con 0x7f2e28102980 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48348/0 (socket says 172.21.15.33:48348) 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e2659c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e28100e70 0x7f2e28196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 -- 172.21.15.33:0/3100942312 learned_addr learned my addr 172.21.15.33:0/3100942312 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e26d9d700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e28102980 0x7f2e2819e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 -- 172.21.15.33:0/3100942312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e28102980 msgr2=0x7f2e2819e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e28102980 0x7f2e2819e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 -- 172.21.15.33:0/3100942312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e28100e70 msgr2=0x7f2e28196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e28100e70 0x7f2e28196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 -- 172.21.15.33:0/3100942312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e180095f0 con 0x7f2e28101fc0 2024-05-08T20:03:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e26d9d700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e28102980 0x7f2e2819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e25d9b700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28197440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800b720 tx=0x7f2e18009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e1f7fe700 1 -- 172.21.15.33:0/3100942312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1801d070 con 0x7f2e28101fc0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2819ef80 con 0x7f2e28101fc0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e1f7fe700 1 -- 172.21.15.33:0/3100942312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2e1800be70 con 0x7f2e28101fc0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e1f7fe700 1 -- 172.21.15.33:0/3100942312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18017650 con 0x7f2e28101fc0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.834+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2819f340 con 0x7f2e28101fc0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.835+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e28108290 con 0x7f2e28101fc0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.836+0000 7f2e1f7fe700 1 -- 172.21.15.33:0/3100942312 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2e18022470 con 0x7f2e28101fc0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.837+0000 7f2e1f7fe700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2e140a1120 0x7f2e140a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.837+0000 7f2e2659c700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2e140a1120 0x7f2e140a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.837+0000 7f2e1f7fe700 1 -- 172.21.15.33:0/3100942312 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2e180cdd20 con 0x7f2e28101fc0 2024-05-08T20:03:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.838+0000 7f2e2659c700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2e140a1120 0x7f2e140a35e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e10005950 tx=0x7f2e1000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:10.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:10.841+0000 7f2e1f7fe700 1 -- 172.21.15.33:0/3100942312 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2e180979e0 con 0x7f2e28101fc0 2024-05-08T20:03:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.111+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e28067380 con 0x7f2e28101fc0 2024-05-08T20:03:11.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.112+0000 7f2e1f7fe700 1 -- 172.21.15.33:0/3100942312 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3528 (secure 0 0 0) 0x7f2e1809b000 con 0x7f2e28101fc0 2024-05-08T20:03:11.101 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:11.102 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5}],"filesystems":[]} 2024-05-08T20:03:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2e140a1120 msgr2=0x7f2e140a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2e140a1120 0x7f2e140a35e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2e10005950 tx=0x7f2e1000b410 comp rx=0 tx=0).stop 2024-05-08T20:03:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 msgr2=0x7f2e28197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28197440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e1800b720 tx=0x7f2e18009580 comp rx=0 tx=0).stop 2024-05-08T20:03:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 shutdown_connections 2024-05-08T20:03:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2e140a1120 0x7f2e140a35e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:11.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e28102980 0x7f2e2819e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e28100e70 0x7f2e28196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 --2- 172.21.15.33:0/3100942312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2e28101fc0 0x7f2e28197440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 >> 172.21.15.33:0/3100942312 conn(0x7f2e280fc400 msgr2=0x7f2e281053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 shutdown_connections 2024-05-08T20:03:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:11.114+0000 7f2e2ce95700 1 -- 172.21.15.33:0/3100942312 wait complete. 2024-05-08T20:03:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 5 2024-05-08T20:03:11.121 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:03:10 smithi082 ceph-mds[82879]: -- 172.21.15.82:0/3303099625 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b104f4e1a0 con 0x55b104f24800 2024-05-08T20:03:11.121 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:03:10 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-e[82856]: starting mds.e at 2024-05-08T20:03:11.121 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:03:10 smithi082 bash[82841]: 8a0628489a2d64e0ea2cf4055dbb1d4a238801c97aba661ae82d3327ad09c4e7 2024-05-08T20:03:11.121 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:03:10 smithi082 systemd[1]: Started Ceph mds.e for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:12.182 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: Deploying daemon mds.f on smithi132 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3100942312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6834/120986217,v1:172.21.15.82:6835/120986217] up:boot 2024-05-08T20:03:12.183 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: fsmap 5 up:standby 2024-05-08T20:03:12.184 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:11 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:03:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: Deploying daemon mds.f on smithi132 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3100942312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6834/120986217,v1:172.21.15.82:6835/120986217] up:boot 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: fsmap 5 up:standby 2024-05-08T20:03:12.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:11 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:03:12.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: Deploying daemon mds.f on smithi132 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3100942312' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:12.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6834/120986217,v1:172.21.15.82:6835/120986217] up:boot 2024-05-08T20:03:12.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: fsmap 5 up:standby 2024-05-08T20:03:12.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:11 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:03:12.445 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:03:12 smithi132 systemd[1]: Starting Ceph mds.f for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:12.874 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:03:12 smithi132 ceph-mds[82686]: -- 172.21.15.132:0/3639470863 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558dbaf4e1a0 con 0x558dbaf25000 2024-05-08T20:03:12.874 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:03:12 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-f[82663]: starting mds.f at 2024-05-08T20:03:12.874 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:03:12 smithi132 bash[82649]: 27cc1c23cab7fa236c1bd155ac19d45701f44703bfb080a15f7fee7e3f842bb6 2024-05-08T20:03:12.874 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:03:12 smithi132 systemd[1]: Started Ceph mds.f for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:13.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:13.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 -- 172.21.15.33:0/3430222064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 msgr2=0x7ff1d4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/3430222064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4100180 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff1c40099c0 tx=0x7ff1c4009cd0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 -- 172.21.15.33:0/3430222064 shutdown_connections 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/3430222064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d41018f0 0x7ff1d41081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/3430222064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4100180 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/3430222064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1d4100f50 0x7ff1d41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 -- 172.21.15.33:0/3430222064 >> 172.21.15.33:0/3430222064 conn(0x7ff1d40fb2f0 msgr2=0x7ff1d40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 -- 172.21.15.33:0/3430222064 shutdown_connections 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 -- 172.21.15.33:0/3430222064 wait complete. 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.276+0000 7ff1d9b32700 1 Processor -- start 2024-05-08T20:03:13.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d9b32700 1 -- start start 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d9b32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d9b32700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1d4100f50 0x7ff1d4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d9b32700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d41018f0 0x7ff1d41a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d9b32700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d41a0c60 con 0x7ff1d40ffd60 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d9b32700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d41a0da0 con 0x7ff1d41018f0 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d9b32700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d41a0f30 con 0x7ff1d4100f50 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52248/0 (socket says 172.21.15.33:52248) 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 -- 172.21.15.33:0/1674063873 learned_addr learned my addr 172.21.15.33:0/1674063873 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d2ffd700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1d4100f50 0x7ff1d4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d3fff700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d41018f0 0x7ff1d41a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 -- 172.21.15.33:0/1674063873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1d4100f50 msgr2=0x7ff1d4199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1d4100f50 0x7ff1d4199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 -- 172.21.15.33:0/1674063873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d41018f0 msgr2=0x7ff1d41a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d41018f0 0x7ff1d41a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 -- 172.21.15.33:0/1674063873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c40095f0 con 0x7ff1d40ffd60 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d3fff700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d41018f0 0x7ff1d41a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d37fe700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4199130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4006010 tx=0x7ff1c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.277+0000 7ff1d0ff9700 1 -- 172.21.15.33:0/1674063873 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c401d070 con 0x7ff1d40ffd60 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.278+0000 7ff1d0ff9700 1 -- 172.21.15.33:0/1674063873 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff1c4004160 con 0x7ff1d40ffd60 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.278+0000 7ff1d0ff9700 1 -- 172.21.15.33:0/1674063873 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c40052b0 con 0x7ff1d40ffd60 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.278+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d41a11b0 con 0x7ff1d40ffd60 2024-05-08T20:03:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.278+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d41a1580 con 0x7ff1d40ffd60 2024-05-08T20:03:13.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.279+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d4067c10 con 0x7ff1d40ffd60 2024-05-08T20:03:13.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.280+0000 7ff1d0ff9700 1 -- 172.21.15.33:0/1674063873 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7ff1c40049e0 con 0x7ff1d40ffd60 2024-05-08T20:03:13.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.280+0000 7ff1d0ff9700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff1bc0a1120 0x7ff1bc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:13.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.281+0000 7ff1d2ffd700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff1bc0a1120 0x7ff1bc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:13.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.281+0000 7ff1d0ff9700 1 -- 172.21.15.33:0/1674063873 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff1c40cd600 con 0x7ff1d40ffd60 2024-05-08T20:03:13.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.281+0000 7ff1d2ffd700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff1bc0a1120 0x7ff1bc0a35e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009a10 tx=0x7ff1c8009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:13.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.284+0000 7ff1d0ff9700 1 -- 172.21.15.33:0/1674063873 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff1c4097220 con 0x7ff1d40ffd60 2024-05-08T20:03:13.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.550+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1d410b730 con 0x7ff1d40ffd60 2024-05-08T20:03:13.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.551+0000 7ff1d0ff9700 1 -- 172.21.15.33:0/1674063873 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5042 (secure 0 0 0) 0x7ff1c409a840 con 0x7ff1d40ffd60 2024-05-08T20:03:13.540 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:13.540 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff1bc0a1120 msgr2=0x7ff1bc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff1bc0a1120 0x7ff1bc0a35e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8009a10 tx=0x7ff1c8009190 comp rx=0 tx=0).stop 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 msgr2=0x7ff1d4199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4199130 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff1c4006010 tx=0x7ff1c4004730 comp rx=0 tx=0).stop 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 shutdown_connections 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff1d41018f0 0x7ff1d41a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1d40ffd60 0x7ff1d4199130 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff1bc0a1120 0x7ff1bc0a35e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 --2- 172.21.15.33:0/1674063873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1d4100f50 0x7ff1d4199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 >> 172.21.15.33:0/1674063873 conn(0x7ff1d40fb2f0 msgr2=0x7ff1d4067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 shutdown_connections 2024-05-08T20:03:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:13.553+0000 7ff1d9b32700 1 -- 172.21.15.33:0/1674063873 wait complete. 2024-05-08T20:03:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 7 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: Deploying daemon mds.c on smithi132 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.132:6834/3702888214,v1:172.21.15.132:6835/3702888214] up:boot 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: fsmap 6 up:standby 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:13.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:13 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1674063873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:13.900 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:03:13 smithi132 systemd[1]: Starting Ceph mds.c for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: Deploying daemon mds.c on smithi132 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.132:6834/3702888214,v1:172.21.15.132:6835/3702888214] up:boot 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: fsmap 6 up:standby 2024-05-08T20:03:13.901 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T20:03:13.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:13.902 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:13 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1674063873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:14.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: Deploying daemon mds.c on smithi132 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.132:6834/3702888214,v1:172.21.15.132:6835/3702888214] up:boot 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: fsmap 6 up:standby 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:14.122 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:13 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1674063873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:14.624 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:03:14 smithi132 ceph-mds[83026]: -- 172.21.15.132:0/513897962 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556af18e21a0 con 0x556af18b8800 2024-05-08T20:03:14.624 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:03:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-c[83003]: starting mds.c at 2024-05-08T20:03:14.624 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:03:14 smithi132 bash[82987]: 2ff95c276123c6fce7f470dc714f6a843418a4944e2f70187baee037e181e7d2 2024-05-08T20:03:14.624 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:03:14 smithi132 systemd[1]: Started Ceph mds.c for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:15.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] up:boot 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: fsmap 7 up:standby 2024-05-08T20:03:15.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:15 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] up:boot 2024-05-08T20:03:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: fsmap 7 up:standby 2024-05-08T20:03:15.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:15 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:03:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 -- 172.21.15.33:0/2061545939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0106b60 msgr2=0x7fbbd0108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 --2- 172.21.15.33:0/2061545939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0106b60 0x7fbbd0108fd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800b0a0 tx=0x7fbbc800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 -- 172.21.15.33:0/2061545939 shutdown_connections 2024-05-08T20:03:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 --2- 172.21.15.33:0/2061545939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0106b60 0x7fbbd0108fd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 --2- 172.21.15.33:0/2061545939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd0101900 0x7fbbd0103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 --2- 172.21.15.33:0/2061545939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd0104230 0x7fbbd0106620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 -- 172.21.15.33:0/2061545939 >> 172.21.15.33:0/2061545939 conn(0x7fbbd00fb2f0 msgr2=0x7fbbd00fd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.714+0000 7fbbd5251700 1 -- 172.21.15.33:0/2061545939 shutdown_connections 2024-05-08T20:03:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.715+0000 7fbbd5251700 1 -- 172.21.15.33:0/2061545939 wait complete. 2024-05-08T20:03:15.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.715+0000 7fbbd5251700 1 Processor -- start 2024-05-08T20:03:15.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbd5251700 1 -- start start 2024-05-08T20:03:15.707 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbd5251700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd0101900 0x7fbbd0196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbd5251700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0104230 0x7fbbd0197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbd5251700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd0106b60 0x7fbbd019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbd5251700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd019eb10 con 0x7fbbd0104230 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbd5251700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd019ec50 con 0x7fbbd0101900 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbd5251700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd019ede0 con 0x7fbbd0106b60 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0104230 0x7fbbd0197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0104230 0x7fbbd0197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52258/0 (socket says 172.21.15.33:52258) 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbced9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd0101900 0x7fbbd0196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 -- 172.21.15.33:0/362323576 learned_addr learned my addr 172.21.15.33:0/362323576 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbcf59e700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd0106b60 0x7fbbd019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 -- 172.21.15.33:0/362323576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd0106b60 msgr2=0x7fbbd019e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd0106b60 0x7fbbd019e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 -- 172.21.15.33:0/362323576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd0101900 msgr2=0x7fbbd0196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd0101900 0x7fbbd0196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 -- 172.21.15.33:0/362323576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc0009520 con 0x7fbbd0104230 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbced9d700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd0101900 0x7fbbd0196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.716+0000 7fbbce59c700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0104230 0x7fbbd0197520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800d980 tx=0x7fbbb800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.717+0000 7fbbc7fff700 1 -- 172.21.15.33:0/362323576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8004220 con 0x7fbbd0104230 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.717+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8009d00 con 0x7fbbd0104230 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.717+0000 7fbbc7fff700 1 -- 172.21.15.33:0/362323576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbbb8007640 con 0x7fbbd0104230 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.717+0000 7fbbc7fff700 1 -- 172.21.15.33:0/362323576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8005720 con 0x7fbbd0104230 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.717+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd019f490 con 0x7fbbd0104230 2024-05-08T20:03:15.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.718+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd00fce70 con 0x7fbbd0104230 2024-05-08T20:03:15.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.719+0000 7fbbc7fff700 1 -- 172.21.15.33:0/362323576 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fbbb8004410 con 0x7fbbd0104230 2024-05-08T20:03:15.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.719+0000 7fbbc7fff700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbbbc0a1120 0x7fbbbc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:15.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.720+0000 7fbbced9d700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbbbc0a1120 0x7fbbbc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:15.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.720+0000 7fbbc7fff700 1 -- 172.21.15.33:0/362323576 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbbb80cc340 con 0x7fbbd0104230 2024-05-08T20:03:15.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.720+0000 7fbbced9d700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbbbc0a1120 0x7fbbbc0a35e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009fd0 tx=0x7fbbc0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:15.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.724+0000 7fbbc7fff700 1 -- 172.21.15.33:0/362323576 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbbb8095ed0 con 0x7fbbd0104230 2024-05-08T20:03:15.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:15.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:15.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:15.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:15.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] up:boot 2024-05-08T20:03:15.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: fsmap 7 up:standby 2024-05-08T20:03:15.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:15 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:03:15.882 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:03:15 smithi082 systemd[1]: Starting Ceph mds.h for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.991+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbd0068060 con 0x7fbbd0104230 2024-05-08T20:03:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.992+0000 7fbbc7fff700 1 -- 172.21.15.33:0/362323576 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5799 (secure 0 0 0) 0x7fbbb80994f0 con 0x7fbbd0104230 2024-05-08T20:03:15.981 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:15.981 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2024-05-08T20:03:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbbbc0a1120 msgr2=0x7fbbbc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbbbc0a1120 0x7fbbbc0a35e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbc0009fd0 tx=0x7fbbc0009260 comp rx=0 tx=0).stop 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0104230 msgr2=0x7fbbd0197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0104230 0x7fbbd0197520 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbbb800d980 tx=0x7fbbb800dc90 comp rx=0 tx=0).stop 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 shutdown_connections 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbbbc0a1120 0x7fbbbc0a35e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd0106b60 0x7fbbd019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbbd0101900 0x7fbbd0196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 --2- 172.21.15.33:0/362323576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbd0104230 0x7fbbd0197520 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 >> 172.21.15.33:0/362323576 conn(0x7fbbd00fb2f0 msgr2=0x7fbbd0102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 shutdown_connections 2024-05-08T20:03:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:15.994+0000 7fbbd5251700 1 -- 172.21.15.33:0/362323576 wait complete. 2024-05-08T20:03:15.985 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2024-05-08T20:03:16.370 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mds[83222]: -- 172.21.15.82:0/70924255 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560cb95d01a0 con 0x560cb95a6800 2024-05-08T20:03:16.371 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:03:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: starting mds.h at 2024-05-08T20:03:16.371 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:03:16 smithi082 bash[83184]: 98d3fe716c11a57e779b7f85c6da8d15f2c6d8760f5d9bbe5884545c0b60bd03 2024-05-08T20:03:16.371 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:03:16 smithi082 systemd[1]: Started Ceph mds.h for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: Deploying daemon mds.h on smithi082 2024-05-08T20:03:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/362323576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:16 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: Deploying daemon mds.h on smithi082 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/362323576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:16 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:16.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: Deploying daemon mds.h on smithi082 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/362323576' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:16.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:16 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:17.624 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:03:17 smithi132 systemd[1]: Starting Ceph mds.i for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:17.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:17 smithi132 ceph-mon[47484]: Deploying daemon mds.i on smithi132 2024-05-08T20:03:17.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6836/84840757,v1:172.21.15.82:6837/84840757] up:boot 2024-05-08T20:03:17.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:17 smithi132 ceph-mon[47484]: fsmap 8 up:standby 2024-05-08T20:03:17.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:17 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:03:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:17 smithi033 ceph-mon[42490]: Deploying daemon mds.i on smithi132 2024-05-08T20:03:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6836/84840757,v1:172.21.15.82:6837/84840757] up:boot 2024-05-08T20:03:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:17 smithi033 ceph-mon[42490]: fsmap 8 up:standby 2024-05-08T20:03:17.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:17 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:03:17.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:17 smithi082 ceph-mon[46774]: Deploying daemon mds.i on smithi132 2024-05-08T20:03:17.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6836/84840757,v1:172.21.15.82:6837/84840757] up:boot 2024-05-08T20:03:17.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:17 smithi082 ceph-mon[46774]: fsmap 8 up:standby 2024-05-08T20:03:17.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:17 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:03:17.998 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 -- 172.21.15.33:0/1869879921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 msgr2=0x7f1190103d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 --2- 172.21.15.33:0/1869879921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190103d30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1180009990 tx=0x7f1180009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 -- 172.21.15.33:0/1869879921 shutdown_connections 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 --2- 172.21.15.33:0/1869879921 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1190106ba0 0x7f1190108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 --2- 172.21.15.33:0/1869879921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190103d30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 --2- 172.21.15.33:0/1869879921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1190104270 0x7f1190106660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 -- 172.21.15.33:0/1869879921 >> 172.21.15.33:0/1869879921 conn(0x7f11900fb2f0 msgr2=0x7f11900fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 -- 172.21.15.33:0/1869879921 shutdown_connections 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 -- 172.21.15.33:0/1869879921 wait complete. 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.161+0000 7f1196368700 1 Processor -- start 2024-05-08T20:03:18.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1196368700 1 -- start start 2024-05-08T20:03:18.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1196368700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1196368700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1190104270 0x7f11900ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1196368700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1190106ba0 0x7f11900ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1196368700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190100530 con 0x7f1190101940 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1196368700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11901006a0 con 0x7f1190106ba0 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1196368700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11901a0ef0 con 0x7f1190104270 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52280/0 (socket says 172.21.15.33:52280) 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 -- 172.21.15.33:0/1898356273 learned_addr learned my addr 172.21.15.33:0/1898356273 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f1194905700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1190106ba0 0x7f11900ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118f7fe700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1190104270 0x7f11900ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 -- 172.21.15.33:0/1898356273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1190104270 msgr2=0x7f11900ff8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1190104270 0x7f11900ff8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 -- 172.21.15.33:0/1898356273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1190106ba0 msgr2=0x7f11900ffe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1190106ba0 0x7f11900ffe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.162+0000 7f118ffff700 1 -- 172.21.15.33:0/1898356273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800095f0 con 0x7f1190101940 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.163+0000 7f118ffff700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190101210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f118000b5c0 tx=0x7f118000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.163+0000 7f118d7fa700 1 -- 172.21.15.33:0/1898356273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118001d070 con 0x7f1190101940 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.163+0000 7f118d7fa700 1 -- 172.21.15.33:0/1898356273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1180022470 con 0x7f1190101940 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.163+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11901a10f0 con 0x7f1190101940 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.163+0000 7f118d7fa700 1 -- 172.21.15.33:0/1898356273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180017650 con 0x7f1190101940 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.163+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11901a1510 con 0x7f1190101940 2024-05-08T20:03:18.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.164+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11900fce70 con 0x7f1190101940 2024-05-08T20:03:18.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.165+0000 7f118d7fa700 1 -- 172.21.15.33:0/1898356273 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f11800225e0 con 0x7f1190101940 2024-05-08T20:03:18.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.166+0000 7f118d7fa700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f11780a1120 0x7f11780a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:18.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.166+0000 7f118f7fe700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f11780a1120 0x7f11780a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:18.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.166+0000 7f118d7fa700 1 -- 172.21.15.33:0/1898356273 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f11800cdea0 con 0x7f1190101940 2024-05-08T20:03:18.156 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.166+0000 7f118f7fe700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f11780a1120 0x7f11780a35e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1184005950 tx=0x7f118400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:18.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.173+0000 7f118d7fa700 1 -- 172.21.15.33:0/1898356273 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1180097ac0 con 0x7f1190101940 2024-05-08T20:03:18.374 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:03:17 smithi132 ceph-mds[83370]: -- 172.21.15.132:0/2197387790 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5654d7e201a0 con 0x5654d7df6c00 2024-05-08T20:03:18.374 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:03:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i[83347]: starting mds.i at 2024-05-08T20:03:18.374 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:03:17 smithi132 bash[83332]: 533fe21632a109420ead581933e7a60ac5bdda54284b0cc22468584a07f0d379 2024-05-08T20:03:18.374 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:03:17 smithi132 systemd[1]: Started Ceph mds.i for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:18.439 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.450+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1190067c10 con 0x7f1190101940 2024-05-08T20:03:18.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.451+0000 7f118d7fa700 1 -- 172.21.15.33:0/1898356273 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6550 (secure 0 0 0) 0x7f118009b0e0 con 0x7f1190101940 2024-05-08T20:03:18.440 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:18.440 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f11780a1120 msgr2=0x7f11780a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f11780a1120 0x7f11780a35e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1184005950 tx=0x7f118400b410 comp rx=0 tx=0).stop 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 msgr2=0x7f1190101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190101210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f118000b5c0 tx=0x7f118000f690 comp rx=0 tx=0).stop 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 shutdown_connections 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1190106ba0 0x7f11900ffe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1190101940 0x7f1190101210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f11780a1120 0x7f11780a35e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 --2- 172.21.15.33:0/1898356273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1190104270 0x7f11900ff8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:18.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 >> 172.21.15.33:0/1898356273 conn(0x7f11900fb2f0 msgr2=0x7f1190102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:18.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 shutdown_connections 2024-05-08T20:03:18.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:18.453+0000 7f1196368700 1 -- 172.21.15.33:0/1898356273 wait complete. 2024-05-08T20:03:18.444 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 9 2024-05-08T20:03:18.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:18 smithi033 ceph-mon[42490]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:18.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:18.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:18.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:18 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:18.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:18 smithi082 ceph-mon[46774]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:18.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:18 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:18 smithi132 ceph-mon[47484]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:18.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:18 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:19.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:19 smithi033 ceph-mon[42490]: Deploying daemon mds.g on smithi033 2024-05-08T20:03:19.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:19 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1898356273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:19.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:19 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.132:6838/3830178924,v1:172.21.15.132:6839/3830178924] up:boot 2024-05-08T20:03:19.614 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:19 smithi033 ceph-mon[42490]: fsmap 9 up:standby 2024-05-08T20:03:19.615 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:19 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:03:19.615 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:03:19 smithi033 systemd[1]: Starting Ceph mds.g for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:19.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:19 smithi082 ceph-mon[46774]: Deploying daemon mds.g on smithi033 2024-05-08T20:03:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:19 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1898356273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:19 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.132:6838/3830178924,v1:172.21.15.132:6839/3830178924] up:boot 2024-05-08T20:03:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:19 smithi082 ceph-mon[46774]: fsmap 9 up:standby 2024-05-08T20:03:19.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:19 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:03:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:19 smithi132 ceph-mon[47484]: Deploying daemon mds.g on smithi033 2024-05-08T20:03:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:19 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1898356273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:19 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.132:6838/3830178924,v1:172.21.15.132:6839/3830178924] up:boot 2024-05-08T20:03:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:19 smithi132 ceph-mon[47484]: fsmap 9 up:standby 2024-05-08T20:03:19.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:19 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:03:20.071 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:03:19 smithi033 bash[93606]: 5e7dc104afbe28e6f91ba5c42355d8634deffc4f00ef167570288d3eb664e7d5 2024-05-08T20:03:20.071 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:03:19 smithi033 ceph-mds[93644]: -- 172.21.15.33:0/3866936295 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5574c08dc1a0 con 0x5574c08b2800 2024-05-08T20:03:20.071 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:03:19 smithi033 systemd[1]: Started Ceph mds.g for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:20.071 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:03:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-g[93621]: starting mds.g at 2024-05-08T20:03:20.460 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:20 smithi033 ceph-mon[42490]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:20 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 -- 172.21.15.33:0/3646091681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc1018f0 msgr2=0x7faefc103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 --2- 172.21.15.33:0/3646091681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc1018f0 0x7faefc103ce0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faeec009990 tx=0x7faeec009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 -- 172.21.15.33:0/3646091681 shutdown_connections 2024-05-08T20:03:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 --2- 172.21.15.33:0/3646091681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faefc106b50 0x7faefc108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 --2- 172.21.15.33:0/3646091681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc1018f0 0x7faefc103ce0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 --2- 172.21.15.33:0/3646091681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faefc104220 0x7faefc106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 -- 172.21.15.33:0/3646091681 >> 172.21.15.33:0/3646091681 conn(0x7faefc0fb300 msgr2=0x7faefc0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 -- 172.21.15.33:0/3646091681 shutdown_connections 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.623+0000 7faf01cf1700 1 -- 172.21.15.33:0/3646091681 wait complete. 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.624+0000 7faf01cf1700 1 Processor -- start 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.624+0000 7faf01cf1700 1 -- start start 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faf01cf1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faefc1018f0 0x7faefc196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:20.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faf01cf1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc104220 0x7faefc1973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faf01cf1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faefc106b50 0x7faefc19e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faf01cf1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc19e990 con 0x7faefc104220 2024-05-08T20:03:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faf01cf1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc19ead0 con 0x7faefc1018f0 2024-05-08T20:03:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faf01cf1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc19ec60 con 0x7faefc106b50 2024-05-08T20:03:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc104220 0x7faefc1973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc104220 0x7faefc1973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52322/0 (socket says 172.21.15.33:52322) 2024-05-08T20:03:20.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 -- 172.21.15.33:0/708224512 learned_addr learned my addr 172.21.15.33:0/708224512 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefbfff700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faefc106b50 0x7faefc19e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefb7fe700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faefc1018f0 0x7faefc196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 -- 172.21.15.33:0/708224512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faefc106b50 msgr2=0x7faefc19e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faefc106b50 0x7faefc19e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 -- 172.21.15.33:0/708224512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faefc1018f0 msgr2=0x7faefc196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faefc1018f0 0x7faefc196e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 -- 172.21.15.33:0/708224512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0095f0 con 0x7faefc104220 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefb7fe700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faefc1018f0 0x7faefc196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faefaffd700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc104220 0x7faefc1973a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faef000d950 tx=0x7faef000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:20.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faef8ff9700 1 -- 172.21.15.33:0/708224512 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0009940 con 0x7faefc104220 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.625+0000 7faef8ff9700 1 -- 172.21.15.33:0/708224512 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faef0010460 con 0x7faefc104220 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.626+0000 7faef8ff9700 1 -- 172.21.15.33:0/708224512 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef000f620 con 0x7faefc104220 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.626+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc19ef40 con 0x7faefc104220 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.626+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc19f310 con 0x7faefc104220 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.627+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc0680d0 con 0x7faefc104220 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.628+0000 7faef8ff9700 1 -- 172.21.15.33:0/708224512 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7faef0010960 con 0x7faefc104220 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.628+0000 7faef8ff9700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7faee40a1120 0x7faee40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.629+0000 7faefb7fe700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7faee40a1120 0x7faee40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:20.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.629+0000 7faef8ff9700 1 -- 172.21.15.33:0/708224512 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faef00cc150 con 0x7faefc104220 2024-05-08T20:03:20.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.629+0000 7faefb7fe700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7faee40a1120 0x7faee40a35e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faeec00b2e0 tx=0x7faeec00b870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:20.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.632+0000 7faef8ff9700 1 -- 172.21.15.33:0/708224512 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7faef0095d80 con 0x7faefc104220 2024-05-08T20:03:20.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:20 smithi082 ceph-mon[46774]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:20.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:20.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:20.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:20 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:20.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:20 smithi132 ceph-mon[47484]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:20.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:20.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:20.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:20.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:20 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:20.900 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.911+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faefc0680d0 con 0x7faefc104220 2024-05-08T20:03:20.901 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.912+0000 7faef8ff9700 1 -- 172.21.15.33:0/708224512 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8067 (secure 0 0 0) 0x7faefc0680d0 con 0x7faefc104220 2024-05-08T20:03:20.902 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:20.902 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24535,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-05-08T20:03:20.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.914+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7faee40a1120 msgr2=0x7faee40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:20.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.914+0000 7faf01cf1700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7faee40a1120 0x7faee40a35e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faeec00b2e0 tx=0x7faeec00b870 comp rx=0 tx=0).stop 2024-05-08T20:03:20.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.914+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc104220 msgr2=0x7faefc1973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:20.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.914+0000 7faf01cf1700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc104220 0x7faefc1973a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faef000d950 tx=0x7faef000dc60 comp rx=0 tx=0).stop 2024-05-08T20:03:20.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 shutdown_connections 2024-05-08T20:03:20.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7faee40a1120 0x7faee40a35e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faefc106b50 0x7faefc19e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faefc1018f0 0x7faefc196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 --2- 172.21.15.33:0/708224512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faefc104220 0x7faefc1973a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 >> 172.21.15.33:0/708224512 conn(0x7faefc0fb300 msgr2=0x7faefc102350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 shutdown_connections 2024-05-08T20:03:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:20.915+0000 7faf01cf1700 1 -- 172.21.15.33:0/708224512 wait complete. 2024-05-08T20:03:20.906 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 11 2024-05-08T20:03:21.320 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:03:21 smithi033 systemd[1]: Starting Ceph mds.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:21 smithi033 ceph-mon[42490]: Deploying daemon mds.a on smithi033 2024-05-08T20:03:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:21 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] up:boot 2024-05-08T20:03:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:21 smithi033 ceph-mon[42490]: fsmap 10 up:standby 2024-05-08T20:03:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:21 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:03:21.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:21 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/708224512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:21.821 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:03:21 smithi033 ceph-mds[94032]: -- 172.21.15.33:0/4096220261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555afb9e41a0 con 0x555afb9bac00 2024-05-08T20:03:21.822 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:03:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-a[94009]: starting mds.a at 2024-05-08T20:03:21.822 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:03:21 smithi033 bash[93994]: a8981d8fd239ef6374183224b570f3dd8d2a0159ff965bd80555bc51eebf09a9 2024-05-08T20:03:21.822 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:03:21 smithi033 systemd[1]: Started Ceph mds.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:21.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:21 smithi082 ceph-mon[46774]: Deploying daemon mds.a on smithi033 2024-05-08T20:03:21.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:21 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] up:boot 2024-05-08T20:03:21.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:21 smithi082 ceph-mon[46774]: fsmap 10 up:standby 2024-05-08T20:03:21.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:21 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:03:21.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:21 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/708224512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:21 smithi132 ceph-mon[47484]: Deploying daemon mds.a on smithi033 2024-05-08T20:03:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:21 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] up:boot 2024-05-08T20:03:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:21 smithi132 ceph-mon[47484]: fsmap 10 up:standby 2024-05-08T20:03:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:21 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:03:21.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:21 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/708224512' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:22.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:22 smithi082 ceph-mon[46774]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:22.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:22 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:22 smithi033 ceph-mon[42490]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:22 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:22 smithi132 ceph-mon[47484]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T20:03:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T20:03:22.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:22 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:22.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:23.049 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:03:22 smithi082 systemd[1]: Starting Ceph mds.b for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:03:23.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 -- 172.21.15.33:0/1971059670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb81018f0 msgr2=0x7f7eb81081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/1971059670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb81018f0 0x7f7eb81081a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7eb000b0d0 tx=0x7f7eb000b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 -- 172.21.15.33:0/1971059670 shutdown_connections 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/1971059670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb81018f0 0x7f7eb81081a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/1971059670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eb80ffd60 0x7f7eb8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/1971059670 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb8100f50 0x7f7eb81013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 -- 172.21.15.33:0/1971059670 >> 172.21.15.33:0/1971059670 conn(0x7f7eb80fb2f0 msgr2=0x7f7eb80fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 -- 172.21.15.33:0/1971059670 shutdown_connections 2024-05-08T20:03:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.082+0000 7f7ebeed2700 1 -- 172.21.15.33:0/1971059670 wait complete. 2024-05-08T20:03:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 Processor -- start 2024-05-08T20:03:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 -- start start 2024-05-08T20:03:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb80ffd60 0x7f7eb8195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eb8100f50 0x7f7eb8196460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81018f0 0x7f7eb819d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb819da50 con 0x7f7eb80ffd60 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb819db90 con 0x7f7eb81018f0 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebeed2700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb819dd20 con 0x7f7eb8100f50 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb80ffd60 0x7f7eb8195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb80ffd60 0x7f7eb8195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33310/0 (socket says 172.21.15.33:33310) 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 -- 172.21.15.33:0/939548489 learned_addr learned my addr 172.21.15.33:0/939548489 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7eb7fff700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eb8100f50 0x7f7eb8196460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebd46f700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81018f0 0x7f7eb819d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 -- 172.21.15.33:0/939548489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eb8100f50 msgr2=0x7f7eb8196460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eb8100f50 0x7f7eb8196460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 -- 172.21.15.33:0/939548489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81018f0 msgr2=0x7f7eb819d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81018f0 0x7f7eb819d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebcc6e700 1 -- 172.21.15.33:0/939548489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb0009d00 con 0x7f7eb80ffd60 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7ebd46f700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81018f0 0x7f7eb819d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.083+0000 7f7eb7fff700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eb8100f50 0x7f7eb8196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.084+0000 7f7ebcc6e700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb80ffd60 0x7f7eb8195f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800d9b0 tx=0x7f7ea800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.084+0000 7f7eb5ffb700 1 -- 172.21.15.33:0/939548489 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea800ecd0 con 0x7f7eb80ffd60 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.084+0000 7f7eb5ffb700 1 -- 172.21.15.33:0/939548489 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7ea800ee30 con 0x7f7eb80ffd60 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.084+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb8068050 con 0x7f7eb80ffd60 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.084+0000 7f7eb5ffb700 1 -- 172.21.15.33:0/939548489 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80148a0 con 0x7f7eb80ffd60 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.084+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb8068630 con 0x7f7eb80ffd60 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.085+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb8067c10 con 0x7f7eb80ffd60 2024-05-08T20:03:23.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.086+0000 7f7eb5ffb700 1 -- 172.21.15.33:0/939548489 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7ea8016bb0 con 0x7f7eb80ffd60 2024-05-08T20:03:23.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.087+0000 7f7eb5ffb700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ea00a11a0 0x7f7ea00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:23.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.087+0000 7f7eb7fff700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ea00a11a0 0x7f7ea00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.087+0000 7f7eb5ffb700 1 -- 172.21.15.33:0/939548489 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7ea80cdcb0 con 0x7f7eb80ffd60 2024-05-08T20:03:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.087+0000 7f7eb7fff700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ea00a11a0 0x7f7ea00a3660 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7eac005950 tx=0x7f7eac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:23.080 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.091+0000 7f7eb5ffb700 1 -- 172.21.15.33:0/939548489 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7ea80978e0 con 0x7f7eb80ffd60 2024-05-08T20:03:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.374+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb810b900 con 0x7f7eb80ffd60 2024-05-08T20:03:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.374+0000 7f7eb5ffb700 1 -- 172.21.15.33:0/939548489 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8825 (secure 0 0 0) 0x7f7ea809af00 con 0x7f7eb80ffd60 2024-05-08T20:03:23.364 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:23.364 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24535,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2024-05-08T20:03:23.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ea00a11a0 msgr2=0x7f7ea00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ea00a11a0 0x7f7ea00a3660 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7eac005950 tx=0x7f7eac0058e0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb80ffd60 msgr2=0x7f7eb8195f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb80ffd60 0x7f7eb8195f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ea800d9b0 tx=0x7f7ea800dd70 comp rx=0 tx=0).stop 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 shutdown_connections 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7eb81018f0 0x7f7eb819d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7eb80ffd60 0x7f7eb8195f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ea00a11a0 0x7f7ea00a3660 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 --2- 172.21.15.33:0/939548489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eb8100f50 0x7f7eb8196460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 >> 172.21.15.33:0/939548489 conn(0x7f7eb80fb2f0 msgr2=0x7f7eb81041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 shutdown_connections 2024-05-08T20:03:23.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:23.378+0000 7f7ebeed2700 1 -- 172.21.15.33:0/939548489 wait complete. 2024-05-08T20:03:23.369 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 12 2024-05-08T20:03:23.621 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mds[83569]: -- 172.21.15.82:0/1141408664 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b3077b21a0 con 0x55b307789000 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b[83545]: starting mds.b at 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:03:23 smithi082 bash[83531]: 98ca7e8be80031ac1de544c20657a2b905f8791969d1d61442d26be3b7352b40 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:03:23 smithi082 systemd[1]: Started Ceph mds.b for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: Deploying daemon mds.b on smithi082 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.33:6840/1914520158,v1:172.21.15.33:6841/1914520158] up:boot 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: fsmap 11 up:standby 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:23 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/939548489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: Deploying daemon mds.b on smithi082 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.33:6840/1914520158,v1:172.21.15.33:6841/1914520158] up:boot 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: fsmap 11 up:standby 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:23 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/939548489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: Deploying daemon mds.b on smithi082 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.33:6840/1914520158,v1:172.21.15.33:6841/1914520158] up:boot 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: fsmap 11 up:standby 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:23.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:23 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/939548489' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:24 smithi033 ceph-mon[42490]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:24 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] up:boot 2024-05-08T20:03:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:24 smithi033 ceph-mon[42490]: fsmap 12 up:standby 2024-05-08T20:03:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:03:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:24 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:24.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:24 smithi082 ceph-mon[46774]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:24.899 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:24 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] up:boot 2024-05-08T20:03:24.899 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:24 smithi082 ceph-mon[46774]: fsmap 12 up:standby 2024-05-08T20:03:24.899 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:03:24.899 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:24 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:24.900 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:24 smithi132 ceph-mon[47484]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:24.900 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:24 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] up:boot 2024-05-08T20:03:24.900 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:24 smithi132 ceph-mon[47484]: fsmap 12 up:standby 2024-05-08T20:03:24.900 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:03:24.900 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:24 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:25.382 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 -- 172.21.15.33:0/3152767931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40106bc0 msgr2=0x7fcd40108fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 --2- 172.21.15.33:0/3152767931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40106bc0 0x7fcd40108fd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800b0a0 tx=0x7fcd3800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 -- 172.21.15.33:0/3152767931 shutdown_connections 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 --2- 172.21.15.33:0/3152767931 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40106bc0 0x7fcd40108fd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 --2- 172.21.15.33:0/3152767931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd40101960 0x7fcd40103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 --2- 172.21.15.33:0/3152767931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd40104290 0x7fcd40106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 -- 172.21.15.33:0/3152767931 >> 172.21.15.33:0/3152767931 conn(0x7fcd400fb330 msgr2=0x7fcd400fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:25.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 -- 172.21.15.33:0/3152767931 shutdown_connections 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.550+0000 7fcd4823a700 1 -- 172.21.15.33:0/3152767931 wait complete. 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 Processor -- start 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 -- start start 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd40101960 0x7fcd40199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40104290 0x7fcd40199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd40106bc0 0x7fcd401a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd401a0c20 con 0x7fcd40104290 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd401a0d60 con 0x7fcd40106bc0 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd4823a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd401a0ef0 con 0x7fcd40101960 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40104290 0x7fcd40199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40104290 0x7fcd40199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33322/0 (socket says 172.21.15.33:33322) 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 -- 172.21.15.33:0/2619367697 learned_addr learned my addr 172.21.15.33:0/2619367697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd467d7700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd40106bc0 0x7fcd401a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:25.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd45fd6700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd40101960 0x7fcd40199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 -- 172.21.15.33:0/2619367697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd40101960 msgr2=0x7fcd40199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd40101960 0x7fcd40199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 -- 172.21.15.33:0/2619367697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd40106bc0 msgr2=0x7fcd401a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd40106bc0 0x7fcd401a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd457d5700 1 -- 172.21.15.33:0/2619367697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009d00 con 0x7fcd40104290 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.551+0000 7fcd467d7700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd40106bc0 0x7fcd401a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.552+0000 7fcd457d5700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40104290 0x7fcd40199680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c9b0 tx=0x7fcd3000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.552+0000 7fcd36ffd700 1 -- 172.21.15.33:0/2619367697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30007b00 con 0x7fcd40104290 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.552+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd401a11d0 con 0x7fcd40104290 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.552+0000 7fcd36ffd700 1 -- 172.21.15.33:0/2619367697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd3000ce50 con 0x7fcd40104290 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.552+0000 7fcd36ffd700 1 -- 172.21.15.33:0/2619367697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30018660 con 0x7fcd40104290 2024-05-08T20:03:25.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.552+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd401a1730 con 0x7fcd40104290 2024-05-08T20:03:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.553+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd400fceb0 con 0x7fcd40104290 2024-05-08T20:03:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.554+0000 7fcd36ffd700 1 -- 172.21.15.33:0/2619367697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fcd3000f450 con 0x7fcd40104290 2024-05-08T20:03:25.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.555+0000 7fcd36ffd700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd2c0a1120 0x7fcd2c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.555+0000 7fcd36ffd700 1 -- 172.21.15.33:0/2619367697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcd300cc630 con 0x7fcd40104290 2024-05-08T20:03:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.555+0000 7fcd45fd6700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd2c0a1120 0x7fcd2c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:25.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.556+0000 7fcd45fd6700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd2c0a1120 0x7fcd2c0a35e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009c60 tx=0x7fcd3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:25.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.559+0000 7fcd36ffd700 1 -- 172.21.15.33:0/2619367697 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fcd300962f0 con 0x7fcd40104290 2024-05-08T20:03:25.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:25.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:25 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:25.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.839+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd40068060 con 0x7fcd40104290 2024-05-08T20:03:25.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.840+0000 7fcd36ffd700 1 -- 172.21.15.33:0/2619367697 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9583 (secure 0 0 0) 0x7fcd30099910 con 0x7fcd40104290 2024-05-08T20:03:25.829 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:25.829 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24508,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24523,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24527,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24535,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24566,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2024-05-08T20:03:25.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd2c0a1120 msgr2=0x7fcd2c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:25.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd2c0a1120 0x7fcd2c0a35e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009c60 tx=0x7fcd3c009260 comp rx=0 tx=0).stop 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40104290 msgr2=0x7fcd40199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40104290 0x7fcd40199680 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c9b0 tx=0x7fcd3000ccc0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 shutdown_connections 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd40106bc0 0x7fcd401a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd2c0a1120 0x7fcd2c0a35e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd40101960 0x7fcd40199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 --2- 172.21.15.33:0/2619367697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd40104290 0x7fcd40199680 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 >> 172.21.15.33:0/2619367697 conn(0x7fcd400fb330 msgr2=0x7fcd401022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 shutdown_connections 2024-05-08T20:03:25.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:25.842+0000 7fcd4823a700 1 -- 172.21.15.33:0/2619367697 wait complete. 2024-05-08T20:03:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 13 2024-05-08T20:03:25.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:03:25.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:25.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:25 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:25.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:25.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:25.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:25.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:25.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:25 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:03:26.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 -- 172.21.15.33:0/3279215311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 msgr2=0x7fb6c0102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3279215311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 0x7fb6c0102440 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb6b0009990 tx=0x7fb6b0009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 -- 172.21.15.33:0/3279215311 shutdown_connections 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3279215311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0102980 0x7fb6c01092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3279215311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6c0100e70 0x7fb6c0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3279215311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 0x7fb6c0102440 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 -- 172.21.15.33:0/3279215311 >> 172.21.15.33:0/3279215311 conn(0x7fb6c00fc400 msgr2=0x7fb6c00fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 -- 172.21.15.33:0/3279215311 shutdown_connections 2024-05-08T20:03:26.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.015+0000 7fb6c8180700 1 -- 172.21.15.33:0/3279215311 wait complete. 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 Processor -- start 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 -- start start 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100e70 0x7fb6c0196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 0x7fb6c01973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6c0102980 0x7fb6c019e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c019e9c0 con 0x7fb6c0101fc0 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c019eb00 con 0x7fb6c0100e70 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c8180700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c019ec90 con 0x7fb6c0102980 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c571b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 0x7fb6c01973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c5f1c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100e70 0x7fb6c0196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c571b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 0x7fb6c01973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33334/0 (socket says 172.21.15.33:33334) 2024-05-08T20:03:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c571b700 1 -- 172.21.15.33:0/3275676934 learned_addr learned my addr 172.21.15.33:0/3275676934 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c5f1c700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100e70 0x7fb6c0196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:39168/0 (socket says 172.21.15.33:39168) 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.016+0000 7fb6c671d700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6c0102980 0x7fb6c019e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c5f1c700 1 -- 172.21.15.33:0/3275676934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6c0102980 msgr2=0x7fb6c019e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c5f1c700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6c0102980 0x7fb6c019e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c5f1c700 1 -- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 msgr2=0x7fb6c01973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c5f1c700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 0x7fb6c01973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c5f1c700 1 -- 172.21.15.33:0/3275676934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b00095f0 con 0x7fb6c0100e70 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c5f1c700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100e70 0x7fb6c0196e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00e9f0 tx=0x7fb6bc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6b6ffd700 1 -- 172.21.15.33:0/3275676934 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc00c9c0 con 0x7fb6c0100e70 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6b6ffd700 1 -- 172.21.15.33:0/3275676934 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb6bc010430 con 0x7fb6c0100e70 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c019ef70 con 0x7fb6c0100e70 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6b6ffd700 1 -- 172.21.15.33:0/3275676934 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc018680 con 0x7fb6c0100e70 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.017+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c019f390 con 0x7fb6c0100e70 2024-05-08T20:03:26.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.018+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c01082e0 con 0x7fb6c0100e70 2024-05-08T20:03:26.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.019+0000 7fb6b6ffd700 1 -- 172.21.15.33:0/3275676934 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fb6bc010910 con 0x7fb6c0100e70 2024-05-08T20:03:26.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.020+0000 7fb6b6ffd700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6ac0a1120 0x7fb6ac0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.020+0000 7fb6c571b700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6ac0a1120 0x7fb6ac0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.020+0000 7fb6b6ffd700 1 -- 172.21.15.33:0/3275676934 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb6bc014070 con 0x7fb6c0100e70 2024-05-08T20:03:26.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.021+0000 7fb6c571b700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6ac0a1120 0x7fb6ac0a35e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b2e0 tx=0x7fb6b000b810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:26.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.024+0000 7fb6b6ffd700 1 -- 172.21.15.33:0/3275676934 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fb6bc096150 con 0x7fb6c0100e70 2024-05-08T20:03:26.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.298+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6c010c840 con 0x7fb6c0100e70 2024-05-08T20:03:26.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.300+0000 7fb6b6ffd700 1 -- 172.21.15.33:0/3275676934 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+18349 (secure 0 0 0) 0x7fb6bc0105a0 con 0x7fb6c0100e70 2024-05-08T20:03:26.289 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:26.290 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":76,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:02:57.184553+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6ac0a1120 msgr2=0x7fb6ac0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6ac0a1120 0x7fb6ac0a35e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000b2e0 tx=0x7fb6b000b810 comp rx=0 tx=0).stop 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100e70 msgr2=0x7fb6c0196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100e70 0x7fb6c0196e90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc00e9f0 tx=0x7fb6bc00ed00 comp rx=0 tx=0).stop 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 shutdown_connections 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fb6ac0a1120 0x7fb6ac0a35e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6c0102980 0x7fb6c019e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb6c0100e70 0x7fb6c0196e90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 --2- 172.21.15.33:0/3275676934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6c0101fc0 0x7fb6c01973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 >> 172.21.15.33:0/3275676934 conn(0x7fb6c00fc400 msgr2=0x7fb6c0105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:26.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 shutdown_connections 2024-05-08T20:03:26.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.302+0000 7fb6c8180700 1 -- 172.21.15.33:0/3275676934 wait complete. 2024-05-08T20:03:26.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:03:26.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:03:26.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.467+0000 7f7ae6d80700 1 -- 172.21.15.33:0/44763065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0102ab0 msgr2=0x7f7ae01093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.467+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/44763065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0102ab0 0x7f7ae01093d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7ad800b0a0 tx=0x7f7ad800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.467+0000 7f7ae6d80700 1 -- 172.21.15.33:0/44763065 shutdown_connections 2024-05-08T20:03:26.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.467+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/44763065 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0102ab0 0x7f7ae01093d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.467+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/44763065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae0100f20 0x7f7ae0101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.467+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/44763065 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae01020f0 0x7f7ae0102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.467+0000 7f7ae6d80700 1 -- 172.21.15.33:0/44763065 >> 172.21.15.33:0/44763065 conn(0x7f7ae00fc4e0 msgr2=0x7f7ae00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 -- 172.21.15.33:0/44763065 shutdown_connections 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 -- 172.21.15.33:0/44763065 wait complete. 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 Processor -- start 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 -- start start 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0100f20 0x7f7ae0197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae01020f0 0x7f7ae01975d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae0102ab0 0x7f7ae019e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae019ebc0 con 0x7f7ae0100f20 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae019ed00 con 0x7f7ae01020f0 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.468+0000 7f7ae6d80700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae019ee90 con 0x7f7ae0102ab0 2024-05-08T20:03:26.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0100f20 0x7f7ae0197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0100f20 0x7f7ae0197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33352/0 (socket says 172.21.15.33:33352) 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 -- 172.21.15.33:0/4248336870 learned_addr learned my addr 172.21.15.33:0/4248336870 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae531d700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae0102ab0 0x7f7ae019e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7adffff700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae01020f0 0x7f7ae01975d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 -- 172.21.15.33:0/4248336870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae0102ab0 msgr2=0x7f7ae019e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae0102ab0 0x7f7ae019e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 -- 172.21.15.33:0/4248336870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae01020f0 msgr2=0x7f7ae01975d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae01020f0 0x7f7ae01975d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 -- 172.21.15.33:0/4248336870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad8009d00 con 0x7f7ae0100f20 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae4b1c700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0100f20 0x7f7ae0197090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400e970 tx=0x7f7ad400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7addffb700 1 -- 172.21.15.33:0/4248336870 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4009790 con 0x7f7ae0100f20 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7addffb700 1 -- 172.21.15.33:0/4248336870 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7ad400ccc0 con 0x7f7ae0100f20 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae019f170 con 0x7f7ae0100f20 2024-05-08T20:03:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.469+0000 7f7addffb700 1 -- 172.21.15.33:0/4248336870 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4003d80 con 0x7f7ae0100f20 2024-05-08T20:03:26.462 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.470+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae019f680 con 0x7f7ae0100f20 2024-05-08T20:03:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.471+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0108340 con 0x7f7ae0100f20 2024-05-08T20:03:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.472+0000 7f7addffb700 1 -- 172.21.15.33:0/4248336870 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7ad400c7e0 con 0x7f7ae0100f20 2024-05-08T20:03:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.472+0000 7f7addffb700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ad00a1120 0x7f7ad00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.472+0000 7f7addffb700 1 -- 172.21.15.33:0/4248336870 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7ad4014070 con 0x7f7ae0100f20 2024-05-08T20:03:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.472+0000 7f7adffff700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ad00a1120 0x7f7ad00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.466 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.473+0000 7f7adffff700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ad00a1120 0x7f7ad00a35e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009c60 tx=0x7f7acc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.477+0000 7f7addffb700 1 -- 172.21.15.33:0/4248336870 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7ad4096220 con 0x7f7ae0100f20 2024-05-08T20:03:26.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2619367697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3275676934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:26.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:26 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.698+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ae0107d20 con 0x7f7ae0100f20 2024-05-08T20:03:26.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.699+0000 7f7addffb700 1 -- 172.21.15.33:0/4248336870 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ad4099840 con 0x7f7ae0100f20 2024-05-08T20:03:26.688 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ad00a1120 msgr2=0x7f7ad00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ad00a1120 0x7f7ad00a35e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009c60 tx=0x7f7acc009260 comp rx=0 tx=0).stop 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0100f20 msgr2=0x7f7ae0197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0100f20 0x7f7ae0197090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400e970 tx=0x7f7ad400ec80 comp rx=0 tx=0).stop 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 shutdown_connections 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7ad00a1120 0x7f7ad00a35e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ae0102ab0 0x7f7ae019e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ae0100f20 0x7f7ae0197090 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 --2- 172.21.15.33:0/4248336870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ae01020f0 0x7f7ae01975d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 >> 172.21.15.33:0/4248336870 conn(0x7f7ae00fc4e0 msgr2=0x7f7ae0105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 shutdown_connections 2024-05-08T20:03:26.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.701+0000 7f7ae6d80700 1 -- 172.21.15.33:0/4248336870 wait complete. 2024-05-08T20:03:26.705 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-08T20:03:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 -- 172.21.15.33:0/2599046318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b781018f0 msgr2=0x7f3b781081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 --2- 172.21.15.33:0/2599046318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b781018f0 0x7f3b781081a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b7000b0d0 tx=0x7f3b7000b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 -- 172.21.15.33:0/2599046318 shutdown_connections 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 --2- 172.21.15.33:0/2599046318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b781018f0 0x7f3b781081a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 --2- 172.21.15.33:0/2599046318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b780ffd60 0x7f3b78100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 --2- 172.21.15.33:0/2599046318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b78100f50 0x7f3b781013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 -- 172.21.15.33:0/2599046318 >> 172.21.15.33:0/2599046318 conn(0x7f3b780fb2f0 msgr2=0x7f3b780fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 -- 172.21.15.33:0/2599046318 shutdown_connections 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.853+0000 7f3b7f879700 1 -- 172.21.15.33:0/2599046318 wait complete. 2024-05-08T20:03:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 Processor -- start 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 -- start start 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b780ffd60 0x7f3b78103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b78100f50 0x7f3b78102330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b781018f0 0x7f3b78102870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78103010 con 0x7f3b78100f50 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78103180 con 0x7f3b780ffd60 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7f879700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b781a1000 con 0x7f3b781018f0 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b78100f50 0x7f3b78102330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b78100f50 0x7f3b78102330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33368/0 (socket says 172.21.15.33:33368) 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 -- 172.21.15.33:0/478819134 learned_addr learned my addr 172.21.15.33:0/478819134 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7d615700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b780ffd60 0x7f3b78103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7de16700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b781018f0 0x7f3b78102870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 -- 172.21.15.33:0/478819134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b781018f0 msgr2=0x7f3b78102870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b781018f0 0x7f3b78102870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 -- 172.21.15.33:0/478819134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b780ffd60 msgr2=0x7f3b78103ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b780ffd60 0x7f3b78103ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.854+0000 7f3b7ce14700 1 -- 172.21.15.33:0/478819134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b70009d00 con 0x7f3b78100f50 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.855+0000 7f3b7ce14700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b78100f50 0x7f3b78102330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800d980 tx=0x7f3b6800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.855+0000 7f3b6e7fc700 1 -- 172.21.15.33:0/478819134 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68004220 con 0x7f3b78100f50 2024-05-08T20:03:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.855+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b781a1290 con 0x7f3b78100f50 2024-05-08T20:03:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.855+0000 7f3b6e7fc700 1 -- 172.21.15.33:0/478819134 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3b68007640 con 0x7f3b78100f50 2024-05-08T20:03:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.855+0000 7f3b6e7fc700 1 -- 172.21.15.33:0/478819134 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6800f690 con 0x7f3b78100f50 2024-05-08T20:03:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.855+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b781a17f0 con 0x7f3b78100f50 2024-05-08T20:03:26.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.856+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b78067c10 con 0x7f3b78100f50 2024-05-08T20:03:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.857+0000 7f3b6e7fc700 1 -- 172.21.15.33:0/478819134 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3b68004410 con 0x7f3b78100f50 2024-05-08T20:03:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.858+0000 7f3b6e7fc700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3b640a1120 0x7f3b640a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.858+0000 7f3b6e7fc700 1 -- 172.21.15.33:0/478819134 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3b680cc740 con 0x7f3b78100f50 2024-05-08T20:03:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.858+0000 7f3b7d615700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3b640a1120 0x7f3b640a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:26.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.859+0000 7f3b7d615700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3b640a1120 0x7f3b640a35e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b78100db0 tx=0x7f3b74009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:26.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:26.862+0000 7f3b6e7fc700 1 -- 172.21.15.33:0/478819134 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3b680962d0 con 0x7f3b78100f50 2024-05-08T20:03:26.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2619367697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:26.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3275676934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:26 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2619367697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3275676934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:26.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:03:26.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:03:26.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:26 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:27.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.085+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3b7810b950 con 0x7f3b78100f50 2024-05-08T20:03:27.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.086+0000 7f3b6e7fc700 1 -- 172.21.15.33:0/478819134 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3b680998f0 con 0x7f3b78100f50 2024-05-08T20:03:27.076 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:27.076 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2024-05-08T20:03:27.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:03:27.076 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2024-05-08T20:03:27.076 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2024-05-08T20:03:27.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:03:27.076 INFO:teuthology.orchestra.run.smithi033.stdout:] 2024-05-08T20:03:27.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.088+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3b640a1120 msgr2=0x7f3b640a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:27.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.088+0000 7f3b7f879700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3b640a1120 0x7f3b640a35e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3b78100db0 tx=0x7f3b74009260 comp rx=0 tx=0).stop 2024-05-08T20:03:27.078 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b78100f50 msgr2=0x7f3b78102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b78100f50 0x7f3b78102330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b6800d980 tx=0x7f3b6800dc90 comp rx=0 tx=0).stop 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 shutdown_connections 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3b640a1120 0x7f3b640a35e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b781018f0 0x7f3b78102870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b780ffd60 0x7f3b78103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 --2- 172.21.15.33:0/478819134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b78100f50 0x7f3b78102330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 >> 172.21.15.33:0/478819134 conn(0x7f3b780fb2f0 msgr2=0x7f3b780fcd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 shutdown_connections 2024-05-08T20:03:27.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.089+0000 7f3b7f879700 1 -- 172.21.15.33:0/478819134 wait complete. 2024-05-08T20:03:27.092 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T20:03:27.092 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 -- 172.21.15.33:0/3760428772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3198101aa0 msgr2=0x7f3198103e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 --2- 172.21.15.33:0/3760428772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3198101aa0 0x7f3198103e90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3194009990 tx=0x7f3194009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 -- 172.21.15.33:0/3760428772 shutdown_connections 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 --2- 172.21.15.33:0/3760428772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3198106d00 0x7f31981090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 --2- 172.21.15.33:0/3760428772 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3198101aa0 0x7f3198103e90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 --2- 172.21.15.33:0/3760428772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f31981043d0 0x7f31981067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 -- 172.21.15.33:0/3760428772 >> 172.21.15.33:0/3760428772 conn(0x7f31980fb3f0 msgr2=0x7f31980fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 -- 172.21.15.33:0/3760428772 shutdown_connections 2024-05-08T20:03:27.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.245+0000 7f319f474700 1 -- 172.21.15.33:0/3760428772 wait complete. 2024-05-08T20:03:27.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 Processor -- start 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 -- start start 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3198101aa0 0x7f3198199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31981043d0 0x7f3198199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3198106d00 0x7f31981a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981a0c40 con 0x7f31981043d0 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981a0d80 con 0x7f3198101aa0 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319f474700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981a0f10 con 0x7f3198106d00 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319ca0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31981043d0 0x7f3198199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319ca0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31981043d0 0x7f3198199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33382/0 (socket says 172.21.15.33:33382) 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319ca0f700 1 -- 172.21.15.33:0/3370037259 learned_addr learned my addr 172.21.15.33:0/3370037259 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.246+0000 7f319da11700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3198106d00 0x7f31981a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319d210700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3198101aa0 0x7f3198199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319ca0f700 1 -- 172.21.15.33:0/3370037259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3198106d00 msgr2=0x7f31981a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319ca0f700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3198106d00 0x7f31981a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319ca0f700 1 -- 172.21.15.33:0/3370037259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3198101aa0 msgr2=0x7f3198199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319ca0f700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3198101aa0 0x7f3198199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319ca0f700 1 -- 172.21.15.33:0/3370037259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31940095f0 con 0x7f31981043d0 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319da11700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3198106d00 0x7f31981a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319ca0f700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31981043d0 0x7f3198199650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f318800c920 tx=0x7f318800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f318e7fc700 1 -- 172.21.15.33:0/3370037259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188007b00 con 0x7f31981043d0 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f318e7fc700 1 -- 172.21.15.33:0/3370037259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3188004d10 con 0x7f31981043d0 2024-05-08T20:03:27.239 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31981a11f0 con 0x7f31981043d0 2024-05-08T20:03:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f318e7fc700 1 -- 172.21.15.33:0/3370037259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188005660 con 0x7f31981043d0 2024-05-08T20:03:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.247+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31981a1750 con 0x7f31981043d0 2024-05-08T20:03:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.248+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3198108880 con 0x7f31981043d0 2024-05-08T20:03:27.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.249+0000 7f318e7fc700 1 -- 172.21.15.33:0/3370037259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f3188004750 con 0x7f31981043d0 2024-05-08T20:03:27.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.250+0000 7f318e7fc700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f31840a11a0 0x7f31840a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:27.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.250+0000 7f319d210700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f31840a11a0 0x7f31840a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:27.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.250+0000 7f318e7fc700 1 -- 172.21.15.33:0/3370037259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f31880cc4c0 con 0x7f31981043d0 2024-05-08T20:03:27.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.251+0000 7f319d210700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f31840a11a0 0x7f31840a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f319400b5c0 tx=0x7f3194005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:27.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.255+0000 7f318e7fc700 1 -- 172.21.15.33:0/3370037259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3188096050 con 0x7f31981043d0 2024-05-08T20:03:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:27.475+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3198067cf0 con 0x7f31981043d0 2024-05-08T20:03:28.131 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.141+0000 7f318e7fc700 1 -- 172.21.15.33:0/3370037259 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3188099670 con 0x7f31981043d0 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f31840a11a0 msgr2=0x7f31840a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f31840a11a0 0x7f31840a3660 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f319400b5c0 tx=0x7f3194005fb0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31981043d0 msgr2=0x7f3198199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31981043d0 0x7f3198199650 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f318800c920 tx=0x7f318800cce0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 shutdown_connections 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f31840a11a0 0x7f31840a3660 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3198106d00 0x7f31981a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3198101aa0 0x7f3198199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 --2- 172.21.15.33:0/3370037259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31981043d0 0x7f3198199650 secure :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f318800c920 tx=0x7f318800cce0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.147+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 >> 172.21.15.33:0/3370037259 conn(0x7f31980fb3f0 msgr2=0x7f3198101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:28.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.148+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 shutdown_connections 2024-05-08T20:03:28.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.149+0000 7f319f474700 1 -- 172.21.15.33:0/3370037259 wait complete. 2024-05-08T20:03:28.139 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2024-05-08T20:03:28.154 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T20:03:28.182 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:27 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/4248336870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:28.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:27 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/478819134' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T20:03:28.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:27 smithi033 ceph-mon[42490]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:28.183 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:28.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 -- 172.21.15.33:0/3476102833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 msgr2=0x7f710c100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:28.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 --2- 172.21.15.33:0/3476102833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c100290 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009990 tx=0x7f70fc009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 -- 172.21.15.33:0/3476102833 shutdown_connections 2024-05-08T20:03:28.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 --2- 172.21.15.33:0/3476102833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c101980 0x7f710c1082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.310 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 --2- 172.21.15.33:0/3476102833 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c100290 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 --2- 172.21.15.33:0/3476102833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f710c100fc0 0x7f710c101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 -- 172.21.15.33:0/3476102833 >> 172.21.15.33:0/3476102833 conn(0x7f710c0fb400 msgr2=0x7f710c0fd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:28.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 -- 172.21.15.33:0/3476102833 shutdown_connections 2024-05-08T20:03:28.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.313+0000 7f7111b56700 1 -- 172.21.15.33:0/3476102833 wait complete. 2024-05-08T20:03:28.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 Processor -- start 2024-05-08T20:03:28.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 -- start start 2024-05-08T20:03:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c1991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f710c100fc0 0x7f710c199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c101980 0x7f710c1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c1a0d10 con 0x7f710c0ffe70 2024-05-08T20:03:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c1a0e50 con 0x7f710c101980 2024-05-08T20:03:28.312 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f7111b56700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c1a0fe0 con 0x7f710c100fc0 2024-05-08T20:03:28.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f710b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c1991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:28.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f710b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c1991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33396/0 (socket says 172.21.15.33:33396) 2024-05-08T20:03:28.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.314+0000 7f710b7fe700 1 -- 172.21.15.33:0/2365284872 learned_addr learned my addr 172.21.15.33:0/2365284872 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:28.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710affd700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f710c100fc0 0x7f710c199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:28.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710bfff700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c101980 0x7f710c1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:28.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710affd700 1 -- 172.21.15.33:0/2365284872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c101980 msgr2=0x7f710c1a0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:28.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710affd700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c101980 0x7f710c1a0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710affd700 1 -- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 msgr2=0x7f710c1991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:28.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710affd700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c1991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:28.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710affd700 1 -- 172.21.15.33:0/2365284872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0095f0 con 0x7f710c100fc0 2024-05-08T20:03:28.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710b7fe700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:03:28.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f710affd700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f710c100fc0 0x7f710c199720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f710000e9f0 tx=0x7f710000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:28.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f7108ff9700 1 -- 172.21.15.33:0/2365284872 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000eee0 con 0x7f710c100fc0 2024-05-08T20:03:28.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c1a12c0 con 0x7f710c100fc0 2024-05-08T20:03:28.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f7108ff9700 1 -- 172.21.15.33:0/2365284872 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f710000cbd0 con 0x7f710c100fc0 2024-05-08T20:03:28.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f7108ff9700 1 -- 172.21.15.33:0/2365284872 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7100018680 con 0x7f710c100fc0 2024-05-08T20:03:28.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.315+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c1a17d0 con 0x7f710c100fc0 2024-05-08T20:03:28.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.316+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c068140 con 0x7f710c100fc0 2024-05-08T20:03:28.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.318+0000 7f7108ff9700 1 -- 172.21.15.33:0/2365284872 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f7100010430 con 0x7f710c100fc0 2024-05-08T20:03:28.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.318+0000 7f7108ff9700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70f40a1120 0x7f70f40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:28.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.319+0000 7f710b7fe700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70f40a1120 0x7f70f40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:28.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.319+0000 7f7108ff9700 1 -- 172.21.15.33:0/2365284872 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f7100014070 con 0x7f710c100fc0 2024-05-08T20:03:28.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.319+0000 7f710b7fe700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70f40a1120 0x7f70f40a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00b2e0 tx=0x7f70fc00b810 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:28.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.322+0000 7f7108ff9700 1 -- 172.21.15.33:0/2365284872 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7100096730 con 0x7f710c100fc0 2024-05-08T20:03:28.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:27 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/4248336870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:28.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:27 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/478819134' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T20:03:28.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:27 smithi082 ceph-mon[46774]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:28.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:28.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:27 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/4248336870' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:03:28.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:27 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/478819134' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T20:03:28.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:27 smithi132 ceph-mon[47484]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:28.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:03:28.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:28.541+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f710c10b7c0 con 0x7f710c100fc0 2024-05-08T20:03:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.154+0000 7f7108ff9700 1 -- 172.21.15.33:0/2365284872 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7100099d50 con 0x7f710c100fc0 2024-05-08T20:03:29.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.163+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70f40a1120 msgr2=0x7f70f40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.163+0000 7f7111b56700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70f40a1120 0x7f70f40a35e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00b2e0 tx=0x7f70fc00b810 comp rx=0 tx=0).stop 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.163+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f710c100fc0 msgr2=0x7f710c199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.163+0000 7f7111b56700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f710c100fc0 0x7f710c199720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f710000e9f0 tx=0x7f710000ed00 comp rx=0 tx=0).stop 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.164+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 shutdown_connections 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.164+0000 7f7111b56700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f710c101980 0x7f710c1a0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.164+0000 7f7111b56700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f710c0ffe70 0x7f710c1991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.164+0000 7f7111b56700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70f40a1120 0x7f70f40a35e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.164+0000 7f7111b56700 1 --2- 172.21.15.33:0/2365284872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f710c100fc0 0x7f710c199720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.164+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 >> 172.21.15.33:0/2365284872 conn(0x7f710c0fb400 msgr2=0x7f710c0fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:29.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.165+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 shutdown_connections 2024-05-08T20:03:29.155 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.166+0000 7f7111b56700 1 -- 172.21.15.33:0/2365284872 wait complete. 2024-05-08T20:03:29.159 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2024-05-08T20:03:29.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T20:03:29.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:29 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3370037259' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T20:03:29.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:29 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3370037259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T20:03:29.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:29 smithi033 ceph-mon[42490]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T20:03:29.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:29 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2365284872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T20:03:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 -- 172.21.15.33:0/1970423704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 msgr2=0x7f57f010b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 --2- 172.21.15.33:0/1970423704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f010b5c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f57e800b0d0 tx=0x7f57e800b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 -- 172.21.15.33:0/1970423704 shutdown_connections 2024-05-08T20:03:29.363 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 --2- 172.21.15.33:0/1970423704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f010b5c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 --2- 172.21.15.33:0/1970423704 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f0103180 0x7f57f01035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 --2- 172.21.15.33:0/1970423704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f0104370 0x7f57f01047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 -- 172.21.15.33:0/1970423704 >> 172.21.15.33:0/1970423704 conn(0x7f57f00fe6f0 msgr2=0x7f57f0100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 -- 172.21.15.33:0/1970423704 shutdown_connections 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.371+0000 7f57f79a3700 1 -- 172.21.15.33:0/1970423704 wait complete. 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 Processor -- start 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 -- start start 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f0103180 0x7f57f01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f0104370 0x7f57f01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f01a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01a0dd0 con 0x7f57f0104d10 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01a0f10 con 0x7f57f0104370 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f79a3700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f01a10a0 con 0x7f57f0103180 2024-05-08T20:03:29.364 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f5f40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f01a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f5f40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f01a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33422/0 (socket says 172.21.15.33:33422) 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f5f40700 1 -- 172.21.15.33:0/2454952350 learned_addr learned my addr 172.21.15.33:0/2454952350 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.372+0000 7f57f573f700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f0103180 0x7f57f01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f4f3e700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f0104370 0x7f57f01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f5f40700 1 -- 172.21.15.33:0/2454952350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f0103180 msgr2=0x7f57f01992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f5f40700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f0103180 0x7f57f01992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f5f40700 1 -- 172.21.15.33:0/2454952350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f0104370 msgr2=0x7f57f01997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f5f40700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f0104370 0x7f57f01997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f5f40700 1 -- 172.21.15.33:0/2454952350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e8009d00 con 0x7f57f0104d10 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f4f3e700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f0104370 0x7f57f01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f5f40700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f01a0800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57e8007c00 tx=0x7f57e800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57e27fc700 1 -- 172.21.15.33:0/2454952350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800e040 con 0x7f57f0104d10 2024-05-08T20:03:29.365 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f01a1320 con 0x7f57f0104d10 2024-05-08T20:03:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57e27fc700 1 -- 172.21.15.33:0/2454952350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f57e8003e10 con 0x7f57f0104d10 2024-05-08T20:03:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57e27fc700 1 -- 172.21.15.33:0/2454952350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8012b30 con 0x7f57f0104d10 2024-05-08T20:03:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.373+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f01a17a0 con 0x7f57f0104d10 2024-05-08T20:03:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.374+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f010a530 con 0x7f57f0104d10 2024-05-08T20:03:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.376+0000 7f57e27fc700 1 -- 172.21.15.33:0/2454952350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f57e8012c90 con 0x7f57f0104d10 2024-05-08T20:03:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.376+0000 7f57e27fc700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f57dc0a1120 0x7f57dc0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.376+0000 7f57e27fc700 1 -- 172.21.15.33:0/2454952350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f57e80cd830 con 0x7f57f0104d10 2024-05-08T20:03:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.376+0000 7f57f573f700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f57dc0a1120 0x7f57dc0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.377+0000 7f57f573f700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f57dc0a1120 0x7f57dc0a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f57f01041d0 tx=0x7f57e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:29.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.380+0000 7f57e27fc700 1 -- 172.21.15.33:0/2454952350 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f57e80971f0 con 0x7f57f0104d10 2024-05-08T20:03:29.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:29 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3370037259' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T20:03:29.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:29 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3370037259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T20:03:29.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:29 smithi082 ceph-mon[46774]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T20:03:29.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:29 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2365284872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T20:03:29.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:29 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3370037259' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T20:03:29.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:29 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3370037259' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T20:03:29.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:29 smithi132 ceph-mon[47484]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T20:03:29.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:29 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2365284872' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T20:03:29.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.653+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f57f010eda0 con 0x7f57f0104d10 2024-05-08T20:03:29.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.660+0000 7f57e27fc700 1 -- 172.21.15.33:0/2454952350 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f57e809a810 con 0x7f57f0104d10 2024-05-08T20:03:29.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.666+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f57dc0a1120 msgr2=0x7f57dc0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.666+0000 7f57f79a3700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f57dc0a1120 0x7f57dc0a35e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f57f01041d0 tx=0x7f57e4009260 comp rx=0 tx=0).stop 2024-05-08T20:03:29.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.666+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 msgr2=0x7f57f01a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.666+0000 7f57f79a3700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f01a0800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f57e8007c00 tx=0x7f57e800bd40 comp rx=0 tx=0).stop 2024-05-08T20:03:29.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.669+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 shutdown_connections 2024-05-08T20:03:29.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.669+0000 7f57f79a3700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57f0104d10 0x7f57f01a0800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.669+0000 7f57f79a3700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f57dc0a1120 0x7f57dc0a35e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.669+0000 7f57f79a3700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57f0103180 0x7f57f01992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.669+0000 7f57f79a3700 1 --2- 172.21.15.33:0/2454952350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f57f0104370 0x7f57f01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.669+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 >> 172.21.15.33:0/2454952350 conn(0x7f57f00fe6f0 msgr2=0x7f57f0107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:29.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.670+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 shutdown_connections 2024-05-08T20:03:29.667 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.678+0000 7f57f79a3700 1 -- 172.21.15.33:0/2454952350 wait complete. 2024-05-08T20:03:29.675 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T20:03:29.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:03:29.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 -- 172.21.15.33:0/2903010074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 msgr2=0x7facf410f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 --2- 172.21.15.33:0/2903010074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf410f830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7facec00b0a0 tx=0x7facec00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 -- 172.21.15.33:0/2903010074 shutdown_connections 2024-05-08T20:03:29.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 --2- 172.21.15.33:0/2903010074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf410f830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 --2- 172.21.15.33:0/2903010074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf4074fe0 0x7facf4073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 --2- 172.21.15.33:0/2903010074 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4073a00 0x7facf4073e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 -- 172.21.15.33:0/2903010074 >> 172.21.15.33:0/2903010074 conn(0x7facf40fc400 msgr2=0x7facf40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 -- 172.21.15.33:0/2903010074 shutdown_connections 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.883+0000 7facfb2ef700 1 -- 172.21.15.33:0/2903010074 wait complete. 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 Processor -- start 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 -- start start 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf4073a00 0x7facf419d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4074fe0 0x7facf419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf41a4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf41a5110 con 0x7facf410d440 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf41a5250 con 0x7facf4074fe0 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facfb2ef700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf41a53e0 con 0x7facf4073a00 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facf988c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf41a4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facf988c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf41a4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33438/0 (socket says 172.21.15.33:33438) 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facf988c700 1 -- 172.21.15.33:0/3101476055 learned_addr learned my addr 172.21.15.33:0/3101476055 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.884+0000 7facf908b700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf4073a00 0x7facf419d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf888a700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4074fe0 0x7facf419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf988c700 1 -- 172.21.15.33:0/3101476055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf4073a00 msgr2=0x7facf419d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf988c700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf4073a00 0x7facf419d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf988c700 1 -- 172.21.15.33:0/3101476055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4074fe0 msgr2=0x7facf419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf988c700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4074fe0 0x7facf419db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf988c700 1 -- 172.21.15.33:0/3101476055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facec009d00 con 0x7facf410d440 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf908b700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf4073a00 0x7facf419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf888a700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4074fe0 0x7facf419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:29.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facf988c700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf41a4b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facec007ad0 tx=0x7facec00bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facea7fc700 1 -- 172.21.15.33:0/3101476055 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec00e040 con 0x7facf410d440 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facea7fc700 1 -- 172.21.15.33:0/3101476055 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7facec004e60 con 0x7facf410d440 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf41a5660 con 0x7facf410d440 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facea7fc700 1 -- 172.21.15.33:0/3101476055 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facec0052a0 con 0x7facf410d440 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.885+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf41a5b30 con 0x7facf410d440 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.886+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf4103590 con 0x7facf410d440 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.887+0000 7facea7fc700 1 -- 172.21.15.33:0/3101476055 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7facec005400 con 0x7facf410d440 2024-05-08T20:03:29.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.888+0000 7facea7fc700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7face00a11a0 0x7face00a3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:29.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.888+0000 7facf908b700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7face00a11a0 0x7face00a3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:29.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.888+0000 7facea7fc700 1 -- 172.21.15.33:0/3101476055 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7facec0ce490 con 0x7facf410d440 2024-05-08T20:03:29.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.889+0000 7facf908b700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7face00a11a0 0x7face00a3660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7face4009cb0 tx=0x7face4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:29.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:29.892+0000 7facea7fc700 1 -- 172.21.15.33:0/3101476055 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7facec097e00 con 0x7facf410d440 2024-05-08T20:03:30.101 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.111+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facf4112e70 con 0x7facf410d440 2024-05-08T20:03:30.102 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.113+0000 7facea7fc700 1 -- 172.21.15.33:0/3101476055 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22059 (secure 0 0 0) 0x7facec09b420 con 0x7facf410d440 2024-05-08T20:03:30.103 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:30.103 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":79,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:29.655132+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7face00a11a0 msgr2=0x7face00a3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7face00a11a0 0x7face00a3660 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7face4009cb0 tx=0x7face4009260 comp rx=0 tx=0).stop 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 msgr2=0x7facf41a4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf41a4b40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7facec007ad0 tx=0x7facec00bd90 comp rx=0 tx=0).stop 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 shutdown_connections 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7facf410d440 0x7facf41a4b40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7face00a11a0 0x7face00a3660 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facf4073a00 0x7facf419d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 --2- 172.21.15.33:0/3101476055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7facf4074fe0 0x7facf419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 >> 172.21.15.33:0/3101476055 conn(0x7facf40fc400 msgr2=0x7facf41006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:30.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 shutdown_connections 2024-05-08T20:03:30.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.115+0000 7facfb2ef700 1 -- 172.21.15.33:0/3101476055 wait complete. 2024-05-08T20:03:30.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:03:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/1569622367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e41018f0 msgr2=0x7fc5e41081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/1569622367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e41018f0 0x7fc5e41081a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc00b0d0 tx=0x7fc5dc00b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/1569622367 shutdown_connections 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/1569622367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e41018f0 0x7fc5e41081a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/1569622367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5e40ffd60 0x7fc5e4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/1569622367 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e4100f50 0x7fc5e41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/1569622367 >> 172.21.15.33:0/1569622367 conn(0x7fc5e40fb2f0 msgr2=0x7fc5e40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/1569622367 shutdown_connections 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.267+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/1569622367 wait complete. 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 Processor -- start 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 -- start start 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40ffd60 0x7fc5e4194d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5e4100f50 0x7fc5e41952b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e41018f0 0x7fc5e419c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e419c860 con 0x7fc5e40ffd60 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e419c9d0 con 0x7fc5e41018f0 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ec5d9700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e419cb90 con 0x7fc5e4100f50 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40ffd60 0x7fc5e4194d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40ffd60 0x7fc5e4194d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33454/0 (socket says 172.21.15.33:33454) 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 -- 172.21.15.33:0/160523821 learned_addr learned my addr 172.21.15.33:0/160523821 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5e9b74700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5e4100f50 0x7fc5e41952b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5eab76700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e41018f0 0x7fc5e419c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 -- 172.21.15.33:0/160523821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5e4100f50 msgr2=0x7fc5e41952b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5e4100f50 0x7fc5e41952b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 -- 172.21.15.33:0/160523821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e41018f0 msgr2=0x7fc5e419c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e41018f0 0x7fc5e419c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.268+0000 7fc5ea375700 1 -- 172.21.15.33:0/160523821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc009d00 con 0x7fc5e40ffd60 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.269+0000 7fc5eab76700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e41018f0 0x7fc5e419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.269+0000 7fc5ea375700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40ffd60 0x7fc5e4194d70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000a960 tx=0x7fc5e000ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.269+0000 7fc5db7fe700 1 -- 172.21.15.33:0/160523821 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0010070 con 0x7fc5e40ffd60 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.269+0000 7fc5db7fe700 1 -- 172.21.15.33:0/160523821 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc5e0004500 con 0x7fc5e40ffd60 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.269+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e419ce70 con 0x7fc5e40ffd60 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.269+0000 7fc5db7fe700 1 -- 172.21.15.33:0/160523821 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0003b10 con 0x7fc5e40ffd60 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.269+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e419d290 con 0x7fc5e40ffd60 2024-05-08T20:03:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.270+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e41070b0 con 0x7fc5e40ffd60 2024-05-08T20:03:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.271+0000 7fc5db7fe700 1 -- 172.21.15.33:0/160523821 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fc5e00078c0 con 0x7fc5e40ffd60 2024-05-08T20:03:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.272+0000 7fc5db7fe700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc5d00a1120 0x7fc5d00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.272+0000 7fc5db7fe700 1 -- 172.21.15.33:0/160523821 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc5e00cc240 con 0x7fc5e40ffd60 2024-05-08T20:03:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.272+0000 7fc5e9b74700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc5d00a1120 0x7fc5d00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.272+0000 7fc5e9b74700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc5d00a1120 0x7fc5d00a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400f830 tx=0x7fc5d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.276+0000 7fc5db7fe700 1 -- 172.21.15.33:0/160523821 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc5e0095b20 con 0x7fc5e40ffd60 2024-05-08T20:03:30.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T20:03:30.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: pgmap v218: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:30.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T20:03:30.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T20:03:30.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2454952350' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T20:03:30.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T20:03:30.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T20:03:30.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2454952350' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T20:03:30.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T20:03:30.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:30 smithi033 ceph-mon[42490]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: pgmap v218: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2454952350' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2454952350' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T20:03:30.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T20:03:30.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:30 smithi082 ceph-mon[46774]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: pgmap v218: 33 pgs: 17 creating+peering, 1 active+clean, 15 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2454952350' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2454952350' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T20:03:30.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T20:03:30.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:30 smithi132 ceph-mon[47484]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T20:03:30.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.495+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5e410a680 con 0x7fc5e40ffd60 2024-05-08T20:03:30.486 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.497+0000 7fc5db7fe700 1 -- 172.21.15.33:0/160523821 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+22059 (secure 0 0 0) 0x7fc5e0099140 con 0x7fc5e40ffd60 2024-05-08T20:03:30.487 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:30.487 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":79,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:29.655132+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:03:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc5d00a1120 msgr2=0x7fc5d00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc5d00a1120 0x7fc5d00a35e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400f830 tx=0x7fc5d4009260 comp rx=0 tx=0).stop 2024-05-08T20:03:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40ffd60 msgr2=0x7fc5e4194d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40ffd60 0x7fc5e4194d70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000a960 tx=0x7fc5e000ad20 comp rx=0 tx=0).stop 2024-05-08T20:03:30.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 shutdown_connections 2024-05-08T20:03:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5e41018f0 0x7fc5e419c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5e40ffd60 0x7fc5e4194d70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc5d00a1120 0x7fc5d00a35e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 --2- 172.21.15.33:0/160523821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5e4100f50 0x7fc5e41952b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.499+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 >> 172.21.15.33:0/160523821 conn(0x7fc5e40fb2f0 msgr2=0x7fc5e41041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.500+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 shutdown_connections 2024-05-08T20:03:30.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.500+0000 7fc5ec5d9700 1 -- 172.21.15.33:0/160523821 wait complete. 2024-05-08T20:03:30.503 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-08T20:03:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 -- 172.21.15.33:0/756359564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 msgr2=0x7fe1041093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 --2- 172.21.15.33:0/756359564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1041093d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc00b0a0 tx=0x7fe0fc00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 -- 172.21.15.33:0/756359564 shutdown_connections 2024-05-08T20:03:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 --2- 172.21.15.33:0/756359564 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1041093d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.646 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 --2- 172.21.15.33:0/756359564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe104100f20 0x7fe104101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 --2- 172.21.15.33:0/756359564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1041020f0 0x7fe104102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 -- 172.21.15.33:0/756359564 >> 172.21.15.33:0/756359564 conn(0x7fe1040fc4e0 msgr2=0x7fe1040fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 -- 172.21.15.33:0/756359564 shutdown_connections 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.654+0000 7fe109a15700 1 -- 172.21.15.33:0/756359564 wait complete. 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 Processor -- start 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 -- start start 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe104100f20 0x7fe104074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1041020f0 0x7fe104073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1040738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe104074070 con 0x7fe104102ab0 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1040741e0 con 0x7fe104100f20 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe109a15700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1041a1030 con 0x7fe1041020f0 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1040738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.647 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1040738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33476/0 (socket says 172.21.15.33:33476) 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 -- 172.21.15.33:0/1685128044 learned_addr learned my addr 172.21.15.33:0/1685128044 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe102ffd700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe104100f20 0x7fe104074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1027fc700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1041020f0 0x7fe104073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 -- 172.21.15.33:0/1685128044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1041020f0 msgr2=0x7fe104073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1041020f0 0x7fe104073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 -- 172.21.15.33:0/1685128044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe104100f20 msgr2=0x7fe104074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe104100f20 0x7fe104074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.655+0000 7fe1037fe700 1 -- 172.21.15.33:0/1685128044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009d00 con 0x7fe104102ab0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.656+0000 7fe1037fe700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1040738d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc004d00 tx=0x7fe0fc004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.656+0000 7fe108a13700 1 -- 172.21.15.33:0/1685128044 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc00e040 con 0x7fe104102ab0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.656+0000 7fe108a13700 1 -- 172.21.15.33:0/1685128044 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe0fc01db70 con 0x7fe104102ab0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.656+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1041a1260 con 0x7fe104102ab0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.656+0000 7fe108a13700 1 -- 172.21.15.33:0/1685128044 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc01bb10 con 0x7fe104102ab0 2024-05-08T20:03:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.656+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1041a1680 con 0x7fe104102ab0 2024-05-08T20:03:30.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.658+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1041082e0 con 0x7fe104102ab0 2024-05-08T20:03:30.649 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.659+0000 7fe108a13700 1 -- 172.21.15.33:0/1685128044 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe0fc01dce0 con 0x7fe104102ab0 2024-05-08T20:03:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.659+0000 7fe108a13700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe0ec0a1120 0x7fe0ec0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.659+0000 7fe102ffd700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe0ec0a1120 0x7fe0ec0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.660+0000 7fe108a13700 1 -- 172.21.15.33:0/1685128044 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe0fc0ceb90 con 0x7fe104102ab0 2024-05-08T20:03:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.660+0000 7fe102ffd700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe0ec0a1120 0x7fe0ec0a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4005fd0 tx=0x7fe0f4005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:30.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.666+0000 7fe108a13700 1 -- 172.21.15.33:0/1685128044 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe0fc060d60 con 0x7fe104102ab0 2024-05-08T20:03:30.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:30.937+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe104068140 con 0x7fe104102ab0 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3101476055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/160523821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] up:active 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:31.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:31 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1685128044' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T20:03:31.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T20:03:31.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3101476055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:31.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/160523821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:31.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] up:active 2024-05-08T20:03:31.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:31.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T20:03:31.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:31.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:31 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1685128044' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T20:03:31.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T20:03:31.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3101476055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:31.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/160523821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:31.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] up:active 2024-05-08T20:03:31.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:31.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T20:03:31.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:31.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:31 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1685128044' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T20:03:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.671+0000 7fe108a13700 1 -- 172.21.15.33:0/1685128044 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe0fc098500 con 0x7fe104102ab0 2024-05-08T20:03:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe0ec0a1120 msgr2=0x7fe0ec0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe0ec0a1120 0x7fe0ec0a35e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe0f4005fd0 tx=0x7fe0f4005e50 comp rx=0 tx=0).stop 2024-05-08T20:03:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 msgr2=0x7fe1040738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1040738d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc004d00 tx=0x7fe0fc004de0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 shutdown_connections 2024-05-08T20:03:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe104102ab0 0x7fe1040738d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe104100f20 0x7fe104074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe0ec0a1120 0x7fe0ec0a35e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 --2- 172.21.15.33:0/1685128044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1041020f0 0x7fe104073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.674+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 >> 172.21.15.33:0/1685128044 conn(0x7fe1040fc4e0 msgr2=0x7fe104105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.675+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 shutdown_connections 2024-05-08T20:03:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.675+0000 7fe109a15700 1 -- 172.21.15.33:0/1685128044 wait complete. 2024-05-08T20:03:31.680 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-05-08T20:03:31.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 -- 172.21.15.33:0/2488080972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8106c40 msgr2=0x7feba81090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 --2- 172.21.15.33:0/2488080972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8106c40 0x7feba81090b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feba000b0a0 tx=0x7feba000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 -- 172.21.15.33:0/2488080972 shutdown_connections 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 --2- 172.21.15.33:0/2488080972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8106c40 0x7feba81090b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 --2- 172.21.15.33:0/2488080972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba81019e0 0x7feba8103dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 --2- 172.21.15.33:0/2488080972 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba8104310 0x7feba8106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 -- 172.21.15.33:0/2488080972 >> 172.21.15.33:0/2488080972 conn(0x7feba80fb3f0 msgr2=0x7feba80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 -- 172.21.15.33:0/2488080972 shutdown_connections 2024-05-08T20:03:31.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.836+0000 7febaca39700 1 -- 172.21.15.33:0/2488080972 wait complete. 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 Processor -- start 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 -- start start 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba81019e0 0x7feba8197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8104310 0x7feba8197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba8106c40 0x7feba819e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba819eb70 con 0x7feba8104310 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba819ecb0 con 0x7feba8106c40 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7febaca39700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba819ee40 con 0x7feba81019e0 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7feba5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8104310 0x7feba8197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7feba5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8104310 0x7feba8197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33496/0 (socket says 172.21.15.33:33496) 2024-05-08T20:03:31.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7feba5d9b700 1 -- 172.21.15.33:0/388381227 learned_addr learned my addr 172.21.15.33:0/388381227 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7feba659c700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba81019e0 0x7feba8197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7feba6d9d700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba8106c40 0x7feba819e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.837+0000 7feba5d9b700 1 -- 172.21.15.33:0/388381227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba81019e0 msgr2=0x7feba8197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feba5d9b700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba81019e0 0x7feba8197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feba5d9b700 1 -- 172.21.15.33:0/388381227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba8106c40 msgr2=0x7feba819e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feba5d9b700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba8106c40 0x7feba819e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feba5d9b700 1 -- 172.21.15.33:0/388381227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0009d00 con 0x7feba8104310 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feba6d9d700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba8106c40 0x7feba819e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feba659c700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba81019e0 0x7feba8197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feba5d9b700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8104310 0x7feba8197580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d980 tx=0x7feb9c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feb977fe700 1 -- 172.21.15.33:0/388381227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00bb60 con 0x7feba8104310 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feb977fe700 1 -- 172.21.15.33:0/388381227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feb9c007640 con 0x7feba8104310 2024-05-08T20:03:31.830 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba819f120 con 0x7feba8104310 2024-05-08T20:03:31.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7feb977fe700 1 -- 172.21.15.33:0/388381227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c005020 con 0x7feba8104310 2024-05-08T20:03:31.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.838+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba819f630 con 0x7feba8104310 2024-05-08T20:03:31.831 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.839+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba80fcf70 con 0x7feba8104310 2024-05-08T20:03:31.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.840+0000 7feb977fe700 1 -- 172.21.15.33:0/388381227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7feb9c004020 con 0x7feba8104310 2024-05-08T20:03:31.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.841+0000 7feb977fe700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb900a1120 0x7feb900a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:31.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.841+0000 7feb977fe700 1 -- 172.21.15.33:0/388381227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feb9c0ccc10 con 0x7feba8104310 2024-05-08T20:03:31.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.841+0000 7feba659c700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb900a1120 0x7feb900a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:31.832 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.842+0000 7feba659c700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb900a1120 0x7feb900a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb98005950 tx=0x7feb98005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:31.834 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:31.845+0000 7feb977fe700 1 -- 172.21.15.33:0/388381227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7feb9c096450 con 0x7feba8104310 2024-05-08T20:03:32.105 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:32.116+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7feba810c890 con 0x7feba8104310 2024-05-08T20:03:32.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:32 smithi033 ceph-mon[42490]: pgmap v222: 97 pgs: 23 creating+peering, 32 active+clean, 42 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:32.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:32 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1685128044' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T20:03:32.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:32 smithi033 ceph-mon[42490]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:32.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:32 smithi082 ceph-mon[46774]: pgmap v222: 97 pgs: 23 creating+peering, 32 active+clean, 42 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:32.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:32 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1685128044' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T20:03:32.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:32 smithi082 ceph-mon[46774]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:32.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:32 smithi132 ceph-mon[47484]: pgmap v222: 97 pgs: 23 creating+peering, 32 active+clean, 42 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:03:32.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:32 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1685128044' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T20:03:32.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:32 smithi132 ceph-mon[47484]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:33.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.035+0000 7feb977fe700 1 -- 172.21.15.33:0/388381227 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7feb9c0160b0 con 0x7feba8104310 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb900a1120 msgr2=0x7feb900a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb900a1120 0x7feb900a35e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb98005950 tx=0x7feb98005f50 comp rx=0 tx=0).stop 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8104310 msgr2=0x7feba8197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8104310 0x7feba8197580 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d980 tx=0x7feb9c00dd40 comp rx=0 tx=0).stop 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 shutdown_connections 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feba8106c40 0x7feba819e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feb900a1120 0x7feb900a35e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feba81019e0 0x7feba8197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 --2- 172.21.15.33:0/388381227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feba8104310 0x7feba8197580 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 >> 172.21.15.33:0/388381227 conn(0x7feba80fb3f0 msgr2=0x7feba8102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:33.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 shutdown_connections 2024-05-08T20:03:33.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.038+0000 7febaca39700 1 -- 172.21.15.33:0/388381227 wait complete. 2024-05-08T20:03:33.048 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 -- 172.21.15.33:0/3716277112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62700ff7f0 msgr2=0x7f62700ffc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3716277112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62700ff7f0 0x7f62700ffc10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f626c009990 tx=0x7f626c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 -- 172.21.15.33:0/3716277112 shutdown_connections 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3716277112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6270100b10 0x7f6270100f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3716277112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62700ff7f0 0x7f62700ffc10 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3716277112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270100150 0x7f62701005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 -- 172.21.15.33:0/3716277112 >> 172.21.15.33:0/3716277112 conn(0x7f62700fb3f0 msgr2=0x7f62700fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 -- 172.21.15.33:0/3716277112 shutdown_connections 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.204+0000 7f6277f8b700 1 -- 172.21.15.33:0/3716277112 wait complete. 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 Processor -- start 2024-05-08T20:03:33.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 -- start start 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700ff7f0 0x7f62701991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270100150 0x7f62701996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6270100b10 0x7f62701a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701a0cd0 con 0x7f6270100b10 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701a0e10 con 0x7f6270100150 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6277f8b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62701a0fa0 con 0x7f62700ff7f0 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6270100b10 0x7f62701a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6270100b10 0x7f62701a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55360/0 (socket says 172.21.15.33:55360) 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 -- 172.21.15.33:0/3294121821 learned_addr learned my addr 172.21.15.33:0/3294121821 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6275526700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270100150 0x7f62701996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6275d27700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700ff7f0 0x7f62701991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 -- 172.21.15.33:0/3294121821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700ff7f0 msgr2=0x7f62701991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700ff7f0 0x7f62701991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 -- 172.21.15.33:0/3294121821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270100150 msgr2=0x7f62701996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270100150 0x7f62701996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 -- 172.21.15.33:0/3294121821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c0095f0 con 0x7f6270100b10 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.205+0000 7f6276528700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6270100b10 0x7f62701a0700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6268007d70 tx=0x7f626800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.206+0000 7f6266ffd700 1 -- 172.21.15.33:0/3294121821 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626800ad40 con 0x7f6270100b10 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.206+0000 7f6266ffd700 1 -- 172.21.15.33:0/3294121821 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6268012900 con 0x7f6270100b10 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.206+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62701a1280 con 0x7f6270100b10 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.206+0000 7f6266ffd700 1 -- 172.21.15.33:0/3294121821 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6268011780 con 0x7f6270100b10 2024-05-08T20:03:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.206+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62701a1790 con 0x7f6270100b10 2024-05-08T20:03:33.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.207+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627010a780 con 0x7f6270100b10 2024-05-08T20:03:33.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.209+0000 7f6266ffd700 1 -- 172.21.15.33:0/3294121821 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f6268012a70 con 0x7f6270100b10 2024-05-08T20:03:33.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.209+0000 7f6266ffd700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f625c0a1120 0x7f625c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:33.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.210+0000 7f6275d27700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f625c0a1120 0x7f625c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:33.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.210+0000 7f6266ffd700 1 -- 172.21.15.33:0/3294121821 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f62680cced0 con 0x7f6270100b10 2024-05-08T20:03:33.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.210+0000 7f6275d27700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f625c0a1120 0x7f625c0a35e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f626c006010 tx=0x7f626c003880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:33.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.213+0000 7f6266ffd700 1 -- 172.21.15.33:0/3294121821 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6268096710 con 0x7f6270100b10 2024-05-08T20:03:33.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:33 smithi033 ceph-mon[42490]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T20:03:33.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:33 smithi033 ceph-mon[42490]: Cluster is now healthy 2024-05-08T20:03:33.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:33 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/388381227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T20:03:33.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:33 smithi082 ceph-mon[46774]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T20:03:33.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:33 smithi082 ceph-mon[46774]: Cluster is now healthy 2024-05-08T20:03:33.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:33 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/388381227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T20:03:33.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:33 smithi132 ceph-mon[47484]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-08T20:03:33.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:33 smithi132 ceph-mon[47484]: Cluster is now healthy 2024-05-08T20:03:33.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:33 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/388381227' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-05-08T20:03:33.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:33.481+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f6270067460 con 0x7f6270100b10 2024-05-08T20:03:33.871 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:03:33 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b[83545]: 2024-05-08T20:03:33.428+0000 7f9d51b67700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T20:03:33.992 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.003+0000 7f6266ffd700 1 -- 172.21.15.33:0/3294121821 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f6268099d30 con 0x7f6270100b10 2024-05-08T20:03:33.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f625c0a1120 msgr2=0x7f625c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:33.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f625c0a1120 0x7f625c0a35e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f626c006010 tx=0x7f626c003880 comp rx=0 tx=0).stop 2024-05-08T20:03:33.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6270100b10 msgr2=0x7f62701a0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:33.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6270100b10 0x7f62701a0700 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6268007d70 tx=0x7f626800a340 comp rx=0 tx=0).stop 2024-05-08T20:03:33.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 shutdown_connections 2024-05-08T20:03:33.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6270100b10 0x7f62701a0700 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.996 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f625c0a1120 0x7f625c0a35e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62700ff7f0 0x7f62701991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 --2- 172.21.15.33:0/3294121821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6270100150 0x7f62701996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:33.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 >> 172.21.15.33:0/3294121821 conn(0x7f62700fb3f0 msgr2=0x7f62700fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:33.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 shutdown_connections 2024-05-08T20:03:33.997 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.006+0000 7f6277f8b700 1 -- 172.21.15.33:0/3294121821 wait complete. 2024-05-08T20:03:34.016 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 -- 172.21.15.33:0/107028819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102b10 msgr2=0x7f26181093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 --2- 172.21.15.33:0/107028819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102b10 0x7f26181093c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f261000b0d0 tx=0x7f261000b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 -- 172.21.15.33:0/107028819 shutdown_connections 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 --2- 172.21.15.33:0/107028819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102b10 0x7f26181093c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 --2- 172.21.15.33:0/107028819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2618100f80 0x7f26181013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 --2- 172.21.15.33:0/107028819 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2618102170 0x7f26181025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 -- 172.21.15.33:0/107028819 >> 172.21.15.33:0/107028819 conn(0x7f26180fc4f0 msgr2=0x7f26180fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 -- 172.21.15.33:0/107028819 shutdown_connections 2024-05-08T20:03:34.160 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.170+0000 7f261d98d700 1 -- 172.21.15.33:0/107028819 wait complete. 2024-05-08T20:03:34.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 Processor -- start 2024-05-08T20:03:34.161 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 -- start start 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2618100f80 0x7f2618197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102170 0x7f26181975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2618102b10 0x7f261819e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261819eb90 con 0x7f2618102170 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261819ecd0 con 0x7f2618100f80 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f261d98d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261819ee60 con 0x7f2618102b10 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f260e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102170 0x7f26181975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f260e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102170 0x7f26181975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55378/0 (socket says 172.21.15.33:55378) 2024-05-08T20:03:34.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f260e7fc700 1 -- 172.21.15.33:0/3717330627 learned_addr learned my addr 172.21.15.33:0/3717330627 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.171+0000 7f2616ffd700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2618100f80 0x7f2618197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f26177fe700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2618102b10 0x7f261819e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f260e7fc700 1 -- 172.21.15.33:0/3717330627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2618102b10 msgr2=0x7f261819e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f260e7fc700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2618102b10 0x7f261819e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f260e7fc700 1 -- 172.21.15.33:0/3717330627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2618100f80 msgr2=0x7f2618197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f260e7fc700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2618100f80 0x7f2618197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f260e7fc700 1 -- 172.21.15.33:0/3717330627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2610009d00 con 0x7f2618102170 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f260e7fc700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102170 0x7f26181975a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f260000d980 tx=0x7f260000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f261c98b700 1 -- 172.21.15.33:0/3717330627 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600004220 con 0x7f2618102170 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261819f140 con 0x7f2618102170 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f261c98b700 1 -- 172.21.15.33:0/3717330627 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2600007640 con 0x7f2618102170 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f261c98b700 1 -- 172.21.15.33:0/3717330627 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600005720 con 0x7f2618102170 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.172+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261819f650 con 0x7f2618102170 2024-05-08T20:03:34.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.173+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26181082d0 con 0x7f2618102170 2024-05-08T20:03:34.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.174+0000 7f261c98b700 1 -- 172.21.15.33:0/3717330627 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f2600004410 con 0x7f2618102170 2024-05-08T20:03:34.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.175+0000 7f261c98b700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f26040a1120 0x7f26040a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:34.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.175+0000 7f261c98b700 1 -- 172.21.15.33:0/3717330627 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f26000cc5f0 con 0x7f2618102170 2024-05-08T20:03:34.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.175+0000 7f2616ffd700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f26040a1120 0x7f26040a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:34.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.176+0000 7f2616ffd700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f26040a1120 0x7f26040a35e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2618101fd0 tx=0x7f2608009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:34.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.180+0000 7f261c98b700 1 -- 172.21.15.33:0/3717330627 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2600095ed0 con 0x7f2618102170 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/388381227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: pgmap v223: 97 pgs: 23 creating+peering, 59 active+clean, 15 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3294121821' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] up:active 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3294121821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T20:03:34.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T20:03:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T20:03:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: Cluster is now healthy 2024-05-08T20:03:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 2 up:standby-replay 8 up:standby 2024-05-08T20:03:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:creating} 2 up:standby-replay 7 up:standby 2024-05-08T20:03:34.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:34 smithi033 ceph-mon[42490]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T20:03:34.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/388381227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: pgmap v223: 97 pgs: 23 creating+peering, 59 active+clean, 15 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3294121821' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] up:active 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3294121821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: Cluster is now healthy 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 2 up:standby-replay 8 up:standby 2024-05-08T20:03:34.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:creating} 2 up:standby-replay 7 up:standby 2024-05-08T20:03:34.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:34 smithi082 ceph-mon[46774]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/388381227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: daemon mds.g is now active in filesystem cephfs as rank 1 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: pgmap v223: 97 pgs: 23 creating+peering, 59 active+clean, 15 unknown; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s wr, 1 op/s 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3294121821' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] up:active 2024-05-08T20:03:34.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3294121821' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T20:03:34.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T20:03:34.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T20:03:34.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: Cluster is now healthy 2024-05-08T20:03:34.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 2 up:standby-replay 8 up:standby 2024-05-08T20:03:34.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:creating} 2 up:standby-replay 7 up:standby 2024-05-08T20:03:34.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:34 smithi132 ceph-mon[47484]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T20:03:34.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:34.449+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f261810ca90 con 0x7f2618102170 2024-05-08T20:03:35.000 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.011+0000 7f261c98b700 1 -- 172.21.15.33:0/3717330627 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f26000160b0 con 0x7f2618102170 2024-05-08T20:03:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f26040a1120 msgr2=0x7f26040a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f26040a1120 0x7f26040a35e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2618101fd0 tx=0x7f2608009260 comp rx=0 tx=0).stop 2024-05-08T20:03:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102170 msgr2=0x7f26181975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102170 0x7f26181975a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f260000d980 tx=0x7f260000dc90 comp rx=0 tx=0).stop 2024-05-08T20:03:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 shutdown_connections 2024-05-08T20:03:35.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f26040a1120 0x7f26040a35e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2618102b10 0x7f261819e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2618100f80 0x7f2618197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 --2- 172.21.15.33:0/3717330627 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2618102170 0x7f26181975a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.014+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 >> 172.21.15.33:0/3717330627 conn(0x7f26180fc4f0 msgr2=0x7f2618105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.015+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 shutdown_connections 2024-05-08T20:03:35.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.015+0000 7f261d98d700 1 -- 172.21.15.33:0/3717330627 wait complete. 2024-05-08T20:03:35.020 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-05-08T20:03:35.020 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-05-08T20:03:35.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 -- 172.21.15.33:0/3607811450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0100fb0 msgr2=0x7f1ae0101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/3607811450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0100fb0 0x7f1ae0101430 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4009990 tx=0x7f1ad4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 -- 172.21.15.33:0/3607811450 shutdown_connections 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/3607811450 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ae0101970 0x7f1ae0108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/3607811450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae00ffe60 0x7f1ae0100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/3607811450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0100fb0 0x7f1ae0101430 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 -- 172.21.15.33:0/3607811450 >> 172.21.15.33:0/3607811450 conn(0x7f1ae00fb3f0 msgr2=0x7f1ae00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 -- 172.21.15.33:0/3607811450 shutdown_connections 2024-05-08T20:03:35.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.175+0000 7f1ae69c5700 1 -- 172.21.15.33:0/3607811450 wait complete. 2024-05-08T20:03:35.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.176+0000 7f1ae69c5700 1 Processor -- start 2024-05-08T20:03:35.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.176+0000 7f1ae69c5700 1 -- start start 2024-05-08T20:03:35.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae69c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae00ffe60 0x7f1ae0197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae69c5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ae0100fb0 0x7f1ae0197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae69c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0101970 0x7f1ae019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae69c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae019eb40 con 0x7f1ae0101970 2024-05-08T20:03:35.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae69c5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae019ec80 con 0x7f1ae00ffe60 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae69c5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae019ee10 con 0x7f1ae0100fb0 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0101970 0x7f1ae019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0101970 0x7f1ae019e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55408/0 (socket says 172.21.15.33:55408) 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 -- 172.21.15.33:0/1636597678 learned_addr learned my addr 172.21.15.33:0/1636597678 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1adf7fe700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ae0100fb0 0x7f1ae0197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1adffff700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae00ffe60 0x7f1ae0197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 -- 172.21.15.33:0/1636597678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ae0100fb0 msgr2=0x7f1ae0197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ae0100fb0 0x7f1ae0197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 -- 172.21.15.33:0/1636597678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae00ffe60 msgr2=0x7f1ae0197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae00ffe60 0x7f1ae0197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.177+0000 7f1ae4f62700 1 -- 172.21.15.33:0/1636597678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad40095f0 con 0x7f1ae0101970 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.178+0000 7f1ae4f62700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0101970 0x7f1ae019e570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8007ee0 tx=0x7f1ad800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.178+0000 7f1add7fa700 1 -- 172.21.15.33:0/1636597678 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad800dd20 con 0x7f1ae0101970 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.178+0000 7f1add7fa700 1 -- 172.21.15.33:0/1636597678 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ad800f040 con 0x7f1ae0101970 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.178+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae019f0f0 con 0x7f1ae0101970 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.178+0000 7f1add7fa700 1 -- 172.21.15.33:0/1636597678 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad8015400 con 0x7f1ae0101970 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.178+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae019f5b0 con 0x7f1ae0101970 2024-05-08T20:03:35.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.179+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae0067cf0 con 0x7f1ae0101970 2024-05-08T20:03:35.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.180+0000 7f1add7fa700 1 -- 172.21.15.33:0/1636597678 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1ad8003a00 con 0x7f1ae0101970 2024-05-08T20:03:35.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.181+0000 7f1add7fa700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ac80a1120 0x7f1ac80a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.181+0000 7f1add7fa700 1 -- 172.21.15.33:0/1636597678 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1ad80cc7d0 con 0x7f1ae0101970 2024-05-08T20:03:35.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.181+0000 7f1adffff700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ac80a1120 0x7f1ac80a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.181+0000 7f1adffff700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ac80a1120 0x7f1ac80a35e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0005950 tx=0x7f1ad000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:35.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.185+0000 7f1add7fa700 1 -- 172.21.15.33:0/1636597678 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1ad80960b0 con 0x7f1ae0101970 2024-05-08T20:03:35.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:35 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3717330627' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T20:03:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:35 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] up:active 2024-05-08T20:03:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:35 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3717330627' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T20:03:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:35 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-05-08T20:03:35.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:35 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:03:35.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:35 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3717330627' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T20:03:35.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:35 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] up:active 2024-05-08T20:03:35.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:35 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3717330627' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T20:03:35.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:35 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-05-08T20:03:35.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:35 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:03:35.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:35 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3717330627' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T20:03:35.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:35 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] up:active 2024-05-08T20:03:35.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:35 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3717330627' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T20:03:35.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:35 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-05-08T20:03:35.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:35 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:03:35.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.439+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ae0068700 con 0x7f1ac80a1120 2024-05-08T20:03:35.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.466+0000 7f1add7fa700 1 -- 172.21.15.33:0/1636597678 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1ae0068700 con 0x7f1ac80a1120 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ac80a1120 msgr2=0x7f1ac80a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ac80a1120 0x7f1ac80a35e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0005950 tx=0x7f1ad000b410 comp rx=0 tx=0).stop 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0101970 msgr2=0x7f1ae019e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0101970 0x7f1ae019e570 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8007ee0 tx=0x7f1ad800d3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 shutdown_connections 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ae0101970 0x7f1ae019e570 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ae00ffe60 0x7f1ae0197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ac80a1120 0x7f1ac80a35e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 --2- 172.21.15.33:0/1636597678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ae0100fb0 0x7f1ae0197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 >> 172.21.15.33:0/1636597678 conn(0x7f1ae00fb3f0 msgr2=0x7f1ae0067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:35.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 shutdown_connections 2024-05-08T20:03:35.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.468+0000 7f1ae69c5700 1 -- 172.21.15.33:0/1636597678 wait complete. 2024-05-08T20:03:35.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 -- 172.21.15.33:0/1863902793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8106ca0 msgr2=0x7f0ae81090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 --2- 172.21.15.33:0/1863902793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8106ca0 0x7f0ae81090b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ae000b0a0 tx=0x7f0ae000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 -- 172.21.15.33:0/1863902793 shutdown_connections 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 --2- 172.21.15.33:0/1863902793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8106ca0 0x7f0ae81090b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 --2- 172.21.15.33:0/1863902793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ae8101a40 0x7f0ae8103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 --2- 172.21.15.33:0/1863902793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ae8104370 0x7f0ae8106760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 -- 172.21.15.33:0/1863902793 >> 172.21.15.33:0/1863902793 conn(0x7f0ae80fb3f0 msgr2=0x7f0ae80fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 -- 172.21.15.33:0/1863902793 shutdown_connections 2024-05-08T20:03:35.615 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.625+0000 7f0aed125700 1 -- 172.21.15.33:0/1863902793 wait complete. 2024-05-08T20:03:35.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.626+0000 7f0aed125700 1 Processor -- start 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.626+0000 7f0aed125700 1 -- start start 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0aed125700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8101a40 0x7f0ae8101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0aed125700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ae8104370 0x7f0ae80ff9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0aed125700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ae8106ca0 0x7f0ae80fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0aed125700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae8100630 con 0x7f0ae8101a40 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0aed125700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae81007a0 con 0x7f0ae8106ca0 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0aed125700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae81a1150 con 0x7f0ae8104370 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8101a40 0x7f0ae8101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8101a40 0x7f0ae8101310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55434/0 (socket says 172.21.15.33:55434) 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 -- 172.21.15.33:0/4056455103 learned_addr learned my addr 172.21.15.33:0/4056455103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:35.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae659c700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ae8104370 0x7f0ae80ff9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae759e700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ae8106ca0 0x7f0ae80fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 -- 172.21.15.33:0/4056455103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ae8104370 msgr2=0x7f0ae80ff9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ae8104370 0x7f0ae80ff9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 -- 172.21.15.33:0/4056455103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ae8106ca0 msgr2=0x7f0ae80fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ae8106ca0 0x7f0ae80fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.627+0000 7f0ae6d9d700 1 -- 172.21.15.33:0/4056455103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae0009d00 con 0x7f0ae8101a40 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.628+0000 7f0ae6d9d700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8101a40 0x7f0ae8101310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e9a0 tx=0x7f0ad800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.628+0000 7f0adffff700 1 -- 172.21.15.33:0/4056455103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8009790 con 0x7f0ae8101a40 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.628+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae81a13b0 con 0x7f0ae8101a40 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.628+0000 7f0adffff700 1 -- 172.21.15.33:0/4056455103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ad800cbd0 con 0x7f0ae8101a40 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.628+0000 7f0adffff700 1 -- 172.21.15.33:0/4056455103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8018680 con 0x7f0ae8101a40 2024-05-08T20:03:35.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.628+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae81a1910 con 0x7f0ae8101a40 2024-05-08T20:03:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.629+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae80fcf70 con 0x7f0ae8101a40 2024-05-08T20:03:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.630+0000 7f0adffff700 1 -- 172.21.15.33:0/4056455103 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f0ad80188a0 con 0x7f0ae8101a40 2024-05-08T20:03:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.631+0000 7f0adffff700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0ad40a1120 0x7f0ad40a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.631+0000 7f0adffff700 1 -- 172.21.15.33:0/4056455103 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0ad8014070 con 0x7f0ae8101a40 2024-05-08T20:03:35.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.631+0000 7f0ae659c700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0ad40a1120 0x7f0ad40a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:35.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.631+0000 7f0ae659c700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0ad40a1120 0x7f0ad40a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0005950 tx=0x7f0ad000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:35.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.634+0000 7f0adffff700 1 -- 172.21.15.33:0/4056455103 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0ad80967e0 con 0x7f0ae8101a40 2024-05-08T20:03:35.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:03:35 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:03:35.444+0000 7f5b39f25700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:03:35.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:03:35 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:03:35.444+0000 7f5b39f25700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:03:35.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:03:35 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:03:35.444+0000 7f5b39f25700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:03:35.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:03:35 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:03:35.444+0000 7f5b39f25700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:03:35.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:03:35 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:03:35.444+0000 7f5b39f25700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:03:35.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.887+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ae8067cc0 con 0x7f0ad40a1120 2024-05-08T20:03:35.902 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.913+0000 7f0adffff700 1 -- 172.21.15.33:0/4056455103 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0ae8067cc0 con 0x7f0ad40a1120 2024-05-08T20:03:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0ad40a1120 msgr2=0x7f0ad40a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0ad40a1120 0x7f0ad40a35e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0005950 tx=0x7f0ad000b410 comp rx=0 tx=0).stop 2024-05-08T20:03:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8101a40 msgr2=0x7f0ae8101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8101a40 0x7f0ae8101310 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e9a0 tx=0x7f0ad800ecb0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 shutdown_connections 2024-05-08T20:03:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ae8106ca0 0x7f0ae80fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ae8101a40 0x7f0ae8101310 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0ad40a1120 0x7f0ad40a35e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 --2- 172.21.15.33:0/4056455103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ae8104370 0x7f0ae80ff9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:35.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 >> 172.21.15.33:0/4056455103 conn(0x7f0ae80fb3f0 msgr2=0x7f0ae8102380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:35.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 shutdown_connections 2024-05-08T20:03:35.906 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:35.915+0000 7f0aed125700 1 -- 172.21.15.33:0/4056455103 wait complete. 2024-05-08T20:03:35.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-08T20:03:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 -- 172.21.15.33:0/3461802945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20106d00 msgr2=0x7f1e201090f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3461802945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20106d00 0x7f1e201090f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800b0a0 tx=0x7f1e1800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 -- 172.21.15.33:0/3461802945 shutdown_connections 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3461802945 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20106d00 0x7f1e201090f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3461802945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20101aa0 0x7f1e20103e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3461802945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e201043d0 0x7f1e201067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 -- 172.21.15.33:0/3461802945 >> 172.21.15.33:0/3461802945 conn(0x7f1e200fb3f0 msgr2=0x7f1e200fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 -- 172.21.15.33:0/3461802945 shutdown_connections 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 -- 172.21.15.33:0/3461802945 wait complete. 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.077+0000 7f1e24a95700 1 Processor -- start 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e24a95700 1 -- start start 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e24a95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20101aa0 0x7f1e201013c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e24a95700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e201043d0 0x7f1e200ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e24a95700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20106d00 0x7f1e200fff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e24a95700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e20100730 con 0x7f1e20101aa0 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e24a95700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e201008a0 con 0x7f1e20106d00 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e24a95700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e201a10d0 con 0x7f1e201043d0 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20101aa0 0x7f1e201013c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20101aa0 0x7f1e201013c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55460/0 (socket says 172.21.15.33:55460) 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 -- 172.21.15.33:0/3457488622 learned_addr learned my addr 172.21.15.33:0/3457488622 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1dd9b700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e201043d0 0x7f1e200ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1ed9d700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20106d00 0x7f1e200fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 -- 172.21.15.33:0/3457488622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e201043d0 msgr2=0x7f1e200ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e201043d0 0x7f1e200ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 -- 172.21.15.33:0/3457488622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20106d00 msgr2=0x7f1e200fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20106d00 0x7f1e200fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 -- 172.21.15.33:0/3457488622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e18009d00 con 0x7f1e20101aa0 2024-05-08T20:03:36.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1ed9d700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20106d00 0x7f1e200fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.078+0000 7f1e1e59c700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20101aa0 0x7f1e201013c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000c920 tx=0x7f1e1000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.079+0000 7f1e177fe700 1 -- 172.21.15.33:0/3457488622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10007aa0 con 0x7f1e20101aa0 2024-05-08T20:03:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.079+0000 7f1e177fe700 1 -- 172.21.15.33:0/3457488622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1e1000ce70 con 0x7f1e20101aa0 2024-05-08T20:03:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.079+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e201a1360 con 0x7f1e20101aa0 2024-05-08T20:03:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.079+0000 7f1e177fe700 1 -- 172.21.15.33:0/3457488622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10005550 con 0x7f1e20101aa0 2024-05-08T20:03:36.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.079+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e201a1870 con 0x7f1e20101aa0 2024-05-08T20:03:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.080+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e200fcf70 con 0x7f1e20101aa0 2024-05-08T20:03:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.081+0000 7f1e177fe700 1 -- 172.21.15.33:0/3457488622 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7f1e10004750 con 0x7f1e20101aa0 2024-05-08T20:03:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.082+0000 7f1e177fe700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1e0c0a1120 0x7f1e0c0a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.082+0000 7f1e177fe700 1 -- 172.21.15.33:0/3457488622 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1e100cc6f0 con 0x7f1e20101aa0 2024-05-08T20:03:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.082+0000 7f1e1dd9b700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1e0c0a1120 0x7f1e0c0a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.082+0000 7f1e1dd9b700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1e0c0a1120 0x7f1e0c0a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005950 tx=0x7f1e0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:36.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.085+0000 7f1e177fe700 1 -- 172.21.15.33:0/3457488622 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1e10095fd0 con 0x7f1e20101aa0 2024-05-08T20:03:36.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:36 smithi033 ceph-mon[42490]: pgmap v224: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 4.5 KiB/s wr, 14 op/s 2024-05-08T20:03:36.332 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.343+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e20067cc0 con 0x7f1e0c0a1120 2024-05-08T20:03:36.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.348+0000 7f1e177fe700 1 -- 172.21.15.33:0/3457488622 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7f1e20067cc0 con 0x7f1e0c0a1120 2024-05-08T20:03:36.337 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_0/fe06cc56-aca0-4b4f-8663-9e355ec02650 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1e0c0a1120 msgr2=0x7f1e0c0a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1e0c0a1120 0x7f1e0c0a35e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005950 tx=0x7f1e0800b410 comp rx=0 tx=0).stop 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20101aa0 msgr2=0x7f1e201013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20101aa0 0x7f1e201013c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1e1000c920 tx=0x7f1e1000cc30 comp rx=0 tx=0).stop 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 shutdown_connections 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1e20106d00 0x7f1e200fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e20101aa0 0x7f1e201013c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1e0c0a1120 0x7f1e0c0a35e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 --2- 172.21.15.33:0/3457488622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e201043d0 0x7f1e200ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 >> 172.21.15.33:0/3457488622 conn(0x7f1e200fb3f0 msgr2=0x7f1e201024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:36.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 shutdown_connections 2024-05-08T20:03:36.341 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.350+0000 7f1e24a95700 1 -- 172.21.15.33:0/3457488622 wait complete. 2024-05-08T20:03:36.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-08T20:03:36.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:36 smithi082 ceph-mon[46774]: pgmap v224: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 4.5 KiB/s wr, 14 op/s 2024-05-08T20:03:36.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:36 smithi132 ceph-mon[47484]: pgmap v224: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 4.5 KiB/s wr, 14 op/s 2024-05-08T20:03:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 -- 172.21.15.33:0/3337896719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 msgr2=0x7fd1e4103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 --2- 172.21.15.33:0/3337896719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4103dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4009990 tx=0x7fd1d4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 -- 172.21.15.33:0/3337896719 shutdown_connections 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 --2- 172.21.15.33:0/3337896719 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1e4106c40 0x7fd1e41090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 --2- 172.21.15.33:0/3337896719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4103dd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 --2- 172.21.15.33:0/3337896719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e4104310 0x7fd1e4106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 -- 172.21.15.33:0/3337896719 >> 172.21.15.33:0/3337896719 conn(0x7fd1e40fb3f0 msgr2=0x7fd1e40fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 -- 172.21.15.33:0/3337896719 shutdown_connections 2024-05-08T20:03:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.507+0000 7fd1ea737700 1 -- 172.21.15.33:0/3337896719 wait complete. 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 Processor -- start 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 -- start start 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1e4104310 0x7fd1e41974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e4106c40 0x7fd1e419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e419eaa0 con 0x7fd1e41019e0 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e419ebe0 con 0x7fd1e4104310 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1ea737700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e419ed70 con 0x7fd1e4106c40 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55476/0 (socket says 172.21.15.33:55476) 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1e3fff700 1 -- 172.21.15.33:0/1699342463 learned_addr learned my addr 172.21.15.33:0/1699342463 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:36.500 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.508+0000 7fd1e37fe700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1e4104310 0x7fd1e41974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e8cd4700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e4106c40 0x7fd1e419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e3fff700 1 -- 172.21.15.33:0/1699342463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e4106c40 msgr2=0x7fd1e419e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e3fff700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e4106c40 0x7fd1e419e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e3fff700 1 -- 172.21.15.33:0/1699342463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1e4104310 msgr2=0x7fd1e41974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e3fff700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1e4104310 0x7fd1e41974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e3fff700 1 -- 172.21.15.33:0/1699342463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40095f0 con 0x7fd1e41019e0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e8cd4700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e4106c40 0x7fd1e419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e3fff700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4196f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400b5c0 tx=0x7fd1d400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e17fa700 1 -- 172.21.15.33:0/1699342463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d401d070 con 0x7fd1e41019e0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e17fa700 1 -- 172.21.15.33:0/1699342463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd1d400fb80 con 0x7fd1e41019e0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1e17fa700 1 -- 172.21.15.33:0/1699342463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d4017650 con 0x7fd1e41019e0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e419eff0 con 0x7fd1e41019e0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.509+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e419f360 con 0x7fd1e41019e0 2024-05-08T20:03:36.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.510+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e40fcf70 con 0x7fd1e41019e0 2024-05-08T20:03:36.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.511+0000 7fd1e17fa700 1 -- 172.21.15.33:0/1699342463 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fd1d4022470 con 0x7fd1e41019e0 2024-05-08T20:03:36.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.512+0000 7fd1e17fa700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1d00a1120 0x7fd1d00a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.512+0000 7fd1e17fa700 1 -- 172.21.15.33:0/1699342463 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd1d40ce470 con 0x7fd1e41019e0 2024-05-08T20:03:36.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.512+0000 7fd1e37fe700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1d00a1120 0x7fd1d00a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.512+0000 7fd1e37fe700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1d00a1120 0x7fd1d00a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc005950 tx=0x7fd1cc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:36.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.515+0000 7fd1e17fa700 1 -- 172.21.15.33:0/1699342463 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd1d4097d40 con 0x7fd1e41019e0 2024-05-08T20:03:36.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.775+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) v1 -- 0x7fd1e402ce40 con 0x7fd1d00a1120 2024-05-08T20:03:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.798+0000 7fd1e17fa700 1 -- 172.21.15.33:0/1699342463 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd1e402ce40 con 0x7fd1d00a1120 2024-05-08T20:03:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.800+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1d00a1120 msgr2=0x7fd1d00a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.800+0000 7fd1ea737700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1d00a1120 0x7fd1d00a35e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc005950 tx=0x7fd1cc00b410 comp rx=0 tx=0).stop 2024-05-08T20:03:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.800+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 msgr2=0x7fd1e4196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.800+0000 7fd1ea737700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4196f70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd1d400b5c0 tx=0x7fd1d400f690 comp rx=0 tx=0).stop 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 shutdown_connections 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd1d00a1120 0x7fd1d00a35e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1e4106c40 0x7fd1e419e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1e41019e0 0x7fd1e4196f70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 --2- 172.21.15.33:0/1699342463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1e4104310 0x7fd1e41974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 >> 172.21.15.33:0/1699342463 conn(0x7fd1e40fb3f0 msgr2=0x7fd1e4102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 shutdown_connections 2024-05-08T20:03:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.801+0000 7fd1ea737700 1 -- 172.21.15.33:0/1699342463 wait complete. 2024-05-08T20:03:36.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-08T20:03:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3682228891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 msgr2=0x7fe79c1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3682228891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c1093d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe79400b0a0 tx=0x7fe79400b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3682228891 shutdown_connections 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3682228891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c1093d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3682228891 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c100f20 0x7fe79c101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3682228891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe79c1020f0 0x7fe79c102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3682228891 >> 172.21.15.33:0/3682228891 conn(0x7fe79c0fc4e0 msgr2=0x7fe79c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3682228891 shutdown_connections 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.958+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3682228891 wait complete. 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 Processor -- start 2024-05-08T20:03:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 -- start start 2024-05-08T20:03:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c100f20 0x7fe79c074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe79c1020f0 0x7fe79c073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c074070 con 0x7fe79c102ab0 2024-05-08T20:03:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0741e0 con 0x7fe79c100f20 2024-05-08T20:03:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.959+0000 7fe7a0a2e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1a1090 con 0x7fe79c1020f0 2024-05-08T20:03:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c0738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55498/0 (socket says 172.21.15.33:55498) 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 -- 172.21.15.33:0/3535352151 learned_addr learned my addr 172.21.15.33:0/3535352151 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79a59c700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c100f20 0x7fe79c074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe791d9b700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe79c1020f0 0x7fe79c073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 -- 172.21.15.33:0/3535352151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe79c1020f0 msgr2=0x7fe79c073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe79c1020f0 0x7fe79c073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 -- 172.21.15.33:0/3535352151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c100f20 msgr2=0x7fe79c074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c100f20 0x7fe79c074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 -- 172.21.15.33:0/3535352151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe794009d00 con 0x7fe79c102ab0 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe79ad9d700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c0738d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe794007ad0 tx=0x7fe794004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79400e040 con 0x7fe79c102ab0 2024-05-08T20:03:36.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe79400cec0 con 0x7fe79c102ab0 2024-05-08T20:03:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c1a12c0 con 0x7fe79c102ab0 2024-05-08T20:03:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79401dac0 con 0x7fe79c102ab0 2024-05-08T20:03:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.960+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c1a1690 con 0x7fe79c102ab0 2024-05-08T20:03:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.961+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c1082e0 con 0x7fe79c102ab0 2024-05-08T20:03:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.963+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 16) v1 ==== 135873+0+0 (secure 0 0 0) 0x7fe7940058c0 con 0x7fe79c102ab0 2024-05-08T20:03:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.964+0000 7fe793fff700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe7880a1120 0x7fe7880a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.964+0000 7fe79a59c700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe7880a1120 0x7fe7880a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.964+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe79402c030 con 0x7fe79c102ab0 2024-05-08T20:03:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.965+0000 7fe79a59c700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe7880a1120 0x7fe7880a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe79c100c40 tx=0x7fe78c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:36.968+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe7940980f0 con 0x7fe79c102ab0 2024-05-08T20:03:37.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.061+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe7940984c0 con 0x7fe79c102ab0 2024-05-08T20:03:37.070 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:37 smithi033 ceph-mon[42490]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:37 smithi033 ceph-mon[42490]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:37 smithi033 ceph-mon[42490]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.231+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe79c02ce10 con 0x7fe7880a1120 2024-05-08T20:03:37.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.235+0000 7fe793fff700 1 -- 172.21.15.33:0/3535352151 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+54 (secure 0 0 0) 0x7fe79c02ce10 con 0x7fe7880a1120 2024-05-08T20:03:37.224 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/qa/sv_1/a3c000e4-52ed-41ab-926f-9c8c87e10ba4 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe7880a1120 msgr2=0x7fe7880a35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe7880a1120 0x7fe7880a35e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe79c100c40 tx=0x7fe78c00b410 comp rx=0 tx=0).stop 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 msgr2=0x7fe79c0738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c0738d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe794007ad0 tx=0x7fe794004c80 comp rx=0 tx=0).stop 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 shutdown_connections 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe79c102ab0 0x7fe79c0738d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe79c100f20 0x7fe79c074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe7880a1120 0x7fe7880a35e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 --2- 172.21.15.33:0/3535352151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe79c1020f0 0x7fe79c073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 >> 172.21.15.33:0/3535352151 conn(0x7fe79c0fc4e0 msgr2=0x7fe79c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:37.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 shutdown_connections 2024-05-08T20:03:37.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.237+0000 7fe7a0a2e700 1 -- 172.21.15.33:0/3535352151 wait complete. 2024-05-08T20:03:37.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:03:37.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:37 smithi082 ceph-mon[46774]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:37 smithi082 ceph-mon[46774]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:37 smithi082 ceph-mon[46774]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:37 smithi132 ceph-mon[47484]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:37 smithi132 ceph-mon[47484]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:37 smithi132 ceph-mon[47484]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:37.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 -- 172.21.15.33:0/4013154345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40080fffa0 msgr2=0x7f4008100420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 --2- 172.21.15.33:0/4013154345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40080fffa0 0x7f4008100420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009990 tx=0x7f3ff4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 -- 172.21.15.33:0/4013154345 shutdown_connections 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 --2- 172.21.15.33:0/4013154345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4008100960 0x7f4008108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 --2- 172.21.15.33:0/4013154345 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40081013e0 0x7f4008101800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 --2- 172.21.15.33:0/4013154345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40080fffa0 0x7f4008100420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 -- 172.21.15.33:0/4013154345 >> 172.21.15.33:0/4013154345 conn(0x7f40080faa70 msgr2=0x7f40080fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 -- 172.21.15.33:0/4013154345 shutdown_connections 2024-05-08T20:03:37.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.389+0000 7f400f227700 1 -- 172.21.15.33:0/4013154345 wait complete. 2024-05-08T20:03:37.381 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 Processor -- start 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 -- start start 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40080fffa0 0x7f4008196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4008100960 0x7f4008197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40081013e0 0x7f400819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819ea00 con 0x7f40081013e0 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819eb40 con 0x7f4008100960 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400f227700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819ecd0 con 0x7f40080fffa0 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40081013e0 0x7f400819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40081013e0 0x7f400819e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55524/0 (socket says 172.21.15.33:55524) 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 -- 172.21.15.33:0/1251736609 learned_addr learned my addr 172.21.15.33:0/1251736609 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400cfc3700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40080fffa0 0x7f4008196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.382 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f4007fff700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4008100960 0x7f4008197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 -- 172.21.15.33:0/1251736609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40080fffa0 msgr2=0x7f4008196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40080fffa0 0x7f4008196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 -- 172.21.15.33:0/1251736609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4008100960 msgr2=0x7f4008197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4008100960 0x7f4008197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400d7c4700 1 -- 172.21.15.33:0/1251736609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff40095f0 con 0x7f40081013e0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.390+0000 7f400cfc3700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40080fffa0 0x7f4008196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.391+0000 7f400d7c4700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40081013e0 0x7f400819e430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4000007ee0 tx=0x7f400000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.391+0000 7f4005ffb700 1 -- 172.21.15.33:0/1251736609 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000017070 con 0x7f40081013e0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.391+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400819efb0 con 0x7f40081013e0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.391+0000 7f4005ffb700 1 -- 172.21.15.33:0/1251736609 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f400000f040 con 0x7f40081013e0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.391+0000 7f4005ffb700 1 -- 172.21.15.33:0/1251736609 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000005610 con 0x7f40081013e0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.391+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400819f3e0 con 0x7f40081013e0 2024-05-08T20:03:37.383 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.392+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4008067380 con 0x7f40081013e0 2024-05-08T20:03:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.393+0000 7f4005ffb700 1 -- 172.21.15.33:0/1251736609 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4000005790 con 0x7f40081013e0 2024-05-08T20:03:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.394+0000 7f4005ffb700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3ff80a11b0 0x7f3ff80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.394+0000 7f4005ffb700 1 -- 172.21.15.33:0/1251736609 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f40000cbff0 con 0x7f40081013e0 2024-05-08T20:03:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.394+0000 7f400cfc3700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3ff80a11b0 0x7f3ff80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.394+0000 7f400cfc3700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3ff80a11b0 0x7f3ff80a3670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc011490 tx=0x7f3ffc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:37.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.398+0000 7f4005ffb700 1 -- 172.21.15.33:0/1251736609 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f40000957d0 con 0x7f40081013e0 2024-05-08T20:03:37.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.668+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f400810b700 con 0x7f40081013e0 2024-05-08T20:03:37.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.668+0000 7f4005ffb700 1 -- 172.21.15.33:0/1251736609 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10848 (secure 0 0 0) 0x7f4000009390 con 0x7f40081013e0 2024-05-08T20:03:37.658 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:37.658 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:03:35.012471+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:03:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3ff80a11b0 msgr2=0x7f3ff80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3ff80a11b0 0x7f3ff80a3670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc011490 tx=0x7f3ffc009260 comp rx=0 tx=0).stop 2024-05-08T20:03:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40081013e0 msgr2=0x7f400819e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.660 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40081013e0 0x7f400819e430 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4000007ee0 tx=0x7f400000d3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 shutdown_connections 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40081013e0 0x7f400819e430 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3ff80a11b0 0x7f3ff80a3670 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40080fffa0 0x7f4008196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 --2- 172.21.15.33:0/1251736609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4008100960 0x7f4008197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 >> 172.21.15.33:0/1251736609 conn(0x7f40080faa70 msgr2=0x7f40080fc550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 shutdown_connections 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.671+0000 7f400f227700 1 -- 172.21.15.33:0/1251736609 wait complete. 2024-05-08T20:03:37.661 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-05-08T20:03:37.676 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:03:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 -- 172.21.15.33:0/2937879374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e18074f80 msgr2=0x7f6e180733d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/2937879374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e18074f80 0x7f6e180733d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009990 tx=0x7f6e08009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 -- 172.21.15.33:0/2937879374 shutdown_connections 2024-05-08T20:03:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/2937879374 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e18108d40 0x7f6e1810b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/2937879374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e18074f80 0x7f6e180733d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/2937879374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e180739a0 0x7f6e18073e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 -- 172.21.15.33:0/2937879374 >> 172.21.15.33:0/2937879374 conn(0x7f6e180fc400 msgr2=0x7f6e180fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 -- 172.21.15.33:0/2937879374 shutdown_connections 2024-05-08T20:03:37.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.823+0000 7f6e1cee1700 1 -- 172.21.15.33:0/2937879374 wait complete. 2024-05-08T20:03:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 Processor -- start 2024-05-08T20:03:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 -- start start 2024-05-08T20:03:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e180739a0 0x7f6e18199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e18074f80 0x7f6e181995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e18108d40 0x7f6e181a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181a0bb0 con 0x7f6e180739a0 2024-05-08T20:03:37.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181a0cf0 con 0x7f6e18108d40 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.824+0000 7f6e1cee1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181a0e80 con 0x7f6e18074f80 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e180739a0 0x7f6e18199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e180739a0 0x7f6e18199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55548/0 (socket says 172.21.15.33:55548) 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 -- 172.21.15.33:0/1920169626 learned_addr learned my addr 172.21.15.33:0/1920169626 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e16d9d700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e18108d40 0x7f6e181a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e15d9b700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e18074f80 0x7f6e181995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 -- 172.21.15.33:0/1920169626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e18074f80 msgr2=0x7f6e181995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e18074f80 0x7f6e181995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 -- 172.21.15.33:0/1920169626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e18108d40 msgr2=0x7f6e181a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e18108d40 0x7f6e181a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 -- 172.21.15.33:0/1920169626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e080095f0 con 0x7f6e180739a0 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e15d9b700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e18074f80 0x7f6e181995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1659c700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e180739a0 0x7f6e18199080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800b5c0 tx=0x7f6e0800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e077fe700 1 -- 172.21.15.33:0/1920169626 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0801d070 con 0x7f6e180739a0 2024-05-08T20:03:37.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e181a1100 con 0x7f6e180739a0 2024-05-08T20:03:37.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e077fe700 1 -- 172.21.15.33:0/1920169626 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6e0800fb80 con 0x7f6e180739a0 2024-05-08T20:03:37.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e077fe700 1 -- 172.21.15.33:0/1920169626 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e08017650 con 0x7f6e180739a0 2024-05-08T20:03:37.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.825+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e181a1530 con 0x7f6e180739a0 2024-05-08T20:03:37.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.826+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e18107b50 con 0x7f6e180739a0 2024-05-08T20:03:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.828+0000 7f6e077fe700 1 -- 172.21.15.33:0/1920169626 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6e08022470 con 0x7f6e180739a0 2024-05-08T20:03:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.828+0000 7f6e077fe700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6e000a11b0 0x7f6e000a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.829+0000 7f6e15d9b700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6e000a11b0 0x7f6e000a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.829+0000 7f6e077fe700 1 -- 172.21.15.33:0/1920169626 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6e080ce500 con 0x7f6e180739a0 2024-05-08T20:03:37.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.829+0000 7f6e15d9b700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6e000a11b0 0x7f6e000a3670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005950 tx=0x7f6e0c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:37.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:37.832+0000 7f6e077fe700 1 -- 172.21.15.33:0/1920169626 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6e08097d70 con 0x7f6e180739a0 2024-05-08T20:03:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.051+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e1810e9b0 con 0x7f6e180739a0 2024-05-08T20:03:38.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.053+0000 7f6e077fe700 1 -- 172.21.15.33:0/1920169626 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f6e0809b390 con 0x7f6e180739a0 2024-05-08T20:03:38.042 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:38.043 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:30.657561+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6e000a11b0 msgr2=0x7f6e000a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6e000a11b0 0x7f6e000a3670 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c005950 tx=0x7f6e0c0058e0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e180739a0 msgr2=0x7f6e18199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e180739a0 0x7f6e18199080 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800b5c0 tx=0x7f6e0800f690 comp rx=0 tx=0).stop 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 shutdown_connections 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e18108d40 0x7f6e181a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e180739a0 0x7f6e18199080 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6e000a11b0 0x7f6e000a3670 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 --2- 172.21.15.33:0/1920169626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e18074f80 0x7f6e181995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 >> 172.21.15.33:0/1920169626 conn(0x7f6e180fc400 msgr2=0x7f6e18104c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 shutdown_connections 2024-05-08T20:03:38.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.055+0000 7f6e1cee1700 1 -- 172.21.15.33:0/1920169626 wait complete. 2024-05-08T20:03:38.061 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-08T20:03:38.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 -- 172.21.15.33:0/56418437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8101900 msgr2=0x7fabf81081b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/56418437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8101900 0x7fabf81081b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fabf000b0d0 tx=0x7fabf000b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 -- 172.21.15.33:0/56418437 shutdown_connections 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/56418437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8101900 0x7fabf81081b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/56418437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf80ffd70 0x7fabf8100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/56418437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf8100f60 0x7fabf81013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 -- 172.21.15.33:0/56418437 >> 172.21.15.33:0/56418437 conn(0x7fabf80fb300 msgr2=0x7fabf80fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 -- 172.21.15.33:0/56418437 shutdown_connections 2024-05-08T20:03:38.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.210+0000 7fabfcb0e700 1 -- 172.21.15.33:0/56418437 wait complete. 2024-05-08T20:03:38.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 Processor -- start 2024-05-08T20:03:38.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 -- start start 2024-05-08T20:03:38.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf80ffd70 0x7fabf8069ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8100f60 0x7fabf819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf8101900 0x7fabf819e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819ead0 con 0x7fabf8100f60 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819ec40 con 0x7fabf80ffd70 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabfcb0e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf819ee00 con 0x7fabf8101900 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabf5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8100f60 0x7fabf819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabf5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8100f60 0x7fabf819bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55556/0 (socket says 172.21.15.33:55556) 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabf5d9b700 1 -- 172.21.15.33:0/3770797766 learned_addr learned my addr 172.21.15.33:0/3770797766 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabf659c700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf80ffd70 0x7fabf8069ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.211+0000 7fabf6d9d700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf8101900 0x7fabf819e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabf5d9b700 1 -- 172.21.15.33:0/3770797766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf8101900 msgr2=0x7fabf819e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabf5d9b700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf8101900 0x7fabf819e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabf5d9b700 1 -- 172.21.15.33:0/3770797766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf80ffd70 msgr2=0x7fabf8069ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabf5d9b700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf80ffd70 0x7fabf8069ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabf5d9b700 1 -- 172.21.15.33:0/3770797766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf0009d00 con 0x7fabf8100f60 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabf5d9b700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8100f60 0x7fabf819bd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fabec00d980 tx=0x7fabec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabe77fe700 1 -- 172.21.15.33:0/3770797766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec004a30 con 0x7fabf8100f60 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf819f0e0 con 0x7fabf8100f60 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabe77fe700 1 -- 172.21.15.33:0/3770797766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fabec005500 con 0x7fabf8100f60 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabe77fe700 1 -- 172.21.15.33:0/3770797766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec00fc80 con 0x7fabf8100f60 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.212+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf819f5f0 con 0x7fabf8100f60 2024-05-08T20:03:38.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.213+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf8107120 con 0x7fabf8100f60 2024-05-08T20:03:38.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.214+0000 7fabe77fe700 1 -- 172.21.15.33:0/3770797766 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fabec004c90 con 0x7fabf8100f60 2024-05-08T20:03:38.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.215+0000 7fabe77fe700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fabe00a11b0 0x7fabe00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.215+0000 7fabf659c700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fabe00a11b0 0x7fabe00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.215+0000 7fabe77fe700 1 -- 172.21.15.33:0/3770797766 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fabec0cc800 con 0x7fabf8100f60 2024-05-08T20:03:38.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.215+0000 7fabf659c700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fabe00a11b0 0x7fabe00a3670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabf8100dc0 tx=0x7fabe8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:38.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.219+0000 7fabe77fe700 1 -- 172.21.15.33:0/3770797766 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fabec095ee0 con 0x7fabf8100f60 2024-05-08T20:03:38.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:38 smithi033 ceph-mon[42490]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:38.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:38 smithi033 ceph-mon[42490]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-08T20:03:38.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:38 smithi033 ceph-mon[42490]: pgmap v225: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 642 B/s rd, 3.4 KiB/s wr, 13 op/s 2024-05-08T20:03:38.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:38 smithi033 ceph-mon[42490]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:38.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:38 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1251736609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:38.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:38 smithi082 ceph-mon[46774]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:38.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:38 smithi082 ceph-mon[46774]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-08T20:03:38.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:38 smithi082 ceph-mon[46774]: pgmap v225: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 642 B/s rd, 3.4 KiB/s wr, 13 op/s 2024-05-08T20:03:38.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:38 smithi082 ceph-mon[46774]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:38.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:38 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1251736609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:38.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:38 smithi132 ceph-mon[47484]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:38.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:38 smithi132 ceph-mon[47484]: mgrmap e17: x(active, since 5m), standbys: z, y 2024-05-08T20:03:38.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:38 smithi132 ceph-mon[47484]: pgmap v225: 97 pgs: 97 active+clean; 580 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 642 B/s rd, 3.4 KiB/s wr, 13 op/s 2024-05-08T20:03:38.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:38 smithi132 ceph-mon[47484]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:03:38.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:38 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1251736609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:03:38.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.434+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fabf802ce10 con 0x7fabe00a11b0 2024-05-08T20:03:38.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.445+0000 7fabe77fe700 1 -- 172.21.15.33:0/3770797766 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+327921 (secure 0 0 0) 0x7fabf802ce10 con 0x7fabe00a11b0 2024-05-08T20:03:38.440 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:38.442 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fabe00a11b0 msgr2=0x7fabe00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fabe00a11b0 0x7fabe00a3670 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabf8100dc0 tx=0x7fabe8009260 comp rx=0 tx=0).stop 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8100f60 msgr2=0x7fabf819bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8100f60 0x7fabf819bd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fabec00d980 tx=0x7fabec00dc90 comp rx=0 tx=0).stop 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 shutdown_connections 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fabe00a11b0 0x7fabe00a3670 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabf8101900 0x7fabf819e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fabf80ffd70 0x7fabf8069ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 --2- 172.21.15.33:0/3770797766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fabf8100f60 0x7fabf819bd40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 >> 172.21.15.33:0/3770797766 conn(0x7fabf80fb300 msgr2=0x7fabf8104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 shutdown_connections 2024-05-08T20:03:38.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.449+0000 7fabfcb0e700 1 -- 172.21.15.33:0/3770797766 wait complete. 2024-05-08T20:03:38.444 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T20:03:38.453 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-05-08T20:03:37.114271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594178,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":142,"num_read_kb":124,"num_write":281,"num_write_kb":2965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355120,"kb_used_data":10408,"kb_used_omap":18,"kb_used_meta":344557,"kb_avail":1124586704,"statfs":{"total":1151940427776,"available":1151576784896,"internally_reserved":0,"allocated":10657792,"data_stored":6762149,"data_compressed":107118,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19130,"internal_metadata":352826694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3810,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.969717"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.696608+0000","last_change":"2024-05-08T20:03:29.696040+0000","last_active":"2024-05-08T20:03:29.696608+0000","last_peered":"2024-05-08T20:03:29.696608+0000","last_clean":"2024-05-08T20:03:29.696608+0000","last_became_active":"2024-05-08T20:03:29.695312+0000","last_became_peered":"2024-05-08T20:03:29.695312+0000","last_unstale":"2024-05-08T20:03:29.696608+0000","last_undegraded":"2024-05-08T20:03:29.696608+0000","last_fullsized":"2024-05-08T20:03:29.696608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:05.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790102+0000","last_change":"2024-05-08T20:03:29.681157+0000","last_active":"2024-05-08T20:03:31.790102+0000","last_peered":"2024-05-08T20:03:31.790102+0000","last_clean":"2024-05-08T20:03:31.790102+0000","last_became_active":"2024-05-08T20:03:29.680796+0000","last_became_peered":"2024-05-08T20:03:29.680796+0000","last_unstale":"2024-05-08T20:03:31.790102+0000","last_undegraded":"2024-05-08T20:03:31.790102+0000","last_fullsized":"2024-05-08T20:03:31.790102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:49.112158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790228+0000","last_change":"2024-05-08T20:03:29.686199+0000","last_active":"2024-05-08T20:03:31.790228+0000","last_peered":"2024-05-08T20:03:31.790228+0000","last_clean":"2024-05-08T20:03:31.790228+0000","last_became_active":"2024-05-08T20:03:29.685871+0000","last_became_peered":"2024-05-08T20:03:29.685871+0000","last_unstale":"2024-05-08T20:03:31.790228+0000","last_undegraded":"2024-05-08T20:03:31.790228+0000","last_fullsized":"2024-05-08T20:03:31.790228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:45.835061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671020+0000","last_change":"2024-05-08T20:03:29.690931+0000","last_active":"2024-05-08T20:03:30.671020+0000","last_peered":"2024-05-08T20:03:30.671020+0000","last_clean":"2024-05-08T20:03:30.671020+0000","last_became_active":"2024-05-08T20:03:29.690165+0000","last_became_peered":"2024-05-08T20:03:29.690165+0000","last_unstale":"2024-05-08T20:03:30.671020+0000","last_undegraded":"2024-05-08T20:03:30.671020+0000","last_fullsized":"2024-05-08T20:03:30.671020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:25.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790306+0000","last_change":"2024-05-08T20:03:29.675018+0000","last_active":"2024-05-08T20:03:31.790306+0000","last_peered":"2024-05-08T20:03:31.790306+0000","last_clean":"2024-05-08T20:03:31.790306+0000","last_became_active":"2024-05-08T20:03:29.674714+0000","last_became_peered":"2024-05-08T20:03:29.674714+0000","last_unstale":"2024-05-08T20:03:31.790306+0000","last_undegraded":"2024-05-08T20:03:31.790306+0000","last_fullsized":"2024-05-08T20:03:31.790306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:10.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791669+0000","last_change":"2024-05-08T20:03:29.679134+0000","last_active":"2024-05-08T20:03:31.791669+0000","last_peered":"2024-05-08T20:03:31.791669+0000","last_clean":"2024-05-08T20:03:31.791669+0000","last_became_active":"2024-05-08T20:03:29.678853+0000","last_became_peered":"2024-05-08T20:03:29.678853+0000","last_unstale":"2024-05-08T20:03:31.791669+0000","last_undegraded":"2024-05-08T20:03:31.791669+0000","last_fullsized":"2024-05-08T20:03:31.791669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:48.104195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346770+0000","last_change":"2024-05-08T20:03:29.679907+0000","last_active":"2024-05-08T20:03:30.346770+0000","last_peered":"2024-05-08T20:03:30.346770+0000","last_clean":"2024-05-08T20:03:30.346770+0000","last_became_active":"2024-05-08T20:03:29.679565+0000","last_became_peered":"2024-05-08T20:03:29.679565+0000","last_unstale":"2024-05-08T20:03:30.346770+0000","last_undegraded":"2024-05-08T20:03:30.346770+0000","last_fullsized":"2024-05-08T20:03:30.346770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:37.570557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878114+0000","last_change":"2024-05-08T20:03:29.677113+0000","last_active":"2024-05-08T20:03:29.878114+0000","last_peered":"2024-05-08T20:03:29.878114+0000","last_clean":"2024-05-08T20:03:29.878114+0000","last_became_active":"2024-05-08T20:03:29.676762+0000","last_became_peered":"2024-05-08T20:03:29.676762+0000","last_unstale":"2024-05-08T20:03:29.878114+0000","last_undegraded":"2024-05-08T20:03:29.878114+0000","last_fullsized":"2024-05-08T20:03:29.878114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:38.051229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301745+0000","last_change":"2024-05-08T20:03:29.687614+0000","last_active":"2024-05-08T20:03:30.301745+0000","last_peered":"2024-05-08T20:03:30.301745+0000","last_clean":"2024-05-08T20:03:30.301745+0000","last_became_active":"2024-05-08T20:03:29.687288+0000","last_became_peered":"2024-05-08T20:03:29.687288+0000","last_unstale":"2024-05-08T20:03:30.301745+0000","last_undegraded":"2024-05-08T20:03:30.301745+0000","last_fullsized":"2024-05-08T20:03:30.301745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:33.785307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790877+0000","last_change":"2024-05-08T20:03:29.685462+0000","last_active":"2024-05-08T20:03:31.790877+0000","last_peered":"2024-05-08T20:03:31.790877+0000","last_clean":"2024-05-08T20:03:31.790877+0000","last_became_active":"2024-05-08T20:03:29.685133+0000","last_became_peered":"2024-05-08T20:03:29.685133+0000","last_unstale":"2024-05-08T20:03:31.790877+0000","last_undegraded":"2024-05-08T20:03:31.790877+0000","last_fullsized":"2024-05-08T20:03:31.790877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:56.104253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346843+0000","last_change":"2024-05-08T20:03:29.690183+0000","last_active":"2024-05-08T20:03:30.346843+0000","last_peered":"2024-05-08T20:03:30.346843+0000","last_clean":"2024-05-08T20:03:30.346843+0000","last_became_active":"2024-05-08T20:03:29.689740+0000","last_became_peered":"2024-05-08T20:03:29.689740+0000","last_unstale":"2024-05-08T20:03:30.346843+0000","last_undegraded":"2024-05-08T20:03:30.346843+0000","last_fullsized":"2024-05-08T20:03:30.346843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:02.975916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671000+0000","last_change":"2024-05-08T20:03:29.690717+0000","last_active":"2024-05-08T20:03:30.671000+0000","last_peered":"2024-05-08T20:03:30.671000+0000","last_clean":"2024-05-08T20:03:30.671000+0000","last_became_active":"2024-05-08T20:03:29.689845+0000","last_became_peered":"2024-05-08T20:03:29.689845+0000","last_unstale":"2024-05-08T20:03:30.671000+0000","last_undegraded":"2024-05-08T20:03:30.671000+0000","last_fullsized":"2024-05-08T20:03:30.671000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:58.105656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.679134+0000","last_change":"2024-05-08T20:03:29.678031+0000","last_active":"2024-05-08T20:03:29.679134+0000","last_peered":"2024-05-08T20:03:29.679134+0000","last_clean":"2024-05-08T20:03:29.679134+0000","last_became_active":"2024-05-08T20:03:29.677711+0000","last_became_peered":"2024-05-08T20:03:29.677711+0000","last_unstale":"2024-05-08T20:03:29.679134+0000","last_undegraded":"2024-05-08T20:03:29.679134+0000","last_fullsized":"2024-05-08T20:03:29.679134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:44.432527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789896+0000","last_change":"2024-05-08T20:03:29.681551+0000","last_active":"2024-05-08T20:03:31.789896+0000","last_peered":"2024-05-08T20:03:31.789896+0000","last_clean":"2024-05-08T20:03:31.789896+0000","last_became_active":"2024-05-08T20:03:29.680558+0000","last_became_peered":"2024-05-08T20:03:29.680558+0000","last_unstale":"2024-05-08T20:03:31.789896+0000","last_undegraded":"2024-05-08T20:03:31.789896+0000","last_fullsized":"2024-05-08T20:03:31.789896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:40.976066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789942+0000","last_change":"2024-05-08T20:03:29.682503+0000","last_active":"2024-05-08T20:03:31.789942+0000","last_peered":"2024-05-08T20:03:31.789942+0000","last_clean":"2024-05-08T20:03:31.789942+0000","last_became_active":"2024-05-08T20:03:29.675083+0000","last_became_peered":"2024-05-08T20:03:29.675083+0000","last_unstale":"2024-05-08T20:03:31.789942+0000","last_undegraded":"2024-05-08T20:03:31.789942+0000","last_fullsized":"2024-05-08T20:03:31.789942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:19.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301652+0000","last_change":"2024-05-08T20:03:29.693087+0000","last_active":"2024-05-08T20:03:30.301652+0000","last_peered":"2024-05-08T20:03:30.301652+0000","last_clean":"2024-05-08T20:03:30.301652+0000","last_became_active":"2024-05-08T20:03:29.692824+0000","last_became_peered":"2024-05-08T20:03:29.692824+0000","last_unstale":"2024-05-08T20:03:30.301652+0000","last_undegraded":"2024-05-08T20:03:30.301652+0000","last_fullsized":"2024-05-08T20:03:30.301652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:58.653115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.696665+0000","last_change":"2024-05-08T20:03:29.696363+0000","last_active":"2024-05-08T20:03:29.696665+0000","last_peered":"2024-05-08T20:03:29.696665+0000","last_clean":"2024-05-08T20:03:29.696665+0000","last_became_active":"2024-05-08T20:03:29.695742+0000","last_became_peered":"2024-05-08T20:03:29.695742+0000","last_unstale":"2024-05-08T20:03:29.696665+0000","last_undegraded":"2024-05-08T20:03:29.696665+0000","last_fullsized":"2024-05-08T20:03:29.696665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:34.085822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857275+0000","last_change":"2024-05-08T20:03:29.680245+0000","last_active":"2024-05-08T20:03:30.857275+0000","last_peered":"2024-05-08T20:03:30.857275+0000","last_clean":"2024-05-08T20:03:30.857275+0000","last_became_active":"2024-05-08T20:03:29.679921+0000","last_became_peered":"2024-05-08T20:03:29.679921+0000","last_unstale":"2024-05-08T20:03:30.857275+0000","last_undegraded":"2024-05-08T20:03:30.857275+0000","last_fullsized":"2024-05-08T20:03:30.857275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:31.013564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466500+0000","last_change":"2024-05-08T20:03:29.680303+0000","last_active":"2024-05-08T20:03:31.466500+0000","last_peered":"2024-05-08T20:03:31.466500+0000","last_clean":"2024-05-08T20:03:31.466500+0000","last_became_active":"2024-05-08T20:03:29.679406+0000","last_became_peered":"2024-05-08T20:03:29.679406+0000","last_unstale":"2024-05-08T20:03:31.466500+0000","last_undegraded":"2024-05-08T20:03:31.466500+0000","last_fullsized":"2024-05-08T20:03:31.466500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:44.353488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018724+0000","last_change":"2024-05-08T20:03:29.159444+0000","last_active":"2024-05-08T20:03:34.018724+0000","last_peered":"2024-05-08T20:03:34.018724+0000","last_clean":"2024-05-08T20:03:34.018724+0000","last_became_active":"2024-05-08T20:03:29.159024+0000","last_became_peered":"2024-05-08T20:03:29.159024+0000","last_unstale":"2024-05-08T20:03:34.018724+0000","last_undegraded":"2024-05-08T20:03:34.018724+0000","last_fullsized":"2024-05-08T20:03:34.018724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:49.855043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878188+0000","last_change":"2024-05-08T20:03:29.679721+0000","last_active":"2024-05-08T20:03:29.878188+0000","last_peered":"2024-05-08T20:03:29.878188+0000","last_clean":"2024-05-08T20:03:29.878188+0000","last_became_active":"2024-05-08T20:03:29.679424+0000","last_became_peered":"2024-05-08T20:03:29.679424+0000","last_unstale":"2024-05-08T20:03:29.878188+0000","last_undegraded":"2024-05-08T20:03:29.878188+0000","last_fullsized":"2024-05-08T20:03:29.878188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:21.133074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790826+0000","last_change":"2024-05-08T20:03:29.169000+0000","last_active":"2024-05-08T20:03:31.790826+0000","last_peered":"2024-05-08T20:03:31.790826+0000","last_clean":"2024-05-08T20:03:31.790826+0000","last_became_active":"2024-05-08T20:03:29.164576+0000","last_became_peered":"2024-05-08T20:03:29.164576+0000","last_unstale":"2024-05-08T20:03:31.790826+0000","last_undegraded":"2024-05-08T20:03:31.790826+0000","last_fullsized":"2024-05-08T20:03:31.790826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:19.961768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790561+0000","last_change":"2024-05-08T20:03:29.686350+0000","last_active":"2024-05-08T20:03:31.790561+0000","last_peered":"2024-05-08T20:03:31.790561+0000","last_clean":"2024-05-08T20:03:31.790561+0000","last_became_active":"2024-05-08T20:03:29.686016+0000","last_became_peered":"2024-05-08T20:03:29.686016+0000","last_unstale":"2024-05-08T20:03:31.790561+0000","last_undegraded":"2024-05-08T20:03:31.790561+0000","last_fullsized":"2024-05-08T20:03:31.790561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:18.727685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.692694+0000","last_change":"2024-05-08T20:03:29.161691+0000","last_active":"2024-05-08T20:03:29.692694+0000","last_peered":"2024-05-08T20:03:29.692694+0000","last_clean":"2024-05-08T20:03:29.692694+0000","last_became_active":"2024-05-08T20:03:29.161328+0000","last_became_peered":"2024-05-08T20:03:29.161328+0000","last_unstale":"2024-05-08T20:03:29.692694+0000","last_undegraded":"2024-05-08T20:03:29.692694+0000","last_fullsized":"2024-05-08T20:03:29.692694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:08.183440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301699+0000","last_change":"2024-05-08T20:03:29.688528+0000","last_active":"2024-05-08T20:03:30.301699+0000","last_peered":"2024-05-08T20:03:30.301699+0000","last_clean":"2024-05-08T20:03:30.301699+0000","last_became_active":"2024-05-08T20:03:29.688211+0000","last_became_peered":"2024-05-08T20:03:29.688211+0000","last_unstale":"2024-05-08T20:03:30.301699+0000","last_undegraded":"2024-05-08T20:03:30.301699+0000","last_fullsized":"2024-05-08T20:03:30.301699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:01.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694883+0000","last_change":"2024-05-08T20:03:29.158484+0000","last_active":"2024-05-08T20:03:29.694883+0000","last_peered":"2024-05-08T20:03:29.694883+0000","last_clean":"2024-05-08T20:03:29.694883+0000","last_became_active":"2024-05-08T20:03:29.158116+0000","last_became_peered":"2024-05-08T20:03:29.158116+0000","last_unstale":"2024-05-08T20:03:29.694883+0000","last_undegraded":"2024-05-08T20:03:29.694883+0000","last_fullsized":"2024-05-08T20:03:29.694883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:13.955725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670971+0000","last_change":"2024-05-08T20:03:29.688895+0000","last_active":"2024-05-08T20:03:30.670971+0000","last_peered":"2024-05-08T20:03:30.670971+0000","last_clean":"2024-05-08T20:03:30.670971+0000","last_became_active":"2024-05-08T20:03:29.688571+0000","last_became_peered":"2024-05-08T20:03:29.688571+0000","last_unstale":"2024-05-08T20:03:30.670971+0000","last_undegraded":"2024-05-08T20:03:30.670971+0000","last_fullsized":"2024-05-08T20:03:30.670971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:19.722428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.007836+0000","last_change":"2024-05-08T20:03:29.159927+0000","last_active":"2024-05-08T20:03:34.007836+0000","last_peered":"2024-05-08T20:03:34.007836+0000","last_clean":"2024-05-08T20:03:34.007836+0000","last_became_active":"2024-05-08T20:03:29.159608+0000","last_became_peered":"2024-05-08T20:03:29.159608+0000","last_unstale":"2024-05-08T20:03:34.007836+0000","last_undegraded":"2024-05-08T20:03:34.007836+0000","last_fullsized":"2024-05-08T20:03:34.007836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:17.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790183+0000","last_change":"2024-05-08T20:03:29.676181+0000","last_active":"2024-05-08T20:03:31.790183+0000","last_peered":"2024-05-08T20:03:31.790183+0000","last_clean":"2024-05-08T20:03:31.790183+0000","last_became_active":"2024-05-08T20:03:29.675823+0000","last_became_peered":"2024-05-08T20:03:29.675823+0000","last_unstale":"2024-05-08T20:03:31.790183+0000","last_undegraded":"2024-05-08T20:03:31.790183+0000","last_fullsized":"2024-05-08T20:03:31.790183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:42.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.684590+0000","last_change":"2024-05-08T20:03:29.156803+0000","last_active":"2024-05-08T20:03:29.684590+0000","last_peered":"2024-05-08T20:03:29.684590+0000","last_clean":"2024-05-08T20:03:29.684590+0000","last_became_active":"2024-05-08T20:03:29.156114+0000","last_became_peered":"2024-05-08T20:03:29.156114+0000","last_unstale":"2024-05-08T20:03:29.684590+0000","last_undegraded":"2024-05-08T20:03:29.684590+0000","last_fullsized":"2024-05-08T20:03:29.684590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:11.964529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670789+0000","last_change":"2024-05-08T20:03:29.677259+0000","last_active":"2024-05-08T20:03:30.670789+0000","last_peered":"2024-05-08T20:03:30.670789+0000","last_clean":"2024-05-08T20:03:30.670789+0000","last_became_active":"2024-05-08T20:03:29.676885+0000","last_became_peered":"2024-05-08T20:03:29.676885+0000","last_unstale":"2024-05-08T20:03:30.670789+0000","last_undegraded":"2024-05-08T20:03:30.670789+0000","last_fullsized":"2024-05-08T20:03:30.670789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:18.152813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018316+0000","last_change":"2024-05-08T20:03:29.162317+0000","last_active":"2024-05-08T20:03:34.018316+0000","last_peered":"2024-05-08T20:03:34.018316+0000","last_clean":"2024-05-08T20:03:34.018316+0000","last_became_active":"2024-05-08T20:03:29.161961+0000","last_became_peered":"2024-05-08T20:03:29.161961+0000","last_unstale":"2024-05-08T20:03:34.018316+0000","last_undegraded":"2024-05-08T20:03:34.018316+0000","last_fullsized":"2024-05-08T20:03:34.018316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:36.379021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878091+0000","last_change":"2024-05-08T20:03:29.672527+0000","last_active":"2024-05-08T20:03:29.878091+0000","last_peered":"2024-05-08T20:03:29.878091+0000","last_clean":"2024-05-08T20:03:29.878091+0000","last_became_active":"2024-05-08T20:03:29.672199+0000","last_became_peered":"2024-05-08T20:03:29.672199+0000","last_unstale":"2024-05-08T20:03:29.878091+0000","last_undegraded":"2024-05-08T20:03:29.878091+0000","last_fullsized":"2024-05-08T20:03:29.878091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:47.833015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670738+0000","last_change":"2024-05-08T20:03:29.160639+0000","last_active":"2024-05-08T20:03:30.670738+0000","last_peered":"2024-05-08T20:03:30.670738+0000","last_clean":"2024-05-08T20:03:30.670738+0000","last_became_active":"2024-05-08T20:03:29.160291+0000","last_became_peered":"2024-05-08T20:03:29.160291+0000","last_unstale":"2024-05-08T20:03:30.670738+0000","last_undegraded":"2024-05-08T20:03:30.670738+0000","last_fullsized":"2024-05-08T20:03:30.670738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:56.126764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857096+0000","last_change":"2024-05-08T20:03:29.677339+0000","last_active":"2024-05-08T20:03:30.857096+0000","last_peered":"2024-05-08T20:03:30.857096+0000","last_clean":"2024-05-08T20:03:30.857096+0000","last_became_active":"2024-05-08T20:03:29.676954+0000","last_became_peered":"2024-05-08T20:03:29.676954+0000","last_unstale":"2024-05-08T20:03:30.857096+0000","last_undegraded":"2024-05-08T20:03:30.857096+0000","last_fullsized":"2024-05-08T20:03:30.857096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048671+0000","last_change":"2024-05-08T20:03:29.156873+0000","last_active":"2024-05-08T20:03:33.048671+0000","last_peered":"2024-05-08T20:03:33.048671+0000","last_clean":"2024-05-08T20:03:33.048671+0000","last_became_active":"2024-05-08T20:03:29.156130+0000","last_became_peered":"2024-05-08T20:03:29.156130+0000","last_unstale":"2024-05-08T20:03:33.048671+0000","last_undegraded":"2024-05-08T20:03:33.048671+0000","last_fullsized":"2024-05-08T20:03:33.048671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:31.410319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301731+0000","last_change":"2024-05-08T20:03:29.680591+0000","last_active":"2024-05-08T20:03:30.301731+0000","last_peered":"2024-05-08T20:03:30.301731+0000","last_clean":"2024-05-08T20:03:30.301731+0000","last_became_active":"2024-05-08T20:03:29.680311+0000","last_became_peered":"2024-05-08T20:03:29.680311+0000","last_unstale":"2024-05-08T20:03:30.301731+0000","last_undegraded":"2024-05-08T20:03:30.301731+0000","last_fullsized":"2024-05-08T20:03:30.301731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:51.343586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049047+0000","last_change":"2024-05-08T20:03:29.165504+0000","last_active":"2024-05-08T20:03:33.049047+0000","last_peered":"2024-05-08T20:03:33.049047+0000","last_clean":"2024-05-08T20:03:33.049047+0000","last_became_active":"2024-05-08T20:03:29.164251+0000","last_became_peered":"2024-05-08T20:03:29.164251+0000","last_unstale":"2024-05-08T20:03:33.049047+0000","last_undegraded":"2024-05-08T20:03:33.049047+0000","last_fullsized":"2024-05-08T20:03:33.049047+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:51.771014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790469+0000","last_change":"2024-05-08T20:03:29.684880+0000","last_active":"2024-05-08T20:03:31.790469+0000","last_peered":"2024-05-08T20:03:31.790469+0000","last_clean":"2024-05-08T20:03:31.790469+0000","last_became_active":"2024-05-08T20:03:29.683216+0000","last_became_peered":"2024-05-08T20:03:29.683216+0000","last_unstale":"2024-05-08T20:03:31.790469+0000","last_undegraded":"2024-05-08T20:03:31.790469+0000","last_fullsized":"2024-05-08T20:03:31.790469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:12.695393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049436+0000","last_change":"2024-05-08T20:03:29.157211+0000","last_active":"2024-05-08T20:03:33.049436+0000","last_peered":"2024-05-08T20:03:33.049436+0000","last_clean":"2024-05-08T20:03:33.049436+0000","last_became_active":"2024-05-08T20:03:29.156761+0000","last_became_peered":"2024-05-08T20:03:29.156761+0000","last_unstale":"2024-05-08T20:03:33.049436+0000","last_undegraded":"2024-05-08T20:03:33.049436+0000","last_fullsized":"2024-05-08T20:03:33.049436+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:27.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301709+0000","last_change":"2024-05-08T20:03:29.686949+0000","last_active":"2024-05-08T20:03:30.301709+0000","last_peered":"2024-05-08T20:03:30.301709+0000","last_clean":"2024-05-08T20:03:30.301709+0000","last_became_active":"2024-05-08T20:03:29.686634+0000","last_became_peered":"2024-05-08T20:03:29.686634+0000","last_unstale":"2024-05-08T20:03:30.301709+0000","last_undegraded":"2024-05-08T20:03:30.301709+0000","last_fullsized":"2024-05-08T20:03:30.301709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:27.560636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'8","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048581+0000","last_change":"2024-05-08T20:03:29.156991+0000","last_active":"2024-05-08T20:03:33.048581+0000","last_peered":"2024-05-08T20:03:33.048581+0000","last_clean":"2024-05-08T20:03:33.048581+0000","last_became_active":"2024-05-08T20:03:29.156570+0000","last_became_peered":"2024-05-08T20:03:29.156570+0000","last_unstale":"2024-05-08T20:03:33.048581+0000","last_undegraded":"2024-05-08T20:03:33.048581+0000","last_fullsized":"2024-05-08T20:03:33.048581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:05.001469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790529+0000","last_change":"2024-05-08T20:03:29.684822+0000","last_active":"2024-05-08T20:03:31.790529+0000","last_peered":"2024-05-08T20:03:31.790529+0000","last_clean":"2024-05-08T20:03:31.790529+0000","last_became_active":"2024-05-08T20:03:29.684455+0000","last_became_peered":"2024-05-08T20:03:29.684455+0000","last_unstale":"2024-05-08T20:03:31.790529+0000","last_undegraded":"2024-05-08T20:03:31.790529+0000","last_fullsized":"2024-05-08T20:03:31.790529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:28.982158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466444+0000","last_change":"2024-05-08T20:03:29.165831+0000","last_active":"2024-05-08T20:03:31.466444+0000","last_peered":"2024-05-08T20:03:31.466444+0000","last_clean":"2024-05-08T20:03:31.466444+0000","last_became_active":"2024-05-08T20:03:29.165493+0000","last_became_peered":"2024-05-08T20:03:29.165493+0000","last_unstale":"2024-05-08T20:03:31.466444+0000","last_undegraded":"2024-05-08T20:03:31.466444+0000","last_fullsized":"2024-05-08T20:03:31.466444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:56.507752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678998+0000","last_change":"2024-05-08T20:03:29.675564+0000","last_active":"2024-05-08T20:03:29.678998+0000","last_peered":"2024-05-08T20:03:29.678998+0000","last_clean":"2024-05-08T20:03:29.678998+0000","last_became_active":"2024-05-08T20:03:29.675228+0000","last_became_peered":"2024-05-08T20:03:29.675228+0000","last_unstale":"2024-05-08T20:03:29.678998+0000","last_undegraded":"2024-05-08T20:03:29.678998+0000","last_fullsized":"2024-05-08T20:03:29.678998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:16.646254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049236+0000","last_change":"2024-05-08T20:03:29.161586+0000","last_active":"2024-05-08T20:03:33.049236+0000","last_peered":"2024-05-08T20:03:33.049236+0000","last_clean":"2024-05-08T20:03:33.049236+0000","last_became_active":"2024-05-08T20:03:29.161158+0000","last_became_peered":"2024-05-08T20:03:29.161158+0000","last_unstale":"2024-05-08T20:03:33.049236+0000","last_undegraded":"2024-05-08T20:03:33.049236+0000","last_fullsized":"2024-05-08T20:03:33.049236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:35.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346806+0000","last_change":"2024-05-08T20:03:29.680216+0000","last_active":"2024-05-08T20:03:30.346806+0000","last_peered":"2024-05-08T20:03:30.346806+0000","last_clean":"2024-05-08T20:03:30.346806+0000","last_became_active":"2024-05-08T20:03:29.679855+0000","last_became_peered":"2024-05-08T20:03:29.679855+0000","last_unstale":"2024-05-08T20:03:30.346806+0000","last_undegraded":"2024-05-08T20:03:30.346806+0000","last_fullsized":"2024-05-08T20:03:30.346806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:14.995587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.665365+0000","last_change":"2024-05-08T20:03:29.160134+0000","last_active":"2024-05-08T20:03:29.665365+0000","last_peered":"2024-05-08T20:03:29.665365+0000","last_clean":"2024-05-08T20:03:29.665365+0000","last_became_active":"2024-05-08T20:03:29.159782+0000","last_became_peered":"2024-05-08T20:03:29.159782+0000","last_unstale":"2024-05-08T20:03:29.665365+0000","last_undegraded":"2024-05-08T20:03:29.665365+0000","last_fullsized":"2024-05-08T20:03:29.665365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:10.580761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346697+0000","last_change":"2024-05-08T20:03:29.677050+0000","last_active":"2024-05-08T20:03:30.346697+0000","last_peered":"2024-05-08T20:03:30.346697+0000","last_clean":"2024-05-08T20:03:30.346697+0000","last_became_active":"2024-05-08T20:03:29.676685+0000","last_became_peered":"2024-05-08T20:03:29.676685+0000","last_unstale":"2024-05-08T20:03:30.346697+0000","last_undegraded":"2024-05-08T20:03:30.346697+0000","last_fullsized":"2024-05-08T20:03:30.346697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:39.115370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'10","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048501+0000","last_change":"2024-05-08T20:03:29.165983+0000","last_active":"2024-05-08T20:03:33.048501+0000","last_peered":"2024-05-08T20:03:33.048501+0000","last_clean":"2024-05-08T20:03:33.048501+0000","last_became_active":"2024-05-08T20:03:29.165645+0000","last_became_peered":"2024-05-08T20:03:29.165645+0000","last_unstale":"2024-05-08T20:03:33.048501+0000","last_undegraded":"2024-05-08T20:03:33.048501+0000","last_fullsized":"2024-05-08T20:03:33.048501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:50.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670619+0000","last_change":"2024-05-08T20:03:29.688949+0000","last_active":"2024-05-08T20:03:30.670619+0000","last_peered":"2024-05-08T20:03:30.670619+0000","last_clean":"2024-05-08T20:03:30.670619+0000","last_became_active":"2024-05-08T20:03:29.687174+0000","last_became_peered":"2024-05-08T20:03:29.687174+0000","last_unstale":"2024-05-08T20:03:30.670619+0000","last_undegraded":"2024-05-08T20:03:30.670619+0000","last_fullsized":"2024-05-08T20:03:30.670619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:27.751738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694769+0000","last_change":"2024-05-08T20:03:29.162951+0000","last_active":"2024-05-08T20:03:29.694769+0000","last_peered":"2024-05-08T20:03:29.694769+0000","last_clean":"2024-05-08T20:03:29.694769+0000","last_became_active":"2024-05-08T20:03:29.162589+0000","last_became_peered":"2024-05-08T20:03:29.162589+0000","last_unstale":"2024-05-08T20:03:29.694769+0000","last_undegraded":"2024-05-08T20:03:29.694769+0000","last_fullsized":"2024-05-08T20:03:29.694769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.185986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.693210+0000","last_change":"2024-05-08T20:03:29.692187+0000","last_active":"2024-05-08T20:03:29.693210+0000","last_peered":"2024-05-08T20:03:29.693210+0000","last_clean":"2024-05-08T20:03:29.693210+0000","last_became_active":"2024-05-08T20:03:29.691853+0000","last_became_peered":"2024-05-08T20:03:29.691853+0000","last_unstale":"2024-05-08T20:03:29.693210+0000","last_undegraded":"2024-05-08T20:03:29.693210+0000","last_fullsized":"2024-05-08T20:03:29.693210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:24.907475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857193+0000","last_change":"2024-05-08T20:03:29.159695+0000","last_active":"2024-05-08T20:03:30.857193+0000","last_peered":"2024-05-08T20:03:30.857193+0000","last_clean":"2024-05-08T20:03:30.857193+0000","last_became_active":"2024-05-08T20:03:29.159358+0000","last_became_peered":"2024-05-08T20:03:29.159358+0000","last_unstale":"2024-05-08T20:03:30.857193+0000","last_undegraded":"2024-05-08T20:03:30.857193+0000","last_fullsized":"2024-05-08T20:03:30.857193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:04.211835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791312+0000","last_change":"2024-05-08T20:03:29.685490+0000","last_active":"2024-05-08T20:03:31.791312+0000","last_peered":"2024-05-08T20:03:31.791312+0000","last_clean":"2024-05-08T20:03:31.791312+0000","last_became_active":"2024-05-08T20:03:29.685153+0000","last_became_peered":"2024-05-08T20:03:29.685153+0000","last_unstale":"2024-05-08T20:03:31.791312+0000","last_undegraded":"2024-05-08T20:03:31.791312+0000","last_fullsized":"2024-05-08T20:03:31.791312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:32.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790920+0000","last_change":"2024-05-08T20:03:29.168932+0000","last_active":"2024-05-08T20:03:31.790920+0000","last_peered":"2024-05-08T20:03:31.790920+0000","last_clean":"2024-05-08T20:03:31.790920+0000","last_became_active":"2024-05-08T20:03:29.168625+0000","last_became_peered":"2024-05-08T20:03:29.168625+0000","last_unstale":"2024-05-08T20:03:31.790920+0000","last_undegraded":"2024-05-08T20:03:31.790920+0000","last_fullsized":"2024-05-08T20:03:31.790920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:06.360590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790862+0000","last_change":"2024-05-08T20:03:29.679318+0000","last_active":"2024-05-08T20:03:31.790862+0000","last_peered":"2024-05-08T20:03:31.790862+0000","last_clean":"2024-05-08T20:03:31.790862+0000","last_became_active":"2024-05-08T20:03:29.678986+0000","last_became_peered":"2024-05-08T20:03:29.678986+0000","last_unstale":"2024-05-08T20:03:31.790862+0000","last_undegraded":"2024-05-08T20:03:31.790862+0000","last_fullsized":"2024-05-08T20:03:31.790862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:01.320483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670997+0000","last_change":"2024-05-08T20:03:29.685281+0000","last_active":"2024-05-08T20:03:30.670997+0000","last_peered":"2024-05-08T20:03:30.670997+0000","last_clean":"2024-05-08T20:03:30.670997+0000","last_became_active":"2024-05-08T20:03:29.684501+0000","last_became_peered":"2024-05-08T20:03:29.684501+0000","last_unstale":"2024-05-08T20:03:30.670997+0000","last_undegraded":"2024-05-08T20:03:30.670997+0000","last_fullsized":"2024-05-08T20:03:30.670997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:39.638911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.020210+0000","last_change":"2024-05-08T20:03:29.165278+0000","last_active":"2024-05-08T20:03:34.020210+0000","last_peered":"2024-05-08T20:03:34.020210+0000","last_clean":"2024-05-08T20:03:34.020210+0000","last_became_active":"2024-05-08T20:03:29.164901+0000","last_became_peered":"2024-05-08T20:03:29.164901+0000","last_unstale":"2024-05-08T20:03:34.020210+0000","last_undegraded":"2024-05-08T20:03:34.020210+0000","last_fullsized":"2024-05-08T20:03:34.020210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:43.034192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878165+0000","last_change":"2024-05-08T20:03:29.685296+0000","last_active":"2024-05-08T20:03:29.878165+0000","last_peered":"2024-05-08T20:03:29.878165+0000","last_clean":"2024-05-08T20:03:29.878165+0000","last_became_active":"2024-05-08T20:03:29.684909+0000","last_became_peered":"2024-05-08T20:03:29.684909+0000","last_unstale":"2024-05-08T20:03:29.878165+0000","last_undegraded":"2024-05-08T20:03:29.878165+0000","last_fullsized":"2024-05-08T20:03:29.878165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.092769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048822+0000","last_change":"2024-05-08T20:03:29.158016+0000","last_active":"2024-05-08T20:03:33.048822+0000","last_peered":"2024-05-08T20:03:33.048822+0000","last_clean":"2024-05-08T20:03:33.048822+0000","last_became_active":"2024-05-08T20:03:29.157635+0000","last_became_peered":"2024-05-08T20:03:29.157635+0000","last_unstale":"2024-05-08T20:03:33.048822+0000","last_undegraded":"2024-05-08T20:03:33.048822+0000","last_fullsized":"2024-05-08T20:03:33.048822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:55.355837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.664978+0000","last_change":"2024-05-08T20:02:41.684821+0000","last_active":"2024-05-08T20:03:29.664978+0000","last_peered":"2024-05-08T20:03:29.664978+0000","last_clean":"2024-05-08T20:03:29.664978+0000","last_became_active":"2024-05-08T20:02:41.684413+0000","last_became_peered":"2024-05-08T20:02:41.684413+0000","last_unstale":"2024-05-08T20:03:29.664978+0000","last_undegraded":"2024-05-08T20:03:29.664978+0000","last_fullsized":"2024-05-08T20:03:29.664978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_clean_scrub_stamp":"2024-05-08T20:00:17.645281+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:03.139734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678805+0000","last_change":"2024-05-08T20:03:29.674487+0000","last_active":"2024-05-08T20:03:29.678805+0000","last_peered":"2024-05-08T20:03:29.678805+0000","last_clean":"2024-05-08T20:03:29.678805+0000","last_became_active":"2024-05-08T20:03:29.674122+0000","last_became_peered":"2024-05-08T20:03:29.674122+0000","last_unstale":"2024-05-08T20:03:29.678805+0000","last_undegraded":"2024-05-08T20:03:29.678805+0000","last_fullsized":"2024-05-08T20:03:29.678805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:38.401296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018435+0000","last_change":"2024-05-08T20:03:29.165420+0000","last_active":"2024-05-08T20:03:34.018435+0000","last_peered":"2024-05-08T20:03:34.018435+0000","last_clean":"2024-05-08T20:03:34.018435+0000","last_became_active":"2024-05-08T20:03:29.165075+0000","last_became_peered":"2024-05-08T20:03:29.165075+0000","last_unstale":"2024-05-08T20:03:34.018435+0000","last_undegraded":"2024-05-08T20:03:34.018435+0000","last_fullsized":"2024-05-08T20:03:34.018435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:28.980327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790495+0000","last_change":"2024-05-08T20:03:29.165940+0000","last_active":"2024-05-08T20:03:31.790495+0000","last_peered":"2024-05-08T20:03:31.790495+0000","last_clean":"2024-05-08T20:03:31.790495+0000","last_became_active":"2024-05-08T20:03:29.165615+0000","last_became_peered":"2024-05-08T20:03:29.165615+0000","last_unstale":"2024-05-08T20:03:31.790495+0000","last_undegraded":"2024-05-08T20:03:31.790495+0000","last_fullsized":"2024-05-08T20:03:31.790495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:28.066975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.675324+0000","last_change":"2024-05-08T20:03:29.674172+0000","last_active":"2024-05-08T20:03:29.675324+0000","last_peered":"2024-05-08T20:03:29.675324+0000","last_clean":"2024-05-08T20:03:29.675324+0000","last_became_active":"2024-05-08T20:03:29.673771+0000","last_became_peered":"2024-05-08T20:03:29.673771+0000","last_unstale":"2024-05-08T20:03:29.675324+0000","last_undegraded":"2024-05-08T20:03:29.675324+0000","last_fullsized":"2024-05-08T20:03:29.675324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:50.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.016398+0000","last_change":"2024-05-08T20:03:29.166068+0000","last_active":"2024-05-08T20:03:34.016398+0000","last_peered":"2024-05-08T20:03:34.016398+0000","last_clean":"2024-05-08T20:03:34.016398+0000","last_became_active":"2024-05-08T20:03:29.165654+0000","last_became_peered":"2024-05-08T20:03:29.165654+0000","last_unstale":"2024-05-08T20:03:34.016398+0000","last_undegraded":"2024-05-08T20:03:34.016398+0000","last_fullsized":"2024-05-08T20:03:34.016398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:13.951907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878229+0000","last_change":"2024-05-08T20:03:29.680738+0000","last_active":"2024-05-08T20:03:29.878229+0000","last_peered":"2024-05-08T20:03:29.878229+0000","last_clean":"2024-05-08T20:03:29.878229+0000","last_became_active":"2024-05-08T20:03:29.680419+0000","last_became_peered":"2024-05-08T20:03:29.680419+0000","last_unstale":"2024-05-08T20:03:29.878229+0000","last_undegraded":"2024-05-08T20:03:29.878229+0000","last_fullsized":"2024-05-08T20:03:29.878229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:33.006404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048865+0000","last_change":"2024-05-08T20:03:29.163340+0000","last_active":"2024-05-08T20:03:33.048865+0000","last_peered":"2024-05-08T20:03:33.048865+0000","last_clean":"2024-05-08T20:03:33.048865+0000","last_became_active":"2024-05-08T20:03:29.162995+0000","last_became_peered":"2024-05-08T20:03:29.162995+0000","last_unstale":"2024-05-08T20:03:33.048865+0000","last_undegraded":"2024-05-08T20:03:33.048865+0000","last_fullsized":"2024-05-08T20:03:33.048865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:18.097991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790227+0000","last_change":"2024-05-08T20:03:29.683013+0000","last_active":"2024-05-08T20:03:31.790227+0000","last_peered":"2024-05-08T20:03:31.790227+0000","last_clean":"2024-05-08T20:03:31.790227+0000","last_became_active":"2024-05-08T20:03:29.682648+0000","last_became_peered":"2024-05-08T20:03:29.682648+0000","last_unstale":"2024-05-08T20:03:31.790227+0000","last_undegraded":"2024-05-08T20:03:31.790227+0000","last_fullsized":"2024-05-08T20:03:31.790227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:11.950896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048514+0000","last_change":"2024-05-08T20:03:29.163521+0000","last_active":"2024-05-08T20:03:33.048514+0000","last_peered":"2024-05-08T20:03:33.048514+0000","last_clean":"2024-05-08T20:03:33.048514+0000","last_became_active":"2024-05-08T20:03:29.163181+0000","last_became_peered":"2024-05-08T20:03:29.163181+0000","last_unstale":"2024-05-08T20:03:33.048514+0000","last_undegraded":"2024-05-08T20:03:33.048514+0000","last_fullsized":"2024-05-08T20:03:33.048514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:46.167984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790172+0000","last_change":"2024-05-08T20:03:29.678246+0000","last_active":"2024-05-08T20:03:31.790172+0000","last_peered":"2024-05-08T20:03:31.790172+0000","last_clean":"2024-05-08T20:03:31.790172+0000","last_became_active":"2024-05-08T20:03:29.677868+0000","last_became_peered":"2024-05-08T20:03:29.677868+0000","last_unstale":"2024-05-08T20:03:31.790172+0000","last_undegraded":"2024-05-08T20:03:31.790172+0000","last_fullsized":"2024-05-08T20:03:31.790172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:34.232071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049862+0000","last_change":"2024-05-08T20:03:29.170314+0000","last_active":"2024-05-08T20:03:33.049862+0000","last_peered":"2024-05-08T20:03:33.049862+0000","last_clean":"2024-05-08T20:03:33.049862+0000","last_became_active":"2024-05-08T20:03:29.169952+0000","last_became_peered":"2024-05-08T20:03:29.169952+0000","last_unstale":"2024-05-08T20:03:33.049862+0000","last_undegraded":"2024-05-08T20:03:33.049862+0000","last_fullsized":"2024-05-08T20:03:33.049862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.399603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.691772+0000","last_change":"2024-05-08T20:03:29.691046+0000","last_active":"2024-05-08T20:03:29.691772+0000","last_peered":"2024-05-08T20:03:29.691772+0000","last_clean":"2024-05-08T20:03:29.691772+0000","last_became_active":"2024-05-08T20:03:29.690681+0000","last_became_peered":"2024-05-08T20:03:29.690681+0000","last_unstale":"2024-05-08T20:03:29.691772+0000","last_undegraded":"2024-05-08T20:03:29.691772+0000","last_fullsized":"2024-05-08T20:03:29.691772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:01.340274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466122+0000","last_change":"2024-05-08T20:03:29.170122+0000","last_active":"2024-05-08T20:03:31.466122+0000","last_peered":"2024-05-08T20:03:31.466122+0000","last_clean":"2024-05-08T20:03:31.466122+0000","last_became_active":"2024-05-08T20:03:29.169766+0000","last_became_peered":"2024-05-08T20:03:29.169766+0000","last_unstale":"2024-05-08T20:03:31.466122+0000","last_undegraded":"2024-05-08T20:03:31.466122+0000","last_fullsized":"2024-05-08T20:03:31.466122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.969796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878178+0000","last_change":"2024-05-08T20:03:29.678943+0000","last_active":"2024-05-08T20:03:29.878178+0000","last_peered":"2024-05-08T20:03:29.878178+0000","last_clean":"2024-05-08T20:03:29.878178+0000","last_became_active":"2024-05-08T20:03:29.678616+0000","last_became_peered":"2024-05-08T20:03:29.678616+0000","last_unstale":"2024-05-08T20:03:29.878178+0000","last_undegraded":"2024-05-08T20:03:29.878178+0000","last_fullsized":"2024-05-08T20:03:29.878178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:28.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049197+0000","last_change":"2024-05-08T20:03:29.161096+0000","last_active":"2024-05-08T20:03:33.049197+0000","last_peered":"2024-05-08T20:03:33.049197+0000","last_clean":"2024-05-08T20:03:33.049197+0000","last_became_active":"2024-05-08T20:03:29.160768+0000","last_became_peered":"2024-05-08T20:03:29.160768+0000","last_unstale":"2024-05-08T20:03:33.049197+0000","last_undegraded":"2024-05-08T20:03:33.049197+0000","last_fullsized":"2024-05-08T20:03:33.049197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:38.830599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346794+0000","last_change":"2024-05-08T20:03:29.690624+0000","last_active":"2024-05-08T20:03:30.346794+0000","last_peered":"2024-05-08T20:03:30.346794+0000","last_clean":"2024-05-08T20:03:30.346794+0000","last_became_active":"2024-05-08T20:03:29.689889+0000","last_became_peered":"2024-05-08T20:03:29.689889+0000","last_unstale":"2024-05-08T20:03:30.346794+0000","last_undegraded":"2024-05-08T20:03:30.346794+0000","last_fullsized":"2024-05-08T20:03:30.346794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:05.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466536+0000","last_change":"2024-05-08T20:03:29.164559+0000","last_active":"2024-05-08T20:03:31.466536+0000","last_peered":"2024-05-08T20:03:31.466536+0000","last_clean":"2024-05-08T20:03:31.466536+0000","last_became_active":"2024-05-08T20:03:29.164201+0000","last_became_peered":"2024-05-08T20:03:29.164201+0000","last_unstale":"2024-05-08T20:03:31.466536+0000","last_undegraded":"2024-05-08T20:03:31.466536+0000","last_fullsized":"2024-05-08T20:03:31.466536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:12.678098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346856+0000","last_change":"2024-05-08T20:03:29.690256+0000","last_active":"2024-05-08T20:03:30.346856+0000","last_peered":"2024-05-08T20:03:30.346856+0000","last_clean":"2024-05-08T20:03:30.346856+0000","last_became_active":"2024-05-08T20:03:29.689310+0000","last_became_peered":"2024-05-08T20:03:29.689310+0000","last_unstale":"2024-05-08T20:03:30.346856+0000","last_undegraded":"2024-05-08T20:03:30.346856+0000","last_fullsized":"2024-05-08T20:03:30.346856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:49.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670818+0000","last_change":"2024-05-08T20:03:29.164733+0000","last_active":"2024-05-08T20:03:30.670818+0000","last_peered":"2024-05-08T20:03:30.670818+0000","last_clean":"2024-05-08T20:03:30.670818+0000","last_became_active":"2024-05-08T20:03:29.164395+0000","last_became_peered":"2024-05-08T20:03:29.164395+0000","last_unstale":"2024-05-08T20:03:30.670818+0000","last_undegraded":"2024-05-08T20:03:30.670818+0000","last_fullsized":"2024-05-08T20:03:30.670818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:48.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346818+0000","last_change":"2024-05-08T20:03:29.679616+0000","last_active":"2024-05-08T20:03:30.346818+0000","last_peered":"2024-05-08T20:03:30.346818+0000","last_clean":"2024-05-08T20:03:30.346818+0000","last_became_active":"2024-05-08T20:03:29.679235+0000","last_became_peered":"2024-05-08T20:03:29.679235+0000","last_unstale":"2024-05-08T20:03:30.346818+0000","last_undegraded":"2024-05-08T20:03:30.346818+0000","last_fullsized":"2024-05-08T20:03:30.346818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:20.825327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.687694+0000","last_change":"2024-05-08T20:03:29.165731+0000","last_active":"2024-05-08T20:03:29.687694+0000","last_peered":"2024-05-08T20:03:29.687694+0000","last_clean":"2024-05-08T20:03:29.687694+0000","last_became_active":"2024-05-08T20:03:29.165397+0000","last_became_peered":"2024-05-08T20:03:29.165397+0000","last_unstale":"2024-05-08T20:03:29.687694+0000","last_undegraded":"2024-05-08T20:03:29.687694+0000","last_fullsized":"2024-05-08T20:03:29.687694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:55.541984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346880+0000","last_change":"2024-05-08T20:03:29.682523+0000","last_active":"2024-05-08T20:03:30.346880+0000","last_peered":"2024-05-08T20:03:30.346880+0000","last_clean":"2024-05-08T20:03:30.346880+0000","last_became_active":"2024-05-08T20:03:29.682188+0000","last_became_peered":"2024-05-08T20:03:29.682188+0000","last_unstale":"2024-05-08T20:03:30.346880+0000","last_undegraded":"2024-05-08T20:03:30.346880+0000","last_fullsized":"2024-05-08T20:03:30.346880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:16.871494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.695044+0000","last_change":"2024-05-08T20:03:29.692315+0000","last_active":"2024-05-08T20:03:29.695044+0000","last_peered":"2024-05-08T20:03:29.695044+0000","last_clean":"2024-05-08T20:03:29.695044+0000","last_became_active":"2024-05-08T20:03:29.691944+0000","last_became_peered":"2024-05-08T20:03:29.691944+0000","last_unstale":"2024-05-08T20:03:29.695044+0000","last_undegraded":"2024-05-08T20:03:29.695044+0000","last_fullsized":"2024-05-08T20:03:29.695044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:02.614054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466270+0000","last_change":"2024-05-08T20:03:29.677763+0000","last_active":"2024-05-08T20:03:31.466270+0000","last_peered":"2024-05-08T20:03:31.466270+0000","last_clean":"2024-05-08T20:03:31.466270+0000","last_became_active":"2024-05-08T20:03:29.677282+0000","last_became_peered":"2024-05-08T20:03:29.677282+0000","last_unstale":"2024-05-08T20:03:31.466270+0000","last_undegraded":"2024-05-08T20:03:31.466270+0000","last_fullsized":"2024-05-08T20:03:31.466270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:03.039093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466116+0000","last_change":"2024-05-08T20:03:29.680085+0000","last_active":"2024-05-08T20:03:31.466116+0000","last_peered":"2024-05-08T20:03:31.466116+0000","last_clean":"2024-05-08T20:03:31.466116+0000","last_became_active":"2024-05-08T20:03:29.679793+0000","last_became_peered":"2024-05-08T20:03:29.679793+0000","last_unstale":"2024-05-08T20:03:31.466116+0000","last_undegraded":"2024-05-08T20:03:31.466116+0000","last_fullsized":"2024-05-08T20:03:31.466116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:24.679742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790883+0000","last_change":"2024-05-08T20:03:29.679987+0000","last_active":"2024-05-08T20:03:31.790883+0000","last_peered":"2024-05-08T20:03:31.790883+0000","last_clean":"2024-05-08T20:03:31.790883+0000","last_became_active":"2024-05-08T20:03:29.679630+0000","last_became_peered":"2024-05-08T20:03:29.679630+0000","last_unstale":"2024-05-08T20:03:31.790883+0000","last_undegraded":"2024-05-08T20:03:31.790883+0000","last_fullsized":"2024-05-08T20:03:31.790883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:25.119165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.674002+0000","last_change":"2024-05-08T20:03:29.672906+0000","last_active":"2024-05-08T20:03:29.674002+0000","last_peered":"2024-05-08T20:03:29.674002+0000","last_clean":"2024-05-08T20:03:29.674002+0000","last_became_active":"2024-05-08T20:03:29.672522+0000","last_became_peered":"2024-05-08T20:03:29.672522+0000","last_unstale":"2024-05-08T20:03:29.674002+0000","last_undegraded":"2024-05-08T20:03:29.674002+0000","last_fullsized":"2024-05-08T20:03:29.674002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:09.803843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694995+0000","last_change":"2024-05-08T20:03:29.692439+0000","last_active":"2024-05-08T20:03:29.694995+0000","last_peered":"2024-05-08T20:03:29.694995+0000","last_clean":"2024-05-08T20:03:29.694995+0000","last_became_active":"2024-05-08T20:03:29.691768+0000","last_became_peered":"2024-05-08T20:03:29.691768+0000","last_unstale":"2024-05-08T20:03:29.694995+0000","last_undegraded":"2024-05-08T20:03:29.694995+0000","last_fullsized":"2024-05-08T20:03:29.694995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:36.412128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466556+0000","last_change":"2024-05-08T20:03:29.687551+0000","last_active":"2024-05-08T20:03:31.466556+0000","last_peered":"2024-05-08T20:03:31.466556+0000","last_clean":"2024-05-08T20:03:31.466556+0000","last_became_active":"2024-05-08T20:03:29.687188+0000","last_became_peered":"2024-05-08T20:03:29.687188+0000","last_unstale":"2024-05-08T20:03:31.466556+0000","last_undegraded":"2024-05-08T20:03:31.466556+0000","last_fullsized":"2024-05-08T20:03:31.466556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:36.167104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878210+0000","last_change":"2024-05-08T20:03:29.679077+0000","last_active":"2024-05-08T20:03:29.878210+0000","last_peered":"2024-05-08T20:03:29.878210+0000","last_clean":"2024-05-08T20:03:29.878210+0000","last_became_active":"2024-05-08T20:03:29.678712+0000","last_became_peered":"2024-05-08T20:03:29.678712+0000","last_unstale":"2024-05-08T20:03:29.878210+0000","last_undegraded":"2024-05-08T20:03:29.878210+0000","last_fullsized":"2024-05-08T20:03:29.878210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:25.023184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671086+0000","last_change":"2024-05-08T20:03:29.677428+0000","last_active":"2024-05-08T20:03:30.671086+0000","last_peered":"2024-05-08T20:03:30.671086+0000","last_clean":"2024-05-08T20:03:30.671086+0000","last_became_active":"2024-05-08T20:03:29.676210+0000","last_became_peered":"2024-05-08T20:03:29.676210+0000","last_unstale":"2024-05-08T20:03:30.671086+0000","last_undegraded":"2024-05-08T20:03:30.671086+0000","last_fullsized":"2024-05-08T20:03:30.671086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:44.508673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878127+0000","last_change":"2024-05-08T20:03:29.676957+0000","last_active":"2024-05-08T20:03:29.878127+0000","last_peered":"2024-05-08T20:03:29.878127+0000","last_clean":"2024-05-08T20:03:29.878127+0000","last_became_active":"2024-05-08T20:03:29.676580+0000","last_became_peered":"2024-05-08T20:03:29.676580+0000","last_unstale":"2024-05-08T20:03:29.878127+0000","last_undegraded":"2024-05-08T20:03:29.878127+0000","last_fullsized":"2024-05-08T20:03:29.878127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:32.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301687+0000","last_change":"2024-05-08T20:03:29.685336+0000","last_active":"2024-05-08T20:03:30.301687+0000","last_peered":"2024-05-08T20:03:30.301687+0000","last_clean":"2024-05-08T20:03:30.301687+0000","last_became_active":"2024-05-08T20:03:29.685025+0000","last_became_peered":"2024-05-08T20:03:29.685025+0000","last_unstale":"2024-05-08T20:03:30.301687+0000","last_undegraded":"2024-05-08T20:03:30.301687+0000","last_fullsized":"2024-05-08T20:03:30.301687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:24.170359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.682488+0000","last_change":"2024-05-08T20:03:29.681684+0000","last_active":"2024-05-08T20:03:29.682488+0000","last_peered":"2024-05-08T20:03:29.682488+0000","last_clean":"2024-05-08T20:03:29.682488+0000","last_became_active":"2024-05-08T20:03:29.681302+0000","last_became_peered":"2024-05-08T20:03:29.681302+0000","last_unstale":"2024-05-08T20:03:29.682488+0000","last_undegraded":"2024-05-08T20:03:29.682488+0000","last_fullsized":"2024-05-08T20:03:29.682488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:48.963279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.691442+0000","last_change":"2024-05-08T20:03:29.689885+0000","last_active":"2024-05-08T20:03:29.691442+0000","last_peered":"2024-05-08T20:03:29.691442+0000","last_clean":"2024-05-08T20:03:29.691442+0000","last_became_active":"2024-05-08T20:03:29.689562+0000","last_became_peered":"2024-05-08T20:03:29.689562+0000","last_unstale":"2024-05-08T20:03:29.691442+0000","last_undegraded":"2024-05-08T20:03:29.691442+0000","last_fullsized":"2024-05-08T20:03:29.691442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:24.363101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246656,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3810,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":10736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547210,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":851968,"data_stored":407253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":946176,"data_stored":1008430,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":31848898},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":416641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.502}]},{"osd":1,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.432},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":8,"up_from":55,"seq":236223201300,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":868352,"data_stored":416096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.57299999999999995}]},{"osd":2,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.443},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.73999999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58899999999999997}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.83599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":7,"up_from":48,"seq":206158430232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":1007887,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60399999999999998}]},{"osd":3,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.436},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44900000000000001}]},{"osd":4,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41399999999999998}]},{"osd":5,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.499}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53700000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":415823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.434},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.90700000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.503},{"interface":"front","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.626,"15min":0.627},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84899999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed May 8 20:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77600000000000002}]},{"osd":8,"last update":"Wed May 8 20:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68700000000000006}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.746},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65300000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":417114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.38900000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.498}]},{"osd":2,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.46700000000000003},"min":{"1min":0.42099999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed May 8 20:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed May 8 20:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.30499999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 8 20:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.80200000000000005}]},{"osd":6,"last update":"Wed May 8 20:03:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 8 20:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.748}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":868352,"data_stored":415913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.379,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.629},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.52500000000000002,"15min":0.497},"min":{"1min":0.40600000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.57999999999999996,"15min":0.54600000000000004},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59899999999999998}]},{"osd":3,"last update":"Wed May 8 20:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.41599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.46899999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.495},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.55800000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.75900000000000001}]},{"osd":6,"last update":"Wed May 8 20:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73999999999999999}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.89100000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411370,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":417421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.45100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.498}]},{"osd":1,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.46500000000000002},"min":{"1min":0.38600000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.46999999999999997},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72799999999999998}]},{"osd":4,"last update":"Wed May 8 20:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.65300000000000002}]},{"osd":5,"last update":"Wed May 8 20:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.628},{"interface":"front","average":{"1min":0.504,"5min":0.44800000000000001,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.97199999999999998}]},{"osd":6,"last update":"Wed May 8 20:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.749}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.879}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":880640,"data_stored":416107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.28000000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.40500000000000003},"min":{"1min":0.32300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44}]},{"osd":1,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71899999999999997,"5min":0.753,"15min":0.753},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.70599999999999996,"5min":1.119,"15min":1.119},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.45000000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79200000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54200000000000004}]},{"osd":4,"last update":"Wed May 8 20:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.626}]},{"osd":6,"last update":"Wed May 8 20:03:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.871,"5min":0.88,"15min":0.88},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed May 8 20:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.72499999999999998}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.77000000000000002}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.68300000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":868352,"data_stored":415845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.504}]},{"osd":2,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.40600000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48399999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Wed May 8 20:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63}]},{"osd":7,"last update":"Wed May 8 20:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.76000000000000001}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.68799999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822687,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1007619,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.48099999999999998},"min":{"1min":0.313,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.628},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.80000000000000004}]},{"osd":2,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57899999999999996}]},{"osd":3,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.753},{"interface":"front","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.874}]},{"osd":6,"last update":"Wed May 8 20:03:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.78500000000000003}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.82899999999999996}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.90800000000000003}]},{"osd":9,"last update":"Wed May 8 20:03:25 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.86299999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:03:38.460 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T20:03:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 -- 172.21.15.33:0/3342619586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec1018e0 msgr2=0x7f27ec103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 --2- 172.21.15.33:0/3342619586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec1018e0 0x7f27ec103cd0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27e8009990 tx=0x7f27e8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 -- 172.21.15.33:0/3342619586 shutdown_connections 2024-05-08T20:03:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 --2- 172.21.15.33:0/3342619586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27ec106b40 0x7f27ec108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 --2- 172.21.15.33:0/3342619586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec1018e0 0x7f27ec103cd0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 --2- 172.21.15.33:0/3342619586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27ec104210 0x7f27ec106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 -- 172.21.15.33:0/3342619586 >> 172.21.15.33:0/3342619586 conn(0x7f27ec0fb2f0 msgr2=0x7f27ec0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 -- 172.21.15.33:0/3342619586 shutdown_connections 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.642+0000 7f27f4007700 1 -- 172.21.15.33:0/3342619586 wait complete. 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 Processor -- start 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 -- start start 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27ec1018e0 0x7f27ec196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec104210 0x7f27ec1972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27ec106b40 0x7f27ec19e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec19e8d0 con 0x7f27ec104210 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec19ea10 con 0x7f27ec106b40 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f4007700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec19eba0 con 0x7f27ec1018e0 2024-05-08T20:03:38.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f15a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec104210 0x7f27ec1972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f15a2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec104210 0x7f27ec1972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55576/0 (socket says 172.21.15.33:55576) 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f15a2700 1 -- 172.21.15.33:0/451220682 learned_addr learned my addr 172.21.15.33:0/451220682 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.643+0000 7f27f1da3700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27ec1018e0 0x7f27ec196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f25a4700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27ec106b40 0x7f27ec19e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f15a2700 1 -- 172.21.15.33:0/451220682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27ec1018e0 msgr2=0x7f27ec196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f15a2700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27ec1018e0 0x7f27ec196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f15a2700 1 -- 172.21.15.33:0/451220682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27ec106b40 msgr2=0x7f27ec19e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f15a2700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27ec106b40 0x7f27ec19e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f15a2700 1 -- 172.21.15.33:0/451220682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80095f0 con 0x7f27ec104210 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f15a2700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec104210 0x7f27ec1972e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00c9b0 tx=0x7f27dc00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27e2ffd700 1 -- 172.21.15.33:0/451220682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc007b00 con 0x7f27ec104210 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27e2ffd700 1 -- 172.21.15.33:0/451220682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f27dc007c60 con 0x7f27ec104210 2024-05-08T20:03:38.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec19ee80 con 0x7f27ec104210 2024-05-08T20:03:38.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27e2ffd700 1 -- 172.21.15.33:0/451220682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc018660 con 0x7f27ec104210 2024-05-08T20:03:38.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.644+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec19f350 con 0x7f27ec104210 2024-05-08T20:03:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.645+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec0fce70 con 0x7f27ec104210 2024-05-08T20:03:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.647+0000 7f27e2ffd700 1 -- 172.21.15.33:0/451220682 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f27dc00f450 con 0x7f27ec104210 2024-05-08T20:03:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.648+0000 7f27e2ffd700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f27d80a1230 0x7f27d80a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.648+0000 7f27f1da3700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f27d80a1230 0x7f27d80a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.648+0000 7f27e2ffd700 1 -- 172.21.15.33:0/451220682 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f27dc0ccaf0 con 0x7f27ec104210 2024-05-08T20:03:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.648+0000 7f27f1da3700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f27d80a1230 0x7f27d80a36f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27e8003790 tx=0x7f27e8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:38.640 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.651+0000 7f27e2ffd700 1 -- 172.21.15.33:0/451220682 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f27dc0963e0 con 0x7f27ec104210 2024-05-08T20:03:38.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.864+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27ec02ceb0 con 0x7f27d80a1230 2024-05-08T20:03:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.874+0000 7f27e2ffd700 1 -- 172.21.15.33:0/451220682 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+327921 (secure 0 0 0) 0x7f27ec02ceb0 con 0x7f27d80a1230 2024-05-08T20:03:38.868 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:38.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f27d80a1230 msgr2=0x7f27d80a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f27d80a1230 0x7f27d80a36f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27e8003790 tx=0x7f27e8005fd0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec104210 msgr2=0x7f27ec1972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec104210 0x7f27ec1972e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00c9b0 tx=0x7f27dc00ccc0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 shutdown_connections 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27ec106b40 0x7f27ec19e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f27d80a1230 0x7f27d80a36f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27ec1018e0 0x7f27ec196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 --2- 172.21.15.33:0/451220682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27ec104210 0x7f27ec1972e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.878+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 >> 172.21.15.33:0/451220682 conn(0x7f27ec0fb2f0 msgr2=0x7f27ec1021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.879+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 shutdown_connections 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:38.879+0000 7f27f4007700 1 -- 172.21.15.33:0/451220682 wait complete. 2024-05-08T20:03:38.871 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T20:03:38.882 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-05-08T20:03:37.114271+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594178,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":142,"num_read_kb":124,"num_write":281,"num_write_kb":2965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":224,"ondisk_log_size":224,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355120,"kb_used_data":10408,"kb_used_omap":18,"kb_used_meta":344557,"kb_avail":1124586704,"statfs":{"total":1151940427776,"available":1151576784896,"internally_reserved":0,"allocated":10657792,"data_stored":6762149,"data_compressed":107118,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19130,"internal_metadata":352826694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3810,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.969717"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.696608+0000","last_change":"2024-05-08T20:03:29.696040+0000","last_active":"2024-05-08T20:03:29.696608+0000","last_peered":"2024-05-08T20:03:29.696608+0000","last_clean":"2024-05-08T20:03:29.696608+0000","last_became_active":"2024-05-08T20:03:29.695312+0000","last_became_peered":"2024-05-08T20:03:29.695312+0000","last_unstale":"2024-05-08T20:03:29.696608+0000","last_undegraded":"2024-05-08T20:03:29.696608+0000","last_fullsized":"2024-05-08T20:03:29.696608+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:05.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790102+0000","last_change":"2024-05-08T20:03:29.681157+0000","last_active":"2024-05-08T20:03:31.790102+0000","last_peered":"2024-05-08T20:03:31.790102+0000","last_clean":"2024-05-08T20:03:31.790102+0000","last_became_active":"2024-05-08T20:03:29.680796+0000","last_became_peered":"2024-05-08T20:03:29.680796+0000","last_unstale":"2024-05-08T20:03:31.790102+0000","last_undegraded":"2024-05-08T20:03:31.790102+0000","last_fullsized":"2024-05-08T20:03:31.790102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:49.112158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790228+0000","last_change":"2024-05-08T20:03:29.686199+0000","last_active":"2024-05-08T20:03:31.790228+0000","last_peered":"2024-05-08T20:03:31.790228+0000","last_clean":"2024-05-08T20:03:31.790228+0000","last_became_active":"2024-05-08T20:03:29.685871+0000","last_became_peered":"2024-05-08T20:03:29.685871+0000","last_unstale":"2024-05-08T20:03:31.790228+0000","last_undegraded":"2024-05-08T20:03:31.790228+0000","last_fullsized":"2024-05-08T20:03:31.790228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:45.835061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671020+0000","last_change":"2024-05-08T20:03:29.690931+0000","last_active":"2024-05-08T20:03:30.671020+0000","last_peered":"2024-05-08T20:03:30.671020+0000","last_clean":"2024-05-08T20:03:30.671020+0000","last_became_active":"2024-05-08T20:03:29.690165+0000","last_became_peered":"2024-05-08T20:03:29.690165+0000","last_unstale":"2024-05-08T20:03:30.671020+0000","last_undegraded":"2024-05-08T20:03:30.671020+0000","last_fullsized":"2024-05-08T20:03:30.671020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:25.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790306+0000","last_change":"2024-05-08T20:03:29.675018+0000","last_active":"2024-05-08T20:03:31.790306+0000","last_peered":"2024-05-08T20:03:31.790306+0000","last_clean":"2024-05-08T20:03:31.790306+0000","last_became_active":"2024-05-08T20:03:29.674714+0000","last_became_peered":"2024-05-08T20:03:29.674714+0000","last_unstale":"2024-05-08T20:03:31.790306+0000","last_undegraded":"2024-05-08T20:03:31.790306+0000","last_fullsized":"2024-05-08T20:03:31.790306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:10.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791669+0000","last_change":"2024-05-08T20:03:29.679134+0000","last_active":"2024-05-08T20:03:31.791669+0000","last_peered":"2024-05-08T20:03:31.791669+0000","last_clean":"2024-05-08T20:03:31.791669+0000","last_became_active":"2024-05-08T20:03:29.678853+0000","last_became_peered":"2024-05-08T20:03:29.678853+0000","last_unstale":"2024-05-08T20:03:31.791669+0000","last_undegraded":"2024-05-08T20:03:31.791669+0000","last_fullsized":"2024-05-08T20:03:31.791669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:48.104195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346770+0000","last_change":"2024-05-08T20:03:29.679907+0000","last_active":"2024-05-08T20:03:30.346770+0000","last_peered":"2024-05-08T20:03:30.346770+0000","last_clean":"2024-05-08T20:03:30.346770+0000","last_became_active":"2024-05-08T20:03:29.679565+0000","last_became_peered":"2024-05-08T20:03:29.679565+0000","last_unstale":"2024-05-08T20:03:30.346770+0000","last_undegraded":"2024-05-08T20:03:30.346770+0000","last_fullsized":"2024-05-08T20:03:30.346770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:37.570557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878114+0000","last_change":"2024-05-08T20:03:29.677113+0000","last_active":"2024-05-08T20:03:29.878114+0000","last_peered":"2024-05-08T20:03:29.878114+0000","last_clean":"2024-05-08T20:03:29.878114+0000","last_became_active":"2024-05-08T20:03:29.676762+0000","last_became_peered":"2024-05-08T20:03:29.676762+0000","last_unstale":"2024-05-08T20:03:29.878114+0000","last_undegraded":"2024-05-08T20:03:29.878114+0000","last_fullsized":"2024-05-08T20:03:29.878114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:38.051229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301745+0000","last_change":"2024-05-08T20:03:29.687614+0000","last_active":"2024-05-08T20:03:30.301745+0000","last_peered":"2024-05-08T20:03:30.301745+0000","last_clean":"2024-05-08T20:03:30.301745+0000","last_became_active":"2024-05-08T20:03:29.687288+0000","last_became_peered":"2024-05-08T20:03:29.687288+0000","last_unstale":"2024-05-08T20:03:30.301745+0000","last_undegraded":"2024-05-08T20:03:30.301745+0000","last_fullsized":"2024-05-08T20:03:30.301745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:33.785307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790877+0000","last_change":"2024-05-08T20:03:29.685462+0000","last_active":"2024-05-08T20:03:31.790877+0000","last_peered":"2024-05-08T20:03:31.790877+0000","last_clean":"2024-05-08T20:03:31.790877+0000","last_became_active":"2024-05-08T20:03:29.685133+0000","last_became_peered":"2024-05-08T20:03:29.685133+0000","last_unstale":"2024-05-08T20:03:31.790877+0000","last_undegraded":"2024-05-08T20:03:31.790877+0000","last_fullsized":"2024-05-08T20:03:31.790877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:56.104253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346843+0000","last_change":"2024-05-08T20:03:29.690183+0000","last_active":"2024-05-08T20:03:30.346843+0000","last_peered":"2024-05-08T20:03:30.346843+0000","last_clean":"2024-05-08T20:03:30.346843+0000","last_became_active":"2024-05-08T20:03:29.689740+0000","last_became_peered":"2024-05-08T20:03:29.689740+0000","last_unstale":"2024-05-08T20:03:30.346843+0000","last_undegraded":"2024-05-08T20:03:30.346843+0000","last_fullsized":"2024-05-08T20:03:30.346843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:02.975916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671000+0000","last_change":"2024-05-08T20:03:29.690717+0000","last_active":"2024-05-08T20:03:30.671000+0000","last_peered":"2024-05-08T20:03:30.671000+0000","last_clean":"2024-05-08T20:03:30.671000+0000","last_became_active":"2024-05-08T20:03:29.689845+0000","last_became_peered":"2024-05-08T20:03:29.689845+0000","last_unstale":"2024-05-08T20:03:30.671000+0000","last_undegraded":"2024-05-08T20:03:30.671000+0000","last_fullsized":"2024-05-08T20:03:30.671000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:58.105656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.679134+0000","last_change":"2024-05-08T20:03:29.678031+0000","last_active":"2024-05-08T20:03:29.679134+0000","last_peered":"2024-05-08T20:03:29.679134+0000","last_clean":"2024-05-08T20:03:29.679134+0000","last_became_active":"2024-05-08T20:03:29.677711+0000","last_became_peered":"2024-05-08T20:03:29.677711+0000","last_unstale":"2024-05-08T20:03:29.679134+0000","last_undegraded":"2024-05-08T20:03:29.679134+0000","last_fullsized":"2024-05-08T20:03:29.679134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:44.432527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789896+0000","last_change":"2024-05-08T20:03:29.681551+0000","last_active":"2024-05-08T20:03:31.789896+0000","last_peered":"2024-05-08T20:03:31.789896+0000","last_clean":"2024-05-08T20:03:31.789896+0000","last_became_active":"2024-05-08T20:03:29.680558+0000","last_became_peered":"2024-05-08T20:03:29.680558+0000","last_unstale":"2024-05-08T20:03:31.789896+0000","last_undegraded":"2024-05-08T20:03:31.789896+0000","last_fullsized":"2024-05-08T20:03:31.789896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:40.976066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789942+0000","last_change":"2024-05-08T20:03:29.682503+0000","last_active":"2024-05-08T20:03:31.789942+0000","last_peered":"2024-05-08T20:03:31.789942+0000","last_clean":"2024-05-08T20:03:31.789942+0000","last_became_active":"2024-05-08T20:03:29.675083+0000","last_became_peered":"2024-05-08T20:03:29.675083+0000","last_unstale":"2024-05-08T20:03:31.789942+0000","last_undegraded":"2024-05-08T20:03:31.789942+0000","last_fullsized":"2024-05-08T20:03:31.789942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:19.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301652+0000","last_change":"2024-05-08T20:03:29.693087+0000","last_active":"2024-05-08T20:03:30.301652+0000","last_peered":"2024-05-08T20:03:30.301652+0000","last_clean":"2024-05-08T20:03:30.301652+0000","last_became_active":"2024-05-08T20:03:29.692824+0000","last_became_peered":"2024-05-08T20:03:29.692824+0000","last_unstale":"2024-05-08T20:03:30.301652+0000","last_undegraded":"2024-05-08T20:03:30.301652+0000","last_fullsized":"2024-05-08T20:03:30.301652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:58.653115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.696665+0000","last_change":"2024-05-08T20:03:29.696363+0000","last_active":"2024-05-08T20:03:29.696665+0000","last_peered":"2024-05-08T20:03:29.696665+0000","last_clean":"2024-05-08T20:03:29.696665+0000","last_became_active":"2024-05-08T20:03:29.695742+0000","last_became_peered":"2024-05-08T20:03:29.695742+0000","last_unstale":"2024-05-08T20:03:29.696665+0000","last_undegraded":"2024-05-08T20:03:29.696665+0000","last_fullsized":"2024-05-08T20:03:29.696665+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:34.085822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857275+0000","last_change":"2024-05-08T20:03:29.680245+0000","last_active":"2024-05-08T20:03:30.857275+0000","last_peered":"2024-05-08T20:03:30.857275+0000","last_clean":"2024-05-08T20:03:30.857275+0000","last_became_active":"2024-05-08T20:03:29.679921+0000","last_became_peered":"2024-05-08T20:03:29.679921+0000","last_unstale":"2024-05-08T20:03:30.857275+0000","last_undegraded":"2024-05-08T20:03:30.857275+0000","last_fullsized":"2024-05-08T20:03:30.857275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:31.013564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466500+0000","last_change":"2024-05-08T20:03:29.680303+0000","last_active":"2024-05-08T20:03:31.466500+0000","last_peered":"2024-05-08T20:03:31.466500+0000","last_clean":"2024-05-08T20:03:31.466500+0000","last_became_active":"2024-05-08T20:03:29.679406+0000","last_became_peered":"2024-05-08T20:03:29.679406+0000","last_unstale":"2024-05-08T20:03:31.466500+0000","last_undegraded":"2024-05-08T20:03:31.466500+0000","last_fullsized":"2024-05-08T20:03:31.466500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:44.353488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018724+0000","last_change":"2024-05-08T20:03:29.159444+0000","last_active":"2024-05-08T20:03:34.018724+0000","last_peered":"2024-05-08T20:03:34.018724+0000","last_clean":"2024-05-08T20:03:34.018724+0000","last_became_active":"2024-05-08T20:03:29.159024+0000","last_became_peered":"2024-05-08T20:03:29.159024+0000","last_unstale":"2024-05-08T20:03:34.018724+0000","last_undegraded":"2024-05-08T20:03:34.018724+0000","last_fullsized":"2024-05-08T20:03:34.018724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:49.855043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878188+0000","last_change":"2024-05-08T20:03:29.679721+0000","last_active":"2024-05-08T20:03:29.878188+0000","last_peered":"2024-05-08T20:03:29.878188+0000","last_clean":"2024-05-08T20:03:29.878188+0000","last_became_active":"2024-05-08T20:03:29.679424+0000","last_became_peered":"2024-05-08T20:03:29.679424+0000","last_unstale":"2024-05-08T20:03:29.878188+0000","last_undegraded":"2024-05-08T20:03:29.878188+0000","last_fullsized":"2024-05-08T20:03:29.878188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:21.133074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790826+0000","last_change":"2024-05-08T20:03:29.169000+0000","last_active":"2024-05-08T20:03:31.790826+0000","last_peered":"2024-05-08T20:03:31.790826+0000","last_clean":"2024-05-08T20:03:31.790826+0000","last_became_active":"2024-05-08T20:03:29.164576+0000","last_became_peered":"2024-05-08T20:03:29.164576+0000","last_unstale":"2024-05-08T20:03:31.790826+0000","last_undegraded":"2024-05-08T20:03:31.790826+0000","last_fullsized":"2024-05-08T20:03:31.790826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:19.961768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790561+0000","last_change":"2024-05-08T20:03:29.686350+0000","last_active":"2024-05-08T20:03:31.790561+0000","last_peered":"2024-05-08T20:03:31.790561+0000","last_clean":"2024-05-08T20:03:31.790561+0000","last_became_active":"2024-05-08T20:03:29.686016+0000","last_became_peered":"2024-05-08T20:03:29.686016+0000","last_unstale":"2024-05-08T20:03:31.790561+0000","last_undegraded":"2024-05-08T20:03:31.790561+0000","last_fullsized":"2024-05-08T20:03:31.790561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:18.727685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.692694+0000","last_change":"2024-05-08T20:03:29.161691+0000","last_active":"2024-05-08T20:03:29.692694+0000","last_peered":"2024-05-08T20:03:29.692694+0000","last_clean":"2024-05-08T20:03:29.692694+0000","last_became_active":"2024-05-08T20:03:29.161328+0000","last_became_peered":"2024-05-08T20:03:29.161328+0000","last_unstale":"2024-05-08T20:03:29.692694+0000","last_undegraded":"2024-05-08T20:03:29.692694+0000","last_fullsized":"2024-05-08T20:03:29.692694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:08.183440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301699+0000","last_change":"2024-05-08T20:03:29.688528+0000","last_active":"2024-05-08T20:03:30.301699+0000","last_peered":"2024-05-08T20:03:30.301699+0000","last_clean":"2024-05-08T20:03:30.301699+0000","last_became_active":"2024-05-08T20:03:29.688211+0000","last_became_peered":"2024-05-08T20:03:29.688211+0000","last_unstale":"2024-05-08T20:03:30.301699+0000","last_undegraded":"2024-05-08T20:03:30.301699+0000","last_fullsized":"2024-05-08T20:03:30.301699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:01.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694883+0000","last_change":"2024-05-08T20:03:29.158484+0000","last_active":"2024-05-08T20:03:29.694883+0000","last_peered":"2024-05-08T20:03:29.694883+0000","last_clean":"2024-05-08T20:03:29.694883+0000","last_became_active":"2024-05-08T20:03:29.158116+0000","last_became_peered":"2024-05-08T20:03:29.158116+0000","last_unstale":"2024-05-08T20:03:29.694883+0000","last_undegraded":"2024-05-08T20:03:29.694883+0000","last_fullsized":"2024-05-08T20:03:29.694883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:13.955725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670971+0000","last_change":"2024-05-08T20:03:29.688895+0000","last_active":"2024-05-08T20:03:30.670971+0000","last_peered":"2024-05-08T20:03:30.670971+0000","last_clean":"2024-05-08T20:03:30.670971+0000","last_became_active":"2024-05-08T20:03:29.688571+0000","last_became_peered":"2024-05-08T20:03:29.688571+0000","last_unstale":"2024-05-08T20:03:30.670971+0000","last_undegraded":"2024-05-08T20:03:30.670971+0000","last_fullsized":"2024-05-08T20:03:30.670971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:19.722428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.007836+0000","last_change":"2024-05-08T20:03:29.159927+0000","last_active":"2024-05-08T20:03:34.007836+0000","last_peered":"2024-05-08T20:03:34.007836+0000","last_clean":"2024-05-08T20:03:34.007836+0000","last_became_active":"2024-05-08T20:03:29.159608+0000","last_became_peered":"2024-05-08T20:03:29.159608+0000","last_unstale":"2024-05-08T20:03:34.007836+0000","last_undegraded":"2024-05-08T20:03:34.007836+0000","last_fullsized":"2024-05-08T20:03:34.007836+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:17.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790183+0000","last_change":"2024-05-08T20:03:29.676181+0000","last_active":"2024-05-08T20:03:31.790183+0000","last_peered":"2024-05-08T20:03:31.790183+0000","last_clean":"2024-05-08T20:03:31.790183+0000","last_became_active":"2024-05-08T20:03:29.675823+0000","last_became_peered":"2024-05-08T20:03:29.675823+0000","last_unstale":"2024-05-08T20:03:31.790183+0000","last_undegraded":"2024-05-08T20:03:31.790183+0000","last_fullsized":"2024-05-08T20:03:31.790183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:42.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.684590+0000","last_change":"2024-05-08T20:03:29.156803+0000","last_active":"2024-05-08T20:03:29.684590+0000","last_peered":"2024-05-08T20:03:29.684590+0000","last_clean":"2024-05-08T20:03:29.684590+0000","last_became_active":"2024-05-08T20:03:29.156114+0000","last_became_peered":"2024-05-08T20:03:29.156114+0000","last_unstale":"2024-05-08T20:03:29.684590+0000","last_undegraded":"2024-05-08T20:03:29.684590+0000","last_fullsized":"2024-05-08T20:03:29.684590+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:11.964529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670789+0000","last_change":"2024-05-08T20:03:29.677259+0000","last_active":"2024-05-08T20:03:30.670789+0000","last_peered":"2024-05-08T20:03:30.670789+0000","last_clean":"2024-05-08T20:03:30.670789+0000","last_became_active":"2024-05-08T20:03:29.676885+0000","last_became_peered":"2024-05-08T20:03:29.676885+0000","last_unstale":"2024-05-08T20:03:30.670789+0000","last_undegraded":"2024-05-08T20:03:30.670789+0000","last_fullsized":"2024-05-08T20:03:30.670789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:18.152813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018316+0000","last_change":"2024-05-08T20:03:29.162317+0000","last_active":"2024-05-08T20:03:34.018316+0000","last_peered":"2024-05-08T20:03:34.018316+0000","last_clean":"2024-05-08T20:03:34.018316+0000","last_became_active":"2024-05-08T20:03:29.161961+0000","last_became_peered":"2024-05-08T20:03:29.161961+0000","last_unstale":"2024-05-08T20:03:34.018316+0000","last_undegraded":"2024-05-08T20:03:34.018316+0000","last_fullsized":"2024-05-08T20:03:34.018316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:36.379021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878091+0000","last_change":"2024-05-08T20:03:29.672527+0000","last_active":"2024-05-08T20:03:29.878091+0000","last_peered":"2024-05-08T20:03:29.878091+0000","last_clean":"2024-05-08T20:03:29.878091+0000","last_became_active":"2024-05-08T20:03:29.672199+0000","last_became_peered":"2024-05-08T20:03:29.672199+0000","last_unstale":"2024-05-08T20:03:29.878091+0000","last_undegraded":"2024-05-08T20:03:29.878091+0000","last_fullsized":"2024-05-08T20:03:29.878091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:47.833015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670738+0000","last_change":"2024-05-08T20:03:29.160639+0000","last_active":"2024-05-08T20:03:30.670738+0000","last_peered":"2024-05-08T20:03:30.670738+0000","last_clean":"2024-05-08T20:03:30.670738+0000","last_became_active":"2024-05-08T20:03:29.160291+0000","last_became_peered":"2024-05-08T20:03:29.160291+0000","last_unstale":"2024-05-08T20:03:30.670738+0000","last_undegraded":"2024-05-08T20:03:30.670738+0000","last_fullsized":"2024-05-08T20:03:30.670738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:56.126764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857096+0000","last_change":"2024-05-08T20:03:29.677339+0000","last_active":"2024-05-08T20:03:30.857096+0000","last_peered":"2024-05-08T20:03:30.857096+0000","last_clean":"2024-05-08T20:03:30.857096+0000","last_became_active":"2024-05-08T20:03:29.676954+0000","last_became_peered":"2024-05-08T20:03:29.676954+0000","last_unstale":"2024-05-08T20:03:30.857096+0000","last_undegraded":"2024-05-08T20:03:30.857096+0000","last_fullsized":"2024-05-08T20:03:30.857096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048671+0000","last_change":"2024-05-08T20:03:29.156873+0000","last_active":"2024-05-08T20:03:33.048671+0000","last_peered":"2024-05-08T20:03:33.048671+0000","last_clean":"2024-05-08T20:03:33.048671+0000","last_became_active":"2024-05-08T20:03:29.156130+0000","last_became_peered":"2024-05-08T20:03:29.156130+0000","last_unstale":"2024-05-08T20:03:33.048671+0000","last_undegraded":"2024-05-08T20:03:33.048671+0000","last_fullsized":"2024-05-08T20:03:33.048671+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:31.410319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301731+0000","last_change":"2024-05-08T20:03:29.680591+0000","last_active":"2024-05-08T20:03:30.301731+0000","last_peered":"2024-05-08T20:03:30.301731+0000","last_clean":"2024-05-08T20:03:30.301731+0000","last_became_active":"2024-05-08T20:03:29.680311+0000","last_became_peered":"2024-05-08T20:03:29.680311+0000","last_unstale":"2024-05-08T20:03:30.301731+0000","last_undegraded":"2024-05-08T20:03:30.301731+0000","last_fullsized":"2024-05-08T20:03:30.301731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:51.343586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049047+0000","last_change":"2024-05-08T20:03:29.165504+0000","last_active":"2024-05-08T20:03:33.049047+0000","last_peered":"2024-05-08T20:03:33.049047+0000","last_clean":"2024-05-08T20:03:33.049047+0000","last_became_active":"2024-05-08T20:03:29.164251+0000","last_became_peered":"2024-05-08T20:03:29.164251+0000","last_unstale":"2024-05-08T20:03:33.049047+0000","last_undegraded":"2024-05-08T20:03:33.049047+0000","last_fullsized":"2024-05-08T20:03:33.049047+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:51.771014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790469+0000","last_change":"2024-05-08T20:03:29.684880+0000","last_active":"2024-05-08T20:03:31.790469+0000","last_peered":"2024-05-08T20:03:31.790469+0000","last_clean":"2024-05-08T20:03:31.790469+0000","last_became_active":"2024-05-08T20:03:29.683216+0000","last_became_peered":"2024-05-08T20:03:29.683216+0000","last_unstale":"2024-05-08T20:03:31.790469+0000","last_undegraded":"2024-05-08T20:03:31.790469+0000","last_fullsized":"2024-05-08T20:03:31.790469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:12.695393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049436+0000","last_change":"2024-05-08T20:03:29.157211+0000","last_active":"2024-05-08T20:03:33.049436+0000","last_peered":"2024-05-08T20:03:33.049436+0000","last_clean":"2024-05-08T20:03:33.049436+0000","last_became_active":"2024-05-08T20:03:29.156761+0000","last_became_peered":"2024-05-08T20:03:29.156761+0000","last_unstale":"2024-05-08T20:03:33.049436+0000","last_undegraded":"2024-05-08T20:03:33.049436+0000","last_fullsized":"2024-05-08T20:03:33.049436+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:27.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301709+0000","last_change":"2024-05-08T20:03:29.686949+0000","last_active":"2024-05-08T20:03:30.301709+0000","last_peered":"2024-05-08T20:03:30.301709+0000","last_clean":"2024-05-08T20:03:30.301709+0000","last_became_active":"2024-05-08T20:03:29.686634+0000","last_became_peered":"2024-05-08T20:03:29.686634+0000","last_unstale":"2024-05-08T20:03:30.301709+0000","last_undegraded":"2024-05-08T20:03:30.301709+0000","last_fullsized":"2024-05-08T20:03:30.301709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:27.560636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'8","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048581+0000","last_change":"2024-05-08T20:03:29.156991+0000","last_active":"2024-05-08T20:03:33.048581+0000","last_peered":"2024-05-08T20:03:33.048581+0000","last_clean":"2024-05-08T20:03:33.048581+0000","last_became_active":"2024-05-08T20:03:29.156570+0000","last_became_peered":"2024-05-08T20:03:29.156570+0000","last_unstale":"2024-05-08T20:03:33.048581+0000","last_undegraded":"2024-05-08T20:03:33.048581+0000","last_fullsized":"2024-05-08T20:03:33.048581+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:05.001469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790529+0000","last_change":"2024-05-08T20:03:29.684822+0000","last_active":"2024-05-08T20:03:31.790529+0000","last_peered":"2024-05-08T20:03:31.790529+0000","last_clean":"2024-05-08T20:03:31.790529+0000","last_became_active":"2024-05-08T20:03:29.684455+0000","last_became_peered":"2024-05-08T20:03:29.684455+0000","last_unstale":"2024-05-08T20:03:31.790529+0000","last_undegraded":"2024-05-08T20:03:31.790529+0000","last_fullsized":"2024-05-08T20:03:31.790529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:28.982158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"79'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466444+0000","last_change":"2024-05-08T20:03:29.165831+0000","last_active":"2024-05-08T20:03:31.466444+0000","last_peered":"2024-05-08T20:03:31.466444+0000","last_clean":"2024-05-08T20:03:31.466444+0000","last_became_active":"2024-05-08T20:03:29.165493+0000","last_became_peered":"2024-05-08T20:03:29.165493+0000","last_unstale":"2024-05-08T20:03:31.466444+0000","last_undegraded":"2024-05-08T20:03:31.466444+0000","last_fullsized":"2024-05-08T20:03:31.466444+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:56.507752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678998+0000","last_change":"2024-05-08T20:03:29.675564+0000","last_active":"2024-05-08T20:03:29.678998+0000","last_peered":"2024-05-08T20:03:29.678998+0000","last_clean":"2024-05-08T20:03:29.678998+0000","last_became_active":"2024-05-08T20:03:29.675228+0000","last_became_peered":"2024-05-08T20:03:29.675228+0000","last_unstale":"2024-05-08T20:03:29.678998+0000","last_undegraded":"2024-05-08T20:03:29.678998+0000","last_fullsized":"2024-05-08T20:03:29.678998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:16.646254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049236+0000","last_change":"2024-05-08T20:03:29.161586+0000","last_active":"2024-05-08T20:03:33.049236+0000","last_peered":"2024-05-08T20:03:33.049236+0000","last_clean":"2024-05-08T20:03:33.049236+0000","last_became_active":"2024-05-08T20:03:29.161158+0000","last_became_peered":"2024-05-08T20:03:29.161158+0000","last_unstale":"2024-05-08T20:03:33.049236+0000","last_undegraded":"2024-05-08T20:03:33.049236+0000","last_fullsized":"2024-05-08T20:03:33.049236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:35.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346806+0000","last_change":"2024-05-08T20:03:29.680216+0000","last_active":"2024-05-08T20:03:30.346806+0000","last_peered":"2024-05-08T20:03:30.346806+0000","last_clean":"2024-05-08T20:03:30.346806+0000","last_became_active":"2024-05-08T20:03:29.679855+0000","last_became_peered":"2024-05-08T20:03:29.679855+0000","last_unstale":"2024-05-08T20:03:30.346806+0000","last_undegraded":"2024-05-08T20:03:30.346806+0000","last_fullsized":"2024-05-08T20:03:30.346806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:14.995587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.665365+0000","last_change":"2024-05-08T20:03:29.160134+0000","last_active":"2024-05-08T20:03:29.665365+0000","last_peered":"2024-05-08T20:03:29.665365+0000","last_clean":"2024-05-08T20:03:29.665365+0000","last_became_active":"2024-05-08T20:03:29.159782+0000","last_became_peered":"2024-05-08T20:03:29.159782+0000","last_unstale":"2024-05-08T20:03:29.665365+0000","last_undegraded":"2024-05-08T20:03:29.665365+0000","last_fullsized":"2024-05-08T20:03:29.665365+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:10.580761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346697+0000","last_change":"2024-05-08T20:03:29.677050+0000","last_active":"2024-05-08T20:03:30.346697+0000","last_peered":"2024-05-08T20:03:30.346697+0000","last_clean":"2024-05-08T20:03:30.346697+0000","last_became_active":"2024-05-08T20:03:29.676685+0000","last_became_peered":"2024-05-08T20:03:29.676685+0000","last_unstale":"2024-05-08T20:03:30.346697+0000","last_undegraded":"2024-05-08T20:03:30.346697+0000","last_fullsized":"2024-05-08T20:03:30.346697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:39.115370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'10","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048501+0000","last_change":"2024-05-08T20:03:29.165983+0000","last_active":"2024-05-08T20:03:33.048501+0000","last_peered":"2024-05-08T20:03:33.048501+0000","last_clean":"2024-05-08T20:03:33.048501+0000","last_became_active":"2024-05-08T20:03:29.165645+0000","last_became_peered":"2024-05-08T20:03:29.165645+0000","last_unstale":"2024-05-08T20:03:33.048501+0000","last_undegraded":"2024-05-08T20:03:33.048501+0000","last_fullsized":"2024-05-08T20:03:33.048501+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:50.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670619+0000","last_change":"2024-05-08T20:03:29.688949+0000","last_active":"2024-05-08T20:03:30.670619+0000","last_peered":"2024-05-08T20:03:30.670619+0000","last_clean":"2024-05-08T20:03:30.670619+0000","last_became_active":"2024-05-08T20:03:29.687174+0000","last_became_peered":"2024-05-08T20:03:29.687174+0000","last_unstale":"2024-05-08T20:03:30.670619+0000","last_undegraded":"2024-05-08T20:03:30.670619+0000","last_fullsized":"2024-05-08T20:03:30.670619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:27.751738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"79'1","reported_seq":13,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694769+0000","last_change":"2024-05-08T20:03:29.162951+0000","last_active":"2024-05-08T20:03:29.694769+0000","last_peered":"2024-05-08T20:03:29.694769+0000","last_clean":"2024-05-08T20:03:29.694769+0000","last_became_active":"2024-05-08T20:03:29.162589+0000","last_became_peered":"2024-05-08T20:03:29.162589+0000","last_unstale":"2024-05-08T20:03:29.694769+0000","last_undegraded":"2024-05-08T20:03:29.694769+0000","last_fullsized":"2024-05-08T20:03:29.694769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.185986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.693210+0000","last_change":"2024-05-08T20:03:29.692187+0000","last_active":"2024-05-08T20:03:29.693210+0000","last_peered":"2024-05-08T20:03:29.693210+0000","last_clean":"2024-05-08T20:03:29.693210+0000","last_became_active":"2024-05-08T20:03:29.691853+0000","last_became_peered":"2024-05-08T20:03:29.691853+0000","last_unstale":"2024-05-08T20:03:29.693210+0000","last_undegraded":"2024-05-08T20:03:29.693210+0000","last_fullsized":"2024-05-08T20:03:29.693210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:24.907475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857193+0000","last_change":"2024-05-08T20:03:29.159695+0000","last_active":"2024-05-08T20:03:30.857193+0000","last_peered":"2024-05-08T20:03:30.857193+0000","last_clean":"2024-05-08T20:03:30.857193+0000","last_became_active":"2024-05-08T20:03:29.159358+0000","last_became_peered":"2024-05-08T20:03:29.159358+0000","last_unstale":"2024-05-08T20:03:30.857193+0000","last_undegraded":"2024-05-08T20:03:30.857193+0000","last_fullsized":"2024-05-08T20:03:30.857193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:04.211835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791312+0000","last_change":"2024-05-08T20:03:29.685490+0000","last_active":"2024-05-08T20:03:31.791312+0000","last_peered":"2024-05-08T20:03:31.791312+0000","last_clean":"2024-05-08T20:03:31.791312+0000","last_became_active":"2024-05-08T20:03:29.685153+0000","last_became_peered":"2024-05-08T20:03:29.685153+0000","last_unstale":"2024-05-08T20:03:31.791312+0000","last_undegraded":"2024-05-08T20:03:31.791312+0000","last_fullsized":"2024-05-08T20:03:31.791312+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:32.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790920+0000","last_change":"2024-05-08T20:03:29.168932+0000","last_active":"2024-05-08T20:03:31.790920+0000","last_peered":"2024-05-08T20:03:31.790920+0000","last_clean":"2024-05-08T20:03:31.790920+0000","last_became_active":"2024-05-08T20:03:29.168625+0000","last_became_peered":"2024-05-08T20:03:29.168625+0000","last_unstale":"2024-05-08T20:03:31.790920+0000","last_undegraded":"2024-05-08T20:03:31.790920+0000","last_fullsized":"2024-05-08T20:03:31.790920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:06.360590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790862+0000","last_change":"2024-05-08T20:03:29.679318+0000","last_active":"2024-05-08T20:03:31.790862+0000","last_peered":"2024-05-08T20:03:31.790862+0000","last_clean":"2024-05-08T20:03:31.790862+0000","last_became_active":"2024-05-08T20:03:29.678986+0000","last_became_peered":"2024-05-08T20:03:29.678986+0000","last_unstale":"2024-05-08T20:03:31.790862+0000","last_undegraded":"2024-05-08T20:03:31.790862+0000","last_fullsized":"2024-05-08T20:03:31.790862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:01.320483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670997+0000","last_change":"2024-05-08T20:03:29.685281+0000","last_active":"2024-05-08T20:03:30.670997+0000","last_peered":"2024-05-08T20:03:30.670997+0000","last_clean":"2024-05-08T20:03:30.670997+0000","last_became_active":"2024-05-08T20:03:29.684501+0000","last_became_peered":"2024-05-08T20:03:29.684501+0000","last_unstale":"2024-05-08T20:03:30.670997+0000","last_undegraded":"2024-05-08T20:03:30.670997+0000","last_fullsized":"2024-05-08T20:03:30.670997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:39.638911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.020210+0000","last_change":"2024-05-08T20:03:29.165278+0000","last_active":"2024-05-08T20:03:34.020210+0000","last_peered":"2024-05-08T20:03:34.020210+0000","last_clean":"2024-05-08T20:03:34.020210+0000","last_became_active":"2024-05-08T20:03:29.164901+0000","last_became_peered":"2024-05-08T20:03:29.164901+0000","last_unstale":"2024-05-08T20:03:34.020210+0000","last_undegraded":"2024-05-08T20:03:34.020210+0000","last_fullsized":"2024-05-08T20:03:34.020210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:43.034192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878165+0000","last_change":"2024-05-08T20:03:29.685296+0000","last_active":"2024-05-08T20:03:29.878165+0000","last_peered":"2024-05-08T20:03:29.878165+0000","last_clean":"2024-05-08T20:03:29.878165+0000","last_became_active":"2024-05-08T20:03:29.684909+0000","last_became_peered":"2024-05-08T20:03:29.684909+0000","last_unstale":"2024-05-08T20:03:29.878165+0000","last_undegraded":"2024-05-08T20:03:29.878165+0000","last_fullsized":"2024-05-08T20:03:29.878165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.092769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048822+0000","last_change":"2024-05-08T20:03:29.158016+0000","last_active":"2024-05-08T20:03:33.048822+0000","last_peered":"2024-05-08T20:03:33.048822+0000","last_clean":"2024-05-08T20:03:33.048822+0000","last_became_active":"2024-05-08T20:03:29.157635+0000","last_became_peered":"2024-05-08T20:03:29.157635+0000","last_unstale":"2024-05-08T20:03:33.048822+0000","last_undegraded":"2024-05-08T20:03:33.048822+0000","last_fullsized":"2024-05-08T20:03:33.048822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:55.355837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":330,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.664978+0000","last_change":"2024-05-08T20:02:41.684821+0000","last_active":"2024-05-08T20:03:29.664978+0000","last_peered":"2024-05-08T20:03:29.664978+0000","last_clean":"2024-05-08T20:03:29.664978+0000","last_became_active":"2024-05-08T20:02:41.684413+0000","last_became_peered":"2024-05-08T20:02:41.684413+0000","last_unstale":"2024-05-08T20:03:29.664978+0000","last_undegraded":"2024-05-08T20:03:29.664978+0000","last_fullsized":"2024-05-08T20:03:29.664978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_clean_scrub_stamp":"2024-05-08T20:00:17.645281+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:03.139734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678805+0000","last_change":"2024-05-08T20:03:29.674487+0000","last_active":"2024-05-08T20:03:29.678805+0000","last_peered":"2024-05-08T20:03:29.678805+0000","last_clean":"2024-05-08T20:03:29.678805+0000","last_became_active":"2024-05-08T20:03:29.674122+0000","last_became_peered":"2024-05-08T20:03:29.674122+0000","last_unstale":"2024-05-08T20:03:29.678805+0000","last_undegraded":"2024-05-08T20:03:29.678805+0000","last_fullsized":"2024-05-08T20:03:29.678805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:38.401296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018435+0000","last_change":"2024-05-08T20:03:29.165420+0000","last_active":"2024-05-08T20:03:34.018435+0000","last_peered":"2024-05-08T20:03:34.018435+0000","last_clean":"2024-05-08T20:03:34.018435+0000","last_became_active":"2024-05-08T20:03:29.165075+0000","last_became_peered":"2024-05-08T20:03:29.165075+0000","last_unstale":"2024-05-08T20:03:34.018435+0000","last_undegraded":"2024-05-08T20:03:34.018435+0000","last_fullsized":"2024-05-08T20:03:34.018435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:28.980327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790495+0000","last_change":"2024-05-08T20:03:29.165940+0000","last_active":"2024-05-08T20:03:31.790495+0000","last_peered":"2024-05-08T20:03:31.790495+0000","last_clean":"2024-05-08T20:03:31.790495+0000","last_became_active":"2024-05-08T20:03:29.165615+0000","last_became_peered":"2024-05-08T20:03:29.165615+0000","last_unstale":"2024-05-08T20:03:31.790495+0000","last_undegraded":"2024-05-08T20:03:31.790495+0000","last_fullsized":"2024-05-08T20:03:31.790495+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:28.066975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.675324+0000","last_change":"2024-05-08T20:03:29.674172+0000","last_active":"2024-05-08T20:03:29.675324+0000","last_peered":"2024-05-08T20:03:29.675324+0000","last_clean":"2024-05-08T20:03:29.675324+0000","last_became_active":"2024-05-08T20:03:29.673771+0000","last_became_peered":"2024-05-08T20:03:29.673771+0000","last_unstale":"2024-05-08T20:03:29.675324+0000","last_undegraded":"2024-05-08T20:03:29.675324+0000","last_fullsized":"2024-05-08T20:03:29.675324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:50.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.016398+0000","last_change":"2024-05-08T20:03:29.166068+0000","last_active":"2024-05-08T20:03:34.016398+0000","last_peered":"2024-05-08T20:03:34.016398+0000","last_clean":"2024-05-08T20:03:34.016398+0000","last_became_active":"2024-05-08T20:03:29.165654+0000","last_became_peered":"2024-05-08T20:03:29.165654+0000","last_unstale":"2024-05-08T20:03:34.016398+0000","last_undegraded":"2024-05-08T20:03:34.016398+0000","last_fullsized":"2024-05-08T20:03:34.016398+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:13.951907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878229+0000","last_change":"2024-05-08T20:03:29.680738+0000","last_active":"2024-05-08T20:03:29.878229+0000","last_peered":"2024-05-08T20:03:29.878229+0000","last_clean":"2024-05-08T20:03:29.878229+0000","last_became_active":"2024-05-08T20:03:29.680419+0000","last_became_peered":"2024-05-08T20:03:29.680419+0000","last_unstale":"2024-05-08T20:03:29.878229+0000","last_undegraded":"2024-05-08T20:03:29.878229+0000","last_fullsized":"2024-05-08T20:03:29.878229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:33.006404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048865+0000","last_change":"2024-05-08T20:03:29.163340+0000","last_active":"2024-05-08T20:03:33.048865+0000","last_peered":"2024-05-08T20:03:33.048865+0000","last_clean":"2024-05-08T20:03:33.048865+0000","last_became_active":"2024-05-08T20:03:29.162995+0000","last_became_peered":"2024-05-08T20:03:29.162995+0000","last_unstale":"2024-05-08T20:03:33.048865+0000","last_undegraded":"2024-05-08T20:03:33.048865+0000","last_fullsized":"2024-05-08T20:03:33.048865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:18.097991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790227+0000","last_change":"2024-05-08T20:03:29.683013+0000","last_active":"2024-05-08T20:03:31.790227+0000","last_peered":"2024-05-08T20:03:31.790227+0000","last_clean":"2024-05-08T20:03:31.790227+0000","last_became_active":"2024-05-08T20:03:29.682648+0000","last_became_peered":"2024-05-08T20:03:29.682648+0000","last_unstale":"2024-05-08T20:03:31.790227+0000","last_undegraded":"2024-05-08T20:03:31.790227+0000","last_fullsized":"2024-05-08T20:03:31.790227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:11.950896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048514+0000","last_change":"2024-05-08T20:03:29.163521+0000","last_active":"2024-05-08T20:03:33.048514+0000","last_peered":"2024-05-08T20:03:33.048514+0000","last_clean":"2024-05-08T20:03:33.048514+0000","last_became_active":"2024-05-08T20:03:29.163181+0000","last_became_peered":"2024-05-08T20:03:29.163181+0000","last_unstale":"2024-05-08T20:03:33.048514+0000","last_undegraded":"2024-05-08T20:03:33.048514+0000","last_fullsized":"2024-05-08T20:03:33.048514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:46.167984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790172+0000","last_change":"2024-05-08T20:03:29.678246+0000","last_active":"2024-05-08T20:03:31.790172+0000","last_peered":"2024-05-08T20:03:31.790172+0000","last_clean":"2024-05-08T20:03:31.790172+0000","last_became_active":"2024-05-08T20:03:29.677868+0000","last_became_peered":"2024-05-08T20:03:29.677868+0000","last_unstale":"2024-05-08T20:03:31.790172+0000","last_undegraded":"2024-05-08T20:03:31.790172+0000","last_fullsized":"2024-05-08T20:03:31.790172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:34.232071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049862+0000","last_change":"2024-05-08T20:03:29.170314+0000","last_active":"2024-05-08T20:03:33.049862+0000","last_peered":"2024-05-08T20:03:33.049862+0000","last_clean":"2024-05-08T20:03:33.049862+0000","last_became_active":"2024-05-08T20:03:29.169952+0000","last_became_peered":"2024-05-08T20:03:29.169952+0000","last_unstale":"2024-05-08T20:03:33.049862+0000","last_undegraded":"2024-05-08T20:03:33.049862+0000","last_fullsized":"2024-05-08T20:03:33.049862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.399603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.691772+0000","last_change":"2024-05-08T20:03:29.691046+0000","last_active":"2024-05-08T20:03:29.691772+0000","last_peered":"2024-05-08T20:03:29.691772+0000","last_clean":"2024-05-08T20:03:29.691772+0000","last_became_active":"2024-05-08T20:03:29.690681+0000","last_became_peered":"2024-05-08T20:03:29.690681+0000","last_unstale":"2024-05-08T20:03:29.691772+0000","last_undegraded":"2024-05-08T20:03:29.691772+0000","last_fullsized":"2024-05-08T20:03:29.691772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:01.340274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466122+0000","last_change":"2024-05-08T20:03:29.170122+0000","last_active":"2024-05-08T20:03:31.466122+0000","last_peered":"2024-05-08T20:03:31.466122+0000","last_clean":"2024-05-08T20:03:31.466122+0000","last_became_active":"2024-05-08T20:03:29.169766+0000","last_became_peered":"2024-05-08T20:03:29.169766+0000","last_unstale":"2024-05-08T20:03:31.466122+0000","last_undegraded":"2024-05-08T20:03:31.466122+0000","last_fullsized":"2024-05-08T20:03:31.466122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.969796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878178+0000","last_change":"2024-05-08T20:03:29.678943+0000","last_active":"2024-05-08T20:03:29.878178+0000","last_peered":"2024-05-08T20:03:29.878178+0000","last_clean":"2024-05-08T20:03:29.878178+0000","last_became_active":"2024-05-08T20:03:29.678616+0000","last_became_peered":"2024-05-08T20:03:29.678616+0000","last_unstale":"2024-05-08T20:03:29.878178+0000","last_undegraded":"2024-05-08T20:03:29.878178+0000","last_fullsized":"2024-05-08T20:03:29.878178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:28.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049197+0000","last_change":"2024-05-08T20:03:29.161096+0000","last_active":"2024-05-08T20:03:33.049197+0000","last_peered":"2024-05-08T20:03:33.049197+0000","last_clean":"2024-05-08T20:03:33.049197+0000","last_became_active":"2024-05-08T20:03:29.160768+0000","last_became_peered":"2024-05-08T20:03:29.160768+0000","last_unstale":"2024-05-08T20:03:33.049197+0000","last_undegraded":"2024-05-08T20:03:33.049197+0000","last_fullsized":"2024-05-08T20:03:33.049197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:38.830599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346794+0000","last_change":"2024-05-08T20:03:29.690624+0000","last_active":"2024-05-08T20:03:30.346794+0000","last_peered":"2024-05-08T20:03:30.346794+0000","last_clean":"2024-05-08T20:03:30.346794+0000","last_became_active":"2024-05-08T20:03:29.689889+0000","last_became_peered":"2024-05-08T20:03:29.689889+0000","last_unstale":"2024-05-08T20:03:30.346794+0000","last_undegraded":"2024-05-08T20:03:30.346794+0000","last_fullsized":"2024-05-08T20:03:30.346794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:05.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466536+0000","last_change":"2024-05-08T20:03:29.164559+0000","last_active":"2024-05-08T20:03:31.466536+0000","last_peered":"2024-05-08T20:03:31.466536+0000","last_clean":"2024-05-08T20:03:31.466536+0000","last_became_active":"2024-05-08T20:03:29.164201+0000","last_became_peered":"2024-05-08T20:03:29.164201+0000","last_unstale":"2024-05-08T20:03:31.466536+0000","last_undegraded":"2024-05-08T20:03:31.466536+0000","last_fullsized":"2024-05-08T20:03:31.466536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:12.678098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346856+0000","last_change":"2024-05-08T20:03:29.690256+0000","last_active":"2024-05-08T20:03:30.346856+0000","last_peered":"2024-05-08T20:03:30.346856+0000","last_clean":"2024-05-08T20:03:30.346856+0000","last_became_active":"2024-05-08T20:03:29.689310+0000","last_became_peered":"2024-05-08T20:03:29.689310+0000","last_unstale":"2024-05-08T20:03:30.346856+0000","last_undegraded":"2024-05-08T20:03:30.346856+0000","last_fullsized":"2024-05-08T20:03:30.346856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:49.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670818+0000","last_change":"2024-05-08T20:03:29.164733+0000","last_active":"2024-05-08T20:03:30.670818+0000","last_peered":"2024-05-08T20:03:30.670818+0000","last_clean":"2024-05-08T20:03:30.670818+0000","last_became_active":"2024-05-08T20:03:29.164395+0000","last_became_peered":"2024-05-08T20:03:29.164395+0000","last_unstale":"2024-05-08T20:03:30.670818+0000","last_undegraded":"2024-05-08T20:03:30.670818+0000","last_fullsized":"2024-05-08T20:03:30.670818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:48.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346818+0000","last_change":"2024-05-08T20:03:29.679616+0000","last_active":"2024-05-08T20:03:30.346818+0000","last_peered":"2024-05-08T20:03:30.346818+0000","last_clean":"2024-05-08T20:03:30.346818+0000","last_became_active":"2024-05-08T20:03:29.679235+0000","last_became_peered":"2024-05-08T20:03:29.679235+0000","last_unstale":"2024-05-08T20:03:30.346818+0000","last_undegraded":"2024-05-08T20:03:30.346818+0000","last_fullsized":"2024-05-08T20:03:30.346818+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:20.825327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.687694+0000","last_change":"2024-05-08T20:03:29.165731+0000","last_active":"2024-05-08T20:03:29.687694+0000","last_peered":"2024-05-08T20:03:29.687694+0000","last_clean":"2024-05-08T20:03:29.687694+0000","last_became_active":"2024-05-08T20:03:29.165397+0000","last_became_peered":"2024-05-08T20:03:29.165397+0000","last_unstale":"2024-05-08T20:03:29.687694+0000","last_undegraded":"2024-05-08T20:03:29.687694+0000","last_fullsized":"2024-05-08T20:03:29.687694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:55.541984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346880+0000","last_change":"2024-05-08T20:03:29.682523+0000","last_active":"2024-05-08T20:03:30.346880+0000","last_peered":"2024-05-08T20:03:30.346880+0000","last_clean":"2024-05-08T20:03:30.346880+0000","last_became_active":"2024-05-08T20:03:29.682188+0000","last_became_peered":"2024-05-08T20:03:29.682188+0000","last_unstale":"2024-05-08T20:03:30.346880+0000","last_undegraded":"2024-05-08T20:03:30.346880+0000","last_fullsized":"2024-05-08T20:03:30.346880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:16.871494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.695044+0000","last_change":"2024-05-08T20:03:29.692315+0000","last_active":"2024-05-08T20:03:29.695044+0000","last_peered":"2024-05-08T20:03:29.695044+0000","last_clean":"2024-05-08T20:03:29.695044+0000","last_became_active":"2024-05-08T20:03:29.691944+0000","last_became_peered":"2024-05-08T20:03:29.691944+0000","last_unstale":"2024-05-08T20:03:29.695044+0000","last_undegraded":"2024-05-08T20:03:29.695044+0000","last_fullsized":"2024-05-08T20:03:29.695044+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:02.614054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466270+0000","last_change":"2024-05-08T20:03:29.677763+0000","last_active":"2024-05-08T20:03:31.466270+0000","last_peered":"2024-05-08T20:03:31.466270+0000","last_clean":"2024-05-08T20:03:31.466270+0000","last_became_active":"2024-05-08T20:03:29.677282+0000","last_became_peered":"2024-05-08T20:03:29.677282+0000","last_unstale":"2024-05-08T20:03:31.466270+0000","last_undegraded":"2024-05-08T20:03:31.466270+0000","last_fullsized":"2024-05-08T20:03:31.466270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:03.039093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466116+0000","last_change":"2024-05-08T20:03:29.680085+0000","last_active":"2024-05-08T20:03:31.466116+0000","last_peered":"2024-05-08T20:03:31.466116+0000","last_clean":"2024-05-08T20:03:31.466116+0000","last_became_active":"2024-05-08T20:03:29.679793+0000","last_became_peered":"2024-05-08T20:03:29.679793+0000","last_unstale":"2024-05-08T20:03:31.466116+0000","last_undegraded":"2024-05-08T20:03:31.466116+0000","last_fullsized":"2024-05-08T20:03:31.466116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:24.679742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790883+0000","last_change":"2024-05-08T20:03:29.679987+0000","last_active":"2024-05-08T20:03:31.790883+0000","last_peered":"2024-05-08T20:03:31.790883+0000","last_clean":"2024-05-08T20:03:31.790883+0000","last_became_active":"2024-05-08T20:03:29.679630+0000","last_became_peered":"2024-05-08T20:03:29.679630+0000","last_unstale":"2024-05-08T20:03:31.790883+0000","last_undegraded":"2024-05-08T20:03:31.790883+0000","last_fullsized":"2024-05-08T20:03:31.790883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:25.119165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.674002+0000","last_change":"2024-05-08T20:03:29.672906+0000","last_active":"2024-05-08T20:03:29.674002+0000","last_peered":"2024-05-08T20:03:29.674002+0000","last_clean":"2024-05-08T20:03:29.674002+0000","last_became_active":"2024-05-08T20:03:29.672522+0000","last_became_peered":"2024-05-08T20:03:29.672522+0000","last_unstale":"2024-05-08T20:03:29.674002+0000","last_undegraded":"2024-05-08T20:03:29.674002+0000","last_fullsized":"2024-05-08T20:03:29.674002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:09.803843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694995+0000","last_change":"2024-05-08T20:03:29.692439+0000","last_active":"2024-05-08T20:03:29.694995+0000","last_peered":"2024-05-08T20:03:29.694995+0000","last_clean":"2024-05-08T20:03:29.694995+0000","last_became_active":"2024-05-08T20:03:29.691768+0000","last_became_peered":"2024-05-08T20:03:29.691768+0000","last_unstale":"2024-05-08T20:03:29.694995+0000","last_undegraded":"2024-05-08T20:03:29.694995+0000","last_fullsized":"2024-05-08T20:03:29.694995+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:36.412128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466556+0000","last_change":"2024-05-08T20:03:29.687551+0000","last_active":"2024-05-08T20:03:31.466556+0000","last_peered":"2024-05-08T20:03:31.466556+0000","last_clean":"2024-05-08T20:03:31.466556+0000","last_became_active":"2024-05-08T20:03:29.687188+0000","last_became_peered":"2024-05-08T20:03:29.687188+0000","last_unstale":"2024-05-08T20:03:31.466556+0000","last_undegraded":"2024-05-08T20:03:31.466556+0000","last_fullsized":"2024-05-08T20:03:31.466556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:36.167104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878210+0000","last_change":"2024-05-08T20:03:29.679077+0000","last_active":"2024-05-08T20:03:29.878210+0000","last_peered":"2024-05-08T20:03:29.878210+0000","last_clean":"2024-05-08T20:03:29.878210+0000","last_became_active":"2024-05-08T20:03:29.678712+0000","last_became_peered":"2024-05-08T20:03:29.678712+0000","last_unstale":"2024-05-08T20:03:29.878210+0000","last_undegraded":"2024-05-08T20:03:29.878210+0000","last_fullsized":"2024-05-08T20:03:29.878210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:25.023184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671086+0000","last_change":"2024-05-08T20:03:29.677428+0000","last_active":"2024-05-08T20:03:30.671086+0000","last_peered":"2024-05-08T20:03:30.671086+0000","last_clean":"2024-05-08T20:03:30.671086+0000","last_became_active":"2024-05-08T20:03:29.676210+0000","last_became_peered":"2024-05-08T20:03:29.676210+0000","last_unstale":"2024-05-08T20:03:30.671086+0000","last_undegraded":"2024-05-08T20:03:30.671086+0000","last_fullsized":"2024-05-08T20:03:30.671086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:44.508673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878127+0000","last_change":"2024-05-08T20:03:29.676957+0000","last_active":"2024-05-08T20:03:29.878127+0000","last_peered":"2024-05-08T20:03:29.878127+0000","last_clean":"2024-05-08T20:03:29.878127+0000","last_became_active":"2024-05-08T20:03:29.676580+0000","last_became_peered":"2024-05-08T20:03:29.676580+0000","last_unstale":"2024-05-08T20:03:29.878127+0000","last_undegraded":"2024-05-08T20:03:29.878127+0000","last_fullsized":"2024-05-08T20:03:29.878127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:32.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301687+0000","last_change":"2024-05-08T20:03:29.685336+0000","last_active":"2024-05-08T20:03:30.301687+0000","last_peered":"2024-05-08T20:03:30.301687+0000","last_clean":"2024-05-08T20:03:30.301687+0000","last_became_active":"2024-05-08T20:03:29.685025+0000","last_became_peered":"2024-05-08T20:03:29.685025+0000","last_unstale":"2024-05-08T20:03:30.301687+0000","last_undegraded":"2024-05-08T20:03:30.301687+0000","last_fullsized":"2024-05-08T20:03:30.301687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:24.170359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.682488+0000","last_change":"2024-05-08T20:03:29.681684+0000","last_active":"2024-05-08T20:03:29.682488+0000","last_peered":"2024-05-08T20:03:29.682488+0000","last_clean":"2024-05-08T20:03:29.682488+0000","last_became_active":"2024-05-08T20:03:29.681302+0000","last_became_peered":"2024-05-08T20:03:29.681302+0000","last_unstale":"2024-05-08T20:03:29.682488+0000","last_undegraded":"2024-05-08T20:03:29.682488+0000","last_fullsized":"2024-05-08T20:03:29.682488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:48.963279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.691442+0000","last_change":"2024-05-08T20:03:29.689885+0000","last_active":"2024-05-08T20:03:29.691442+0000","last_peered":"2024-05-08T20:03:29.691442+0000","last_clean":"2024-05-08T20:03:29.691442+0000","last_became_active":"2024-05-08T20:03:29.689562+0000","last_became_peered":"2024-05-08T20:03:29.689562+0000","last_unstale":"2024-05-08T20:03:29.691442+0000","last_undegraded":"2024-05-08T20:03:29.691442+0000","last_fullsized":"2024-05-08T20:03:29.691442+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:24.363101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246656,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3810,"num_objects":46,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":172032,"data_stored":10736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547210,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":851968,"data_stored":407253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":10,"up_from":67,"seq":287762808845,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32036,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713116,"statfs":{"total":95995035648,"available":95962230784,"internally_reserved":0,"allocated":946176,"data_stored":1008430,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1598,"internal_metadata":31848898},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":9,"up_from":62,"seq":266287972369,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":416641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.502}]},{"osd":1,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.51800000000000002}]},{"osd":3,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.432},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40100000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.69199999999999995}]},{"osd":5,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57199999999999995}]},{"osd":7,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.64700000000000002}]},{"osd":8,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.752}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":8,"up_from":55,"seq":236223201300,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":868352,"data_stored":416096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.40999999999999998}]},{"osd":1,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.57299999999999995}]},{"osd":2,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.443},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.73999999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.61799999999999999}]},{"osd":7,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58899999999999997}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.83599999999999997}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":7,"up_from":48,"seq":206158430232,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":1007887,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.60399999999999998}]},{"osd":3,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.436},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.44900000000000001}]},{"osd":4,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.41399999999999998}]},{"osd":5,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63200000000000001}]},{"osd":6,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.499}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.70099999999999996}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.53700000000000003}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":6,"up_from":43,"seq":184683593756,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":864256,"data_stored":415823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.434},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.45100000000000001}]},{"osd":1,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42099999999999999}]},{"osd":2,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.90700000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.53800000000000003}]},{"osd":3,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.503},{"interface":"front","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.626,"15min":0.627},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84899999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed May 8 20:02:45 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77600000000000002}]},{"osd":8,"last update":"Wed May 8 20:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68700000000000006}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.746},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65300000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":417114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.38900000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.498}]},{"osd":2,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.46700000000000003},"min":{"1min":0.42099999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed May 8 20:02:37 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.41999999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed May 8 20:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.30499999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.68000000000000005}]},{"osd":5,"last update":"Wed May 8 20:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.80200000000000005}]},{"osd":6,"last update":"Wed May 8 20:03:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73799999999999999}]},{"osd":7,"last update":"Wed May 8 20:02:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.748}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.82499999999999996}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713188,"statfs":{"total":95995035648,"available":95962304512,"internally_reserved":0,"allocated":868352,"data_stored":415913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.379,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.629},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.52500000000000002,"15min":0.497},"min":{"1min":0.40600000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.57999999999999996,"15min":0.54600000000000004},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.59899999999999998}]},{"osd":3,"last update":"Wed May 8 20:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.41599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998}]},{"osd":4,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.46899999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.495},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.39600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54300000000000004}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.55800000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.75900000000000001}]},{"osd":6,"last update":"Wed May 8 20:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.78000000000000003}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73999999999999999}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.89100000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411370,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":880640,"data_stored":417421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.45100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.498}]},{"osd":1,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.46500000000000002},"min":{"1min":0.38600000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.46999999999999997},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.495,"15min":0.48299999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.72799999999999998}]},{"osd":4,"last update":"Wed May 8 20:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.65300000000000002}]},{"osd":5,"last update":"Wed May 8 20:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.628},{"interface":"front","average":{"1min":0.504,"5min":0.44800000000000001,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.97199999999999998}]},{"osd":6,"last update":"Wed May 8 20:02:32 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.77500000000000002}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.749}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.879}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]}]},{"osd":3,"up_from":24,"seq":103079215142,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":880640,"data_stored":416107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.38100000000000001,"15min":0.376},"min":{"1min":0.28000000000000003,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.40999999999999998,"15min":0.40500000000000003},"min":{"1min":0.32300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44}]},{"osd":1,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.40100000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.71899999999999997,"5min":0.753,"15min":0.753},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.54100000000000004,"15min":0.54500000000000004},"min":{"1min":0.39000000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.70599999999999996,"5min":1.119,"15min":1.119},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed May 8 20:02:39 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57499999999999996,"15min":0.56899999999999995},"min":{"1min":0.45000000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.79200000000000004,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.57199999999999995},"min":{"1min":0.42899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54200000000000004}]},{"osd":4,"last update":"Wed May 8 20:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75800000000000001,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58099999999999996,"15min":0.57899999999999996},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.626}]},{"osd":6,"last update":"Wed May 8 20:03:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.871,"5min":0.88,"15min":0.88},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Wed May 8 20:02:50 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.72499999999999998}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.77000000000000002}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.68300000000000005}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31976,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713176,"statfs":{"total":95995035648,"available":95962292224,"internally_reserved":0,"allocated":868352,"data_stored":415845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.375,"15min":0.36699999999999999},"min":{"1min":0.27700000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.36899999999999999,"15min":0.36099999999999999},"min":{"1min":0.29099999999999998,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.504}]},{"osd":2,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70499999999999996}]},{"osd":3,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.40600000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.38700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48399999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.74399999999999999}]},{"osd":6,"last update":"Wed May 8 20:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63}]},{"osd":7,"last update":"Wed May 8 20:02:46 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.76000000000000001}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.81299999999999994}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.68799999999999994}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822687,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":1007619,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.48099999999999998},"min":{"1min":0.313,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.628},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.80000000000000004}]},{"osd":2,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57899999999999996}]},{"osd":3,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63700000000000001}]},{"osd":4,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.753},{"interface":"front","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.874}]},{"osd":6,"last update":"Wed May 8 20:03:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.78500000000000003}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.82899999999999996}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.90800000000000003}]},{"osd":9,"last update":"Wed May 8 20:03:25 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.86299999999999999}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:03:38.889 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-08T20:03:38.889 INFO:tasks.cephadm:Setting up client nodes... 2024-05-08T20:03:38.890 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-08T20:03:39.170 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:39.303 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:39 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1920169626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:39.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:39 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1920169626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:39.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:39 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1920169626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:40.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 -- 172.21.15.33:0/2086812130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 msgr2=0x7f5444106820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:40.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 --2- 172.21.15.33:0/2086812130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f5444106820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5440009990 tx=0x7f5440009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 -- 172.21.15.33:0/2086812130 shutdown_connections 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 --2- 172.21.15.33:0/2086812130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5444106d60 0x7f5444109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 --2- 172.21.15.33:0/2086812130 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5444101b00 0x7f5444103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 --2- 172.21.15.33:0/2086812130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f5444106820 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 -- 172.21.15.33:0/2086812130 >> 172.21.15.33:0/2086812130 conn(0x7f54440fb470 msgr2=0x7f54440fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 -- 172.21.15.33:0/2086812130 shutdown_connections 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 -- 172.21.15.33:0/2086812130 wait complete. 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 Processor -- start 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.207+0000 7f544b791700 1 -- start start 2024-05-08T20:03:40.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f544b791700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5444101b00 0x7f5444196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f544b791700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f54441974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f544b791700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5444106d60 0x7f544419e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f544b791700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419eaf0 con 0x7f5444104430 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f544b791700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419ec30 con 0x7f5444106d60 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f544b791700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544419edc0 con 0x7f5444101b00 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f54441974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f54441974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55588/0 (socket says 172.21.15.33:55588) 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 -- 172.21.15.33:0/725726904 learned_addr learned my addr 172.21.15.33:0/725726904 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f544952d700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5444101b00 0x7f5444196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5449d2e700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5444106d60 0x7f544419e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 -- 172.21.15.33:0/725726904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5444101b00 msgr2=0x7f5444196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5444101b00 0x7f5444196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 -- 172.21.15.33:0/725726904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5444106d60 msgr2=0x7f544419e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5444106d60 0x7f544419e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 -- 172.21.15.33:0/725726904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54400095f0 con 0x7f5444104430 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.208+0000 7f5448d2c700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f54441974f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5440000c00 tx=0x7f544000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.209+0000 7f543a7fc700 1 -- 172.21.15.33:0/725726904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544001d070 con 0x7f5444104430 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.209+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f544419f040 con 0x7f5444104430 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.209+0000 7f543a7fc700 1 -- 172.21.15.33:0/725726904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f544000fb40 con 0x7f5444104430 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.209+0000 7f543a7fc700 1 -- 172.21.15.33:0/725726904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440017650 con 0x7f5444104430 2024-05-08T20:03:40.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.209+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544419f450 con 0x7f5444104430 2024-05-08T20:03:40.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.210+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54440fcff0 con 0x7f5444104430 2024-05-08T20:03:40.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.211+0000 7f543a7fc700 1 -- 172.21.15.33:0/725726904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f544000fcb0 con 0x7f5444104430 2024-05-08T20:03:40.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.212+0000 7f543a7fc700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54300a11b0 0x7f54300a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:40.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.212+0000 7f544952d700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54300a11b0 0x7f54300a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:40.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.212+0000 7f543a7fc700 1 -- 172.21.15.33:0/725726904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f54400ce620 con 0x7f5444104430 2024-05-08T20:03:40.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.212+0000 7f544952d700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54300a11b0 0x7f54300a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5434007c60 tx=0x7f54340073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:40.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.215+0000 7f543a7fc700 1 -- 172.21.15.33:0/725726904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5440097d90 con 0x7f5444104430 2024-05-08T20:03:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:40 smithi033 ceph-mon[42490]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:03:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:40 smithi033 ceph-mon[42490]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:03:40.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:40 smithi033 ceph-mon[42490]: pgmap v226: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.9 KiB/s wr, 19 op/s 2024-05-08T20:03:40.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:40 smithi082 ceph-mon[46774]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:03:40.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:40 smithi082 ceph-mon[46774]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:03:40.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:40 smithi082 ceph-mon[46774]: pgmap v226: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.9 KiB/s wr, 19 op/s 2024-05-08T20:03:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:40 smithi132 ceph-mon[47484]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:03:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:40 smithi132 ceph-mon[47484]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:03:40.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:40 smithi132 ceph-mon[47484]: pgmap v226: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.9 KiB/s wr, 19 op/s 2024-05-08T20:03:40.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.517+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f544410c910 con 0x7f5444104430 2024-05-08T20:03:40.511 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.521+0000 7f543a7fc700 1 -- 172.21.15.33:0/725726904 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f544009b3b0 con 0x7f5444104430 2024-05-08T20:03:40.511 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2024-05-08T20:03:40.511 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCc2jtmBcvpHhAAyj9/UnbQXwzz38Pev4T/kQ== 2024-05-08T20:03:40.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54300a11b0 msgr2=0x7f54300a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:40.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54300a11b0 0x7f54300a3670 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5434007c60 tx=0x7f54340073d0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.513 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 msgr2=0x7f54441974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f54441974f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5440000c00 tx=0x7f544000f690 comp rx=0 tx=0).stop 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 shutdown_connections 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5444106d60 0x7f544419e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54300a11b0 0x7f54300a3670 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5444101b00 0x7f5444196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 --2- 172.21.15.33:0/725726904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5444104430 0x7f54441974f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 >> 172.21.15.33:0/725726904 conn(0x7f54440fb470 msgr2=0x7f5444102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 shutdown_connections 2024-05-08T20:03:40.514 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:40.524+0000 7f544b791700 1 -- 172.21.15.33:0/725726904 wait complete. 2024-05-08T20:03:40.880 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T20:03:40.880 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-08T20:03:40.880 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T20:03:40.931 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T20:03:40.931 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-08T20:03:40.931 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-08T20:03:41.070 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:41 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/725726904' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T20:03:41.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:41 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/725726904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T20:03:41.229 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:41.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:41 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/725726904' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T20:03:41.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:41 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/725726904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T20:03:41.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:41 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/725726904' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T20:03:41.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:41 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/725726904' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T20:03:42.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 -- 172.21.15.33:0/4015183674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 msgr2=0x7f2c40104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:42.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 --2- 172.21.15.33:0/4015183674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c40104a30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009990 tx=0x7f2c30009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 -- 172.21.15.33:0/4015183674 shutdown_connections 2024-05-08T20:03:42.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 --2- 172.21.15.33:0/4015183674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c40100300 0x7f2c4010c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 --2- 172.21.15.33:0/4015183674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c40104a30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 --2- 172.21.15.33:0/4015183674 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c400ff940 0x7f2c400ffdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 -- 172.21.15.33:0/4015183674 >> 172.21.15.33:0/4015183674 conn(0x7f2c40075260 msgr2=0x7f2c40075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:42.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 -- 172.21.15.33:0/4015183674 shutdown_connections 2024-05-08T20:03:42.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.211+0000 7f2c460bd700 1 -- 172.21.15.33:0/4015183674 wait complete. 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.212+0000 7f2c460bd700 1 Processor -- start 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c460bd700 1 -- start start 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c460bd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c400ff940 0x7f2c40196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c460bd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c40100300 0x7f2c40196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c460bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c4019aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c460bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4019b1b0 con 0x7f2c40104650 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c460bd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4019b320 con 0x7f2c40100300 2024-05-08T20:03:42.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c460bd700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4019b4e0 con 0x7f2c400ff940 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c4019aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c4019aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55604/0 (socket says 172.21.15.33:55604) 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 -- 172.21.15.33:0/3382978457 learned_addr learned my addr 172.21.15.33:0/3382978457 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3f7fe700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c400ff940 0x7f2c40196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3effd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c40100300 0x7f2c40196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 -- 172.21.15.33:0/3382978457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c400ff940 msgr2=0x7f2c40196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c400ff940 0x7f2c40196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 -- 172.21.15.33:0/3382978457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c40100300 msgr2=0x7f2c40196840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c40100300 0x7f2c40196840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3ffff700 1 -- 172.21.15.33:0/3382978457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c300095f0 con 0x7f2c40104650 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.213+0000 7f2c3effd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c40100300 0x7f2c40196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:03:42.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.214+0000 7f2c3ffff700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c4019aba0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800ef30 tx=0x7f2c3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.214+0000 7f2c3cff9700 1 -- 172.21.15.33:0/3382978457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c38018070 con 0x7f2c40104650 2024-05-08T20:03:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.214+0000 7f2c3cff9700 1 -- 172.21.15.33:0/3382978457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2c3800f040 con 0x7f2c40104650 2024-05-08T20:03:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.214+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4019b760 con 0x7f2c40104650 2024-05-08T20:03:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.214+0000 7f2c3cff9700 1 -- 172.21.15.33:0/3382978457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800ce00 con 0x7f2c40104650 2024-05-08T20:03:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.214+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c401a3020 con 0x7f2c40104650 2024-05-08T20:03:42.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.215+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c40107c20 con 0x7f2c40104650 2024-05-08T20:03:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.218+0000 7f2c3cff9700 1 -- 172.21.15.33:0/3382978457 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2c38003a00 con 0x7f2c40104650 2024-05-08T20:03:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.218+0000 7f2c3cff9700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2c2c0a11b0 0x7f2c2c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.218+0000 7f2c3f7fe700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2c2c0a11b0 0x7f2c2c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.218+0000 7f2c3cff9700 1 -- 172.21.15.33:0/3382978457 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2c380ccf40 con 0x7f2c40104650 2024-05-08T20:03:42.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.218+0000 7f2c3f7fe700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2c2c0a11b0 0x7f2c2c0a3670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b2e0 tx=0x7f2c30005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:42.210 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.221+0000 7f2c3cff9700 1 -- 172.21.15.33:0/3382978457 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2c380966b0 con 0x7f2c40104650 2024-05-08T20:03:42.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:42 smithi033 ceph-mon[42490]: pgmap v227: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2024-05-08T20:03:42.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:42 smithi082 ceph-mon[46774]: pgmap v227: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2024-05-08T20:03:42.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:42 smithi132 ceph-mon[47484]: pgmap v227: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 8.1 KiB/s wr, 18 op/s 2024-05-08T20:03:42.485 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.495+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2c401975c0 con 0x7f2c40104650 2024-05-08T20:03:42.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.500+0000 7f2c3cff9700 1 -- 172.21.15.33:0/3382978457 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260286 (secure 0 0 0) 0x7f2c38099cd0 con 0x7f2c40104650 2024-05-08T20:03:42.496 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.503+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2c2c0a11b0 msgr2=0x7f2c2c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.503+0000 7f2c460bd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2c2c0a11b0 0x7f2c2c0a3670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2c3000b2e0 tx=0x7f2c30005960 comp rx=0 tx=0).stop 2024-05-08T20:03:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.503+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 msgr2=0x7f2c4019aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.503+0000 7f2c460bd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c4019aba0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800ef30 tx=0x7f2c3800c3a0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.503+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 shutdown_connections 2024-05-08T20:03:42.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.504+0000 7f2c460bd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c40104650 0x7f2c4019aba0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.504+0000 7f2c460bd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2c2c0a11b0 0x7f2c2c0a3670 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.504+0000 7f2c460bd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c400ff940 0x7f2c40196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.504+0000 7f2c460bd700 1 --2- 172.21.15.33:0/3382978457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c40100300 0x7f2c40196840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:42.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.504+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 >> 172.21.15.33:0/3382978457 conn(0x7f2c40075260 msgr2=0x7f2c400fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:42.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.504+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 shutdown_connections 2024-05-08T20:03:42.499 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:42.504+0000 7f2c460bd700 1 -- 172.21.15.33:0/3382978457 wait complete. 2024-05-08T20:03:42.864 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":3089330166},{"type":"v1","addr":"172.21.15.33:6801","nonce":3089330166}]},"active_addr":"172.21.15.33:6801/3089330166","active_change":"2024-05-08T19:58:27.048670+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24119,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.33:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3915505292}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1758089139}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1526464392}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3850877935}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":2345595459}]}]} 2024-05-08T20:03:42.869 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-08T20:03:42.869 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-08T20:03:42.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T20:03:43.071 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:43 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3382978457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T20:03:43.128 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:43.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:43 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3382978457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T20:03:43.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:43 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3382978457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T20:03:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 -- 172.21.15.33:0/3891863399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 msgr2=0x7f6ca4100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 --2- 172.21.15.33:0/3891863399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca4100350 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009990 tx=0x7f6c98009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 -- 172.21.15.33:0/3891863399 shutdown_connections 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 --2- 172.21.15.33:0/3891863399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca4100890 0x7f6ca410cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 --2- 172.21.15.33:0/3891863399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca4105f00 0x7f6ca41062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 --2- 172.21.15.33:0/3891863399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca4100350 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 -- 172.21.15.33:0/3891863399 >> 172.21.15.33:0/3891863399 conn(0x7f6ca4075f80 msgr2=0x7f6ca4076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 -- 172.21.15.33:0/3891863399 shutdown_connections 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.122+0000 7f6caa882700 1 -- 172.21.15.33:0/3891863399 wait complete. 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 Processor -- start 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 -- start start 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca41996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca4100890 0x7f6ca4199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca4105f00 0x7f6ca419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca419e570 con 0x7f6ca40ffed0 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca419e6e0 con 0x7f6ca4105f00 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.123+0000 7f6caa882700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca419e8a0 con 0x7f6ca4100890 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca41996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca41996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47864/0 (socket says 172.21.15.33:47864) 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 -- 172.21.15.33:0/2210279331 learned_addr learned my addr 172.21.15.33:0/2210279331 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca8e1f700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca4105f00 0x7f6ca419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca37fe700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca4100890 0x7f6ca4199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 -- 172.21.15.33:0/2210279331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca4100890 msgr2=0x7f6ca4199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca4100890 0x7f6ca4199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 -- 172.21.15.33:0/2210279331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca4105f00 msgr2=0x7f6ca419df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca4105f00 0x7f6ca419df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 -- 172.21.15.33:0/2210279331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980095f0 con 0x7f6ca40ffed0 2024-05-08T20:03:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca3fff700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca41996c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e9a0 tx=0x7f6c9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca17fa700 1 -- 172.21.15.33:0/2210279331 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94009790 con 0x7f6ca40ffed0 2024-05-08T20:03:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca17fa700 1 -- 172.21.15.33:0/2210279331 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6c94010430 con 0x7f6ca40ffed0 2024-05-08T20:03:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ca419eb80 con 0x7f6ca40ffed0 2024-05-08T20:03:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6ca17fa700 1 -- 172.21.15.33:0/2210279331 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c94018680 con 0x7f6ca40ffed0 2024-05-08T20:03:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.124+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca41a63e0 con 0x7f6ca40ffed0 2024-05-08T20:03:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.125+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca41015b0 con 0x7f6ca40ffed0 2024-05-08T20:03:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.127+0000 7f6ca17fa700 1 -- 172.21.15.33:0/2210279331 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6c94010910 con 0x7f6ca40ffed0 2024-05-08T20:03:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.128+0000 7f6ca17fa700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6c8c0a11b0 0x7f6c8c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.128+0000 7f6ca37fe700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6c8c0a11b0 0x7f6c8c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.128+0000 7f6ca17fa700 1 -- 172.21.15.33:0/2210279331 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6c94014070 con 0x7f6ca40ffed0 2024-05-08T20:03:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.128+0000 7f6ca37fe700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6c8c0a11b0 0x7f6c8c0a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800b2e0 tx=0x7f6c98005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:44.119 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.131+0000 7f6ca17fa700 1 -- 172.21.15.33:0/2210279331 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6c940966d0 con 0x7f6ca40ffed0 2024-05-08T20:03:44.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:44 smithi033 ceph-mon[42490]: pgmap v228: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-05-08T20:03:44.333 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.344+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ca404ec60 con 0x7f6ca40ffed0 2024-05-08T20:03:44.334 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.346+0000 7f6ca17fa700 1 -- 172.21.15.33:0/2210279331 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f6c940105a0 con 0x7f6ca40ffed0 2024-05-08T20:03:44.335 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:44.335 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:30.657561+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:03:44.337 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.348+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6c8c0a11b0 msgr2=0x7f6c8c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:44.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.348+0000 7f6caa882700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6c8c0a11b0 0x7f6c8c0a3670 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6c9800b2e0 tx=0x7f6c98005960 comp rx=0 tx=0).stop 2024-05-08T20:03:44.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.348+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 msgr2=0x7f6ca41996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:44.338 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.348+0000 7f6caa882700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca41996c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6c9400e9a0 tx=0x7f6c9400ecb0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 shutdown_connections 2024-05-08T20:03:44.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ca4105f00 0x7f6ca419df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40ffed0 0x7f6ca41996c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6c8c0a11b0 0x7f6c8c0a3670 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.339 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 --2- 172.21.15.33:0/2210279331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ca4100890 0x7f6ca4199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:44.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 >> 172.21.15.33:0/2210279331 conn(0x7f6ca4075f80 msgr2=0x7f6ca40689b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:44.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 shutdown_connections 2024-05-08T20:03:44.340 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:44.349+0000 7f6caa882700 1 -- 172.21.15.33:0/2210279331 wait complete. 2024-05-08T20:03:44.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:44 smithi082 ceph-mon[46774]: pgmap v228: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-05-08T20:03:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:44 smithi132 ceph-mon[47484]: pgmap v228: 97 pgs: 97 active+clean; 623 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 7.2 KiB/s wr, 16 op/s 2024-05-08T20:03:44.730 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-08T20:03:44.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T20:03:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:45.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:45 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2210279331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:45.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:45 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2210279331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:45.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:45 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2210279331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 -- 172.21.15.33:0/376221841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc068980 msgr2=0x7f7bdc068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 --2- 172.21.15.33:0/376221841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc068980 0x7f7bdc068de0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00098f0 tx=0x7f7bd0009c00 comp rx=0 tx=0).stop 2024-05-08T20:03:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 -- 172.21.15.33:0/376221841 shutdown_connections 2024-05-08T20:03:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 --2- 172.21.15.33:0/376221841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bdc069320 0x7f7bdc10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:45.926 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 --2- 172.21.15.33:0/376221841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bdc107010 0x7f7bdc1073f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 --2- 172.21.15.33:0/376221841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc068980 0x7f7bdc068de0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 -- 172.21.15.33:0/376221841 >> 172.21.15.33:0/376221841 conn(0x7f7bdc075f80 msgr2=0x7f7bdc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 -- 172.21.15.33:0/376221841 shutdown_connections 2024-05-08T20:03:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.937+0000 7f7be251b700 1 -- 172.21.15.33:0/376221841 wait complete. 2024-05-08T20:03:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 Processor -- start 2024-05-08T20:03:45.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 -- start start 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bdc068980 0x7f7bdc197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bdc069320 0x7f7bdc197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc107010 0x7f7bdc19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc19c450 con 0x7f7bdc107010 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc19c5c0 con 0x7f7bdc069320 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be251b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc19c780 con 0x7f7bdc068980 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be0ab8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc107010 0x7f7bdc19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be0ab8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc107010 0x7f7bdc19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47886/0 (socket says 172.21.15.33:47886) 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.938+0000 7f7be0ab8700 1 -- 172.21.15.33:0/2258151501 learned_addr learned my addr 172.21.15.33:0/2258151501 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7bdb7fe700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bdc069320 0x7f7bdc197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:45.929 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7bdbfff700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bdc068980 0x7f7bdc197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be0ab8700 1 -- 172.21.15.33:0/2258151501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bdc068980 msgr2=0x7f7bdc197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be0ab8700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bdc068980 0x7f7bdc197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be0ab8700 1 -- 172.21.15.33:0/2258151501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bdc069320 msgr2=0x7f7bdc197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be0ab8700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bdc069320 0x7f7bdc197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be0ab8700 1 -- 172.21.15.33:0/2258151501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0009520 con 0x7f7bdc107010 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be0ab8700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc107010 0x7f7bdc19be40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c110 tx=0x7f7bd400c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7bd97fa700 1 -- 172.21.15.33:0/2258151501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4017070 con 0x7f7bdc107010 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc19ca00 con 0x7f7bdc107010 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7bd97fa700 1 -- 172.21.15.33:0/2258151501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7bd400e050 con 0x7f7bdc107010 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7bd97fa700 1 -- 172.21.15.33:0/2258151501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4007940 con 0x7f7bdc107010 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.939+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc1a42c0 con 0x7f7bdc107010 2024-05-08T20:03:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.940+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc109530 con 0x7f7bdc107010 2024-05-08T20:03:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.942+0000 7f7bd97fa700 1 -- 172.21.15.33:0/2258151501 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7bd4004ad0 con 0x7f7bdc107010 2024-05-08T20:03:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.942+0000 7f7bd97fa700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7bc40a11b0 0x7f7bc40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.942+0000 7f7bdbfff700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7bc40a11b0 0x7f7bc40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.942+0000 7f7bd97fa700 1 -- 172.21.15.33:0/2258151501 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7bd40ccda0 con 0x7f7bdc107010 2024-05-08T20:03:45.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.943+0000 7f7bdbfff700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7bc40a11b0 0x7f7bc40a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009be0 tx=0x7f7bcc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:45.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:45.946+0000 7f7bd97fa700 1 -- 172.21.15.33:0/2258151501 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7bd4096580 con 0x7f7bdc107010 2024-05-08T20:03:46.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.161+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bdc198860 con 0x7f7bdc107010 2024-05-08T20:03:46.151 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.163+0000 7f7bd97fa700 1 -- 172.21.15.33:0/2258151501 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f7bd4099ba0 con 0x7f7bdc107010 2024-05-08T20:03:46.151 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:03:46.152 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:30.657561+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:03:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7bc40a11b0 msgr2=0x7f7bc40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7bc40a11b0 0x7f7bc40a3670 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009be0 tx=0x7f7bcc009260 comp rx=0 tx=0).stop 2024-05-08T20:03:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc107010 msgr2=0x7f7bdc19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc107010 0x7f7bdc19be40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c110 tx=0x7f7bd400c420 comp rx=0 tx=0).stop 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 shutdown_connections 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7bdc107010 0x7f7bdc19be40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7bc40a11b0 0x7f7bc40a3670 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bdc068980 0x7f7bdc197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 --2- 172.21.15.33:0/2258151501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bdc069320 0x7f7bdc197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 >> 172.21.15.33:0/2258151501 conn(0x7f7bdc075f80 msgr2=0x7f7bdc0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 shutdown_connections 2024-05-08T20:03:46.154 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:46.165+0000 7f7be251b700 1 -- 172.21.15.33:0/2258151501 wait complete. 2024-05-08T20:03:46.326 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:46 smithi033 ceph-mon[42490]: pgmap v229: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-05-08T20:03:46.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:46 smithi082 ceph-mon[46774]: pgmap v229: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-05-08T20:03:46.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:46 smithi132 ceph-mon[47484]: pgmap v229: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.6 KiB/s wr, 18 op/s 2024-05-08T20:03:46.529 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-08T20:03:46.530 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-08T20:03:46.530 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-08T20:03:46.531 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-08T20:03:46.531 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-08T20:03:46.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-08T20:03:46.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-08T20:03:46.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-08T20:03:46.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-08T20:03:46.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-08T20:03:46.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-08T20:03:46.534 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-08T20:03:47.320 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:47.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:47 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2258151501' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:47.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:47 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2258151501' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:47.504 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:47 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2258151501' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:03:47.573 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:47.675 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:47.735 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:48.259 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:48 smithi033 ceph-mon[42490]: pgmap v230: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-05-08T20:03:48.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:48 smithi082 ceph-mon[46774]: pgmap v230: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-05-08T20:03:48.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:48 smithi132 ceph-mon[47484]: pgmap v230: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 -- 172.21.15.33:0/14741452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4069270 msgr2=0x7f68b410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 --2- 172.21.15.33:0/14741452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4069270 0x7f68b410d540 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009990 tx=0x7f68b0009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 -- 172.21.15.33:0/14741452 shutdown_connections 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 --2- 172.21.15.33:0/14741452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b410da80 0x7f68b410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 --2- 172.21.15.33:0/14741452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b4068950 0x7f68b4068d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 --2- 172.21.15.33:0/14741452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4069270 0x7f68b410d540 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 -- 172.21.15.33:0/14741452 >> 172.21.15.33:0/14741452 conn(0x7f68b4075f80 msgr2=0x7f68b4076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 -- 172.21.15.33:0/14741452 shutdown_connections 2024-05-08T20:03:49.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 -- 172.21.15.33:0/14741452 wait complete. 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.030+0000 7f68bc261700 1 Processor -- start 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68bc261700 1 -- start start 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68bc261700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4068950 0x7f68b4199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68bc261700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b4069270 0x7f68b4199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68bc261700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b410da80 0x7f68b419df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68bc261700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b419e530 con 0x7f68b4068950 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68bc261700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b419e6a0 con 0x7f68b410da80 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68bc261700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b419e860 con 0x7f68b4069270 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4068950 0x7f68b4199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4068950 0x7f68b4199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47904/0 (socket says 172.21.15.33:47904) 2024-05-08T20:03:49.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 -- 172.21.15.33:0/2312564957 learned_addr learned my addr 172.21.15.33:0/2312564957 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b97fc700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b4069270 0x7f68b4199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68ba7fe700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b410da80 0x7f68b419df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 -- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b4069270 msgr2=0x7f68b4199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68b4069270 0x7f68b4199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 -- 172.21.15.33:0/2312564957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b410da80 msgr2=0x7f68b419df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68b410da80 0x7f68b419df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.031+0000 7f68b9ffd700 1 -- 172.21.15.33:0/2312564957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00095f0 con 0x7f68b4068950 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.032+0000 7f68b9ffd700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4068950 0x7f68b4199680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f68a400c9b0 tx=0x7f68a400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.032+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4007b00 con 0x7f68b4068950 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.032+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f68a4007c60 con 0x7f68b4068950 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.032+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a4018660 con 0x7f68b4068950 2024-05-08T20:03:49.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.032+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b419eb40 con 0x7f68b4068950 2024-05-08T20:03:49.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.032+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b41a63a0 con 0x7f68b4068950 2024-05-08T20:03:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.033+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68b41134f0 con 0x7f68b4068950 2024-05-08T20:03:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.034+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f68a400f450 con 0x7f68b4068950 2024-05-08T20:03:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.034+0000 7f68aaffd700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f68a00a1230 0x7f68a00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.035+0000 7f68b97fc700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f68a00a1230 0x7f68a00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.035+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f68a40ccdb0 con 0x7f68b4068950 2024-05-08T20:03:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.035+0000 7f68aaffd700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] conn(0x7f68a00aaa10 0x7f68a00ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.035+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 --> [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68a00ad4e0 con 0x7f68a00aaa10 2024-05-08T20:03:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.035+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68a40cd120 con 0x7f68b4068950 2024-05-08T20:03:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.035+0000 7f68b97fc700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f68a00a1230 0x7f68a00a36f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f68b00098e0 tx=0x7f68b0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.035+0000 7f68ba7fe700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] conn(0x7f68a00aaa10 0x7f68a00ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.036+0000 7f68ba7fe700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] conn(0x7f68a00aaa10 0x7f68a00ace30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:49.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.037+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== osd.2 v2:172.21.15.132:6800/1122791849 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f68a00ad4e0 con 0x7f68a00aaa10 2024-05-08T20:03:49.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.054+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 --> [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68b41004b0 con 0x7f68a00aaa10 2024-05-08T20:03:49.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.054+0000 7f68aaffd700 1 -- 172.21.15.33:0/2312564957 <== osd.2 v2:172.21.15.132:6800/1122791849 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68b41004b0 con 0x7f68a00aaa10 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] conn(0x7f68a00aaa10 msgr2=0x7f68a00ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] conn(0x7f68a00aaa10 0x7f68a00ace30 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f68a00a1230 msgr2=0x7f68a00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f68a00a1230 0x7f68a00a36f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f68b00098e0 tx=0x7f68b0005960 comp rx=0 tx=0).stop 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4068950 msgr2=0x7f68b4199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 --2- 172.21.15.33:0/2312564957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b4068950 0x7f68b4199680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f68a400c9b0 tx=0x7f68a400ccc0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68ba7fe700 1 -- 172.21.15.33:0/2312564957 reap_dead start 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 shutdown_connections 2024-05-08T20:03:49.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 >> 172.21.15.33:0/2312564957 conn(0x7f68b4075f80 msgr2=0x7f68b410eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:49.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 shutdown_connections 2024-05-08T20:03:49.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.055+0000 7f68bc261700 1 -- 172.21.15.33:0/2312564957 wait complete. 2024-05-08T20:03:49.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 -- 172.21.15.33:0/3526493453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810069bd0 msgr2=0x7f181010de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 --2- 172.21.15.33:0/3526493453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810069bd0 0x7f181010de00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f180800b0d0 tx=0x7f180800b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 -- 172.21.15.33:0/3526493453 shutdown_connections 2024-05-08T20:03:49.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 --2- 172.21.15.33:0/3526493453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810069bd0 0x7f181010de00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 --2- 172.21.15.33:0/3526493453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1810106fe0 0x7f18101073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 --2- 172.21.15.33:0/3526493453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1810069210 0x7f1810069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 -- 172.21.15.33:0/3526493453 >> 172.21.15.33:0/3526493453 conn(0x7f1810076e70 msgr2=0x7f1810077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:49.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.456+0000 7f1815197700 1 -- 172.21.15.33:0/3526493453 shutdown_connections 2024-05-08T20:03:49.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.457+0000 7f1815197700 1 -- 172.21.15.33:0/3526493453 wait complete. 2024-05-08T20:03:49.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.457+0000 7f1815197700 1 Processor -- start 2024-05-08T20:03:49.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.458+0000 7f1815197700 1 -- start start 2024-05-08T20:03:49.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.458+0000 7f1815197700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1810069210 0x7f1810199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.458+0000 7f1815197700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1810069bd0 0x7f1810199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.458+0000 7f1815197700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810106fe0 0x7f181019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.448 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.458+0000 7f1815197700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019e620 con 0x7f1810106fe0 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.458+0000 7f1815197700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019e790 con 0x7f1810069bd0 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.458+0000 7f1815197700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019e950 con 0x7f1810069210 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1810069bd0 0x7f1810199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1810069bd0 0x7f1810199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:50516/0 (socket says 172.21.15.33:50516) 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 -- 172.21.15.33:0/1563148395 learned_addr learned my addr 172.21.15.33:0/1563148395 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180ed9d700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1810069210 0x7f1810199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180f59e700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810106fe0 0x7f181019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 -- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1810069210 msgr2=0x7f1810199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1810069210 0x7f1810199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 -- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810106fe0 msgr2=0x7f181019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810106fe0 0x7f181019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 -- 172.21.15.33:0/1563148395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1808009d00 con 0x7f1810069bd0 2024-05-08T20:03:49.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180f59e700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1810106fe0 0x7f181019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:03:49.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f180e59c700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1810069bd0 0x7f1810199c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f180400e9a0 tx=0x7f180400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:49.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804009790 con 0x7f1810069bd0 2024-05-08T20:03:49.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f180400cbd0 con 0x7f1810069bd0 2024-05-08T20:03:49.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181019ec30 con 0x7f1810069bd0 2024-05-08T20:03:49.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.459+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804018680 con 0x7f1810069bd0 2024-05-08T20:03:49.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.460+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18101a6490 con 0x7f1810069bd0 2024-05-08T20:03:49.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.461+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18101112f0 con 0x7f1810069bd0 2024-05-08T20:03:49.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.462+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f18040188a0 con 0x7f1810069bd0 2024-05-08T20:03:49.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.463+0000 7f17f7fff700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f17f80a11b0 0x7f17f80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.463+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1804014070 con 0x7f1810069bd0 2024-05-08T20:03:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.463+0000 7f180ed9d700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f17f80a11b0 0x7f17f80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.463+0000 7f17f7fff700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] conn(0x7f17f80aa980 0x7f17f80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.463+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 --> [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f17f80ad450 con 0x7f17f80aa980 2024-05-08T20:03:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.463+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18040cd010 con 0x7f1810069bd0 2024-05-08T20:03:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.464+0000 7f180ed9d700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f17f80a11b0 0x7f17f80a3670 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1800009c60 tx=0x7f1800009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:49.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.464+0000 7f180f59e700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] conn(0x7f17f80aa980 0x7f17f80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:49.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.464+0000 7f180f59e700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] conn(0x7f17f80aa980 0x7f17f80acda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:49.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.465+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== osd.11 v2:172.21.15.132:6824/77968886 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f17f80ad450 con 0x7f17f80aa980 2024-05-08T20:03:49.472 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.483+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 --> [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f181010cb00 con 0x7f17f80aa980 2024-05-08T20:03:49.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.484+0000 7f17f7fff700 1 -- 172.21.15.33:0/1563148395 <== osd.11 v2:172.21.15.132:6824/77968886 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f181010cb00 con 0x7f17f80aa980 2024-05-08T20:03:49.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.485+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] conn(0x7f17f80aa980 msgr2=0x7f17f80acda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.485+0000 7f1815197700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] conn(0x7f17f80aa980 0x7f17f80acda0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.485+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f17f80a11b0 msgr2=0x7f17f80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.485+0000 7f1815197700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f17f80a11b0 0x7f17f80a3670 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1800009c60 tx=0x7f1800009260 comp rx=0 tx=0).stop 2024-05-08T20:03:49.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.485+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1810069bd0 msgr2=0x7f1810199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:49.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.485+0000 7f1815197700 1 --2- 172.21.15.33:0/1563148395 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1810069bd0 0x7f1810199c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f180400e9a0 tx=0x7f180400ecb0 comp rx=0 tx=0).stop 2024-05-08T20:03:49.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.485+0000 7f180f59e700 1 -- 172.21.15.33:0/1563148395 reap_dead start 2024-05-08T20:03:49.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.486+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 shutdown_connections 2024-05-08T20:03:49.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.486+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 >> 172.21.15.33:0/1563148395 conn(0x7f1810076e70 msgr2=0x7f181010c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:49.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.486+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 shutdown_connections 2024-05-08T20:03:49.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:49.486+0000 7f1815197700 1 -- 172.21.15.33:0/1563148395 wait complete. 2024-05-08T20:03:49.986 INFO:teuthology.orchestra.run.smithi033.stdout:322122547214 2024-05-08T20:03:49.987 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-08T20:03:50.239 INFO:teuthology.orchestra.run.smithi033.stdout:77309411374 2024-05-08T20:03:50.239 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-08T20:03:50.271 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:50 smithi033 ceph-mon[42490]: pgmap v231: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-05-08T20:03:50.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.376+0000 7f8b194e7700 1 -- 172.21.15.33:0/2404103263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14106fe0 msgr2=0x7f8b141073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.369 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.376+0000 7f8b194e7700 1 --2- 172.21.15.33:0/2404103263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14106fe0 0x7f8b141073c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8b040099c0 tx=0x7f8b04009cd0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.378+0000 7f8b194e7700 1 -- 172.21.15.33:0/2404103263 shutdown_connections 2024-05-08T20:03:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.378+0000 7f8b194e7700 1 --2- 172.21.15.33:0/2404103263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b14069bd0 0x7f8b1410de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.378+0000 7f8b194e7700 1 --2- 172.21.15.33:0/2404103263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14106fe0 0x7f8b141073c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.378+0000 7f8b194e7700 1 --2- 172.21.15.33:0/2404103263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b14069210 0x7f8b14069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.378+0000 7f8b194e7700 1 -- 172.21.15.33:0/2404103263 >> 172.21.15.33:0/2404103263 conn(0x7f8b14076e70 msgr2=0x7f8b14077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:50.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.379+0000 7f8b194e7700 1 -- 172.21.15.33:0/2404103263 shutdown_connections 2024-05-08T20:03:50.374 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.379+0000 7f8b194e7700 1 -- 172.21.15.33:0/2404103263 wait complete. 2024-05-08T20:03:50.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.379+0000 7f8b194e7700 1 Processor -- start 2024-05-08T20:03:50.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.380+0000 7f8b194e7700 1 -- start start 2024-05-08T20:03:50.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b194e7700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b14069210 0x7f8b1410dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b194e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14069bd0 0x7f8b1410ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b194e7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b14106fe0 0x7f8b1410b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b194e7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1410bac0 con 0x7f8b14069bd0 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b194e7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1410bc30 con 0x7f8b14106fe0 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b194e7700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b14071a60 con 0x7f8b14069210 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14069bd0 0x7f8b1410ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b14069210 0x7f8b1410dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b14069210 0x7f8b1410dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:46070/0 (socket says 172.21.15.33:46070) 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b127fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14069bd0 0x7f8b1410ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47970/0 (socket says 172.21.15.33:47970) 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 -- 172.21.15.33:0/2304663308 learned_addr learned my addr 172.21.15.33:0/2304663308 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 -- 172.21.15.33:0/2304663308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b14106fe0 msgr2=0x7f8b1410b2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b14106fe0 0x7f8b1410b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 -- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14069bd0 msgr2=0x7f8b1410ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b14069bd0 0x7f8b1410ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.381+0000 7f8b12ffd700 1 -- 172.21.15.33:0/2304663308 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b040095f0 con 0x7f8b14069210 2024-05-08T20:03:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.382+0000 7f8b12ffd700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b14069210 0x7f8b1410dc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400f690 tx=0x7f8b0400bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.382+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0401d070 con 0x7f8b14069210 2024-05-08T20:03:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.382+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8b04022470 con 0x7f8b14069210 2024-05-08T20:03:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.382+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04017650 con 0x7f8b14069210 2024-05-08T20:03:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.382+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b14071c80 con 0x7f8b14069210 2024-05-08T20:03:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.382+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b14072130 con 0x7f8b14069210 2024-05-08T20:03:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.383+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8b14102690 con 0x7f8b14069210 2024-05-08T20:03:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.384+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8b04022990 con 0x7f8b14069210 2024-05-08T20:03:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.387+0000 7f8afbfff700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8afc0a1230 0x7f8afc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.387+0000 7f8b127fc700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8afc0a1230 0x7f8afc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.388+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8b040cd830 con 0x7f8b14069210 2024-05-08T20:03:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.388+0000 7f8afbfff700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] conn(0x7f8afc0aaa10 0x7f8afc0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.388+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 --> [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8afc0ad4e0 con 0x7f8afc0aaa10 2024-05-08T20:03:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.388+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b040cdba0 con 0x7f8b14069210 2024-05-08T20:03:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.388+0000 7f8b127fc700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8afc0a1230 0x7f8afc0a36f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b1410c470 tx=0x7f8b08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.388+0000 7f8b137fe700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] conn(0x7f8afc0aaa10 0x7f8afc0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.388+0000 7f8b137fe700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] conn(0x7f8afc0aaa10 0x7f8afc0ace30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.390+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== osd.3 v2:172.21.15.33:6810/3020184499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f8afc0ad4e0 con 0x7f8afc0aaa10 2024-05-08T20:03:50.398 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:50.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.412+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 --> [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8b14101b70 con 0x7f8afc0aaa10 2024-05-08T20:03:50.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.413+0000 7f8afbfff700 1 -- 172.21.15.33:0/2304663308 <== osd.3 v2:172.21.15.33:6810/3020184499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8b14101b70 con 0x7f8afc0aaa10 2024-05-08T20:03:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.414+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] conn(0x7f8afc0aaa10 msgr2=0x7f8afc0ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.414+0000 7f8b194e7700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] conn(0x7f8afc0aaa10 0x7f8afc0ace30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.415+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8afc0a1230 msgr2=0x7f8afc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.415+0000 7f8b194e7700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8afc0a1230 0x7f8afc0a36f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b1410c470 tx=0x7f8b08009260 comp rx=0 tx=0).stop 2024-05-08T20:03:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.415+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b14069210 msgr2=0x7f8b1410dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.415+0000 7f8b194e7700 1 --2- 172.21.15.33:0/2304663308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b14069210 0x7f8b1410dc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400f690 tx=0x7f8b0400bfd0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.415+0000 7f8b137fe700 1 -- 172.21.15.33:0/2304663308 reap_dead start 2024-05-08T20:03:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.415+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 shutdown_connections 2024-05-08T20:03:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.415+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 >> 172.21.15.33:0/2304663308 conn(0x7f8b14076e70 msgr2=0x7f8b140febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.416+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 shutdown_connections 2024-05-08T20:03:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.416+0000 7f8b194e7700 1 -- 172.21.15.33:0/2304663308 wait complete. 2024-05-08T20:03:50.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 -- 172.21.15.33:0/3929228453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 msgr2=0x7f317410de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 --2- 172.21.15.33:0/3929228453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 0x7f317410de00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f316c00b0d0 tx=0x7f316c00b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 -- 172.21.15.33:0/3929228453 shutdown_connections 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 --2- 172.21.15.33:0/3929228453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 0x7f317410de00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 --2- 172.21.15.33:0/3929228453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174106fe0 0x7f31741073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 --2- 172.21.15.33:0/3929228453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174069210 0x7f3174069690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 -- 172.21.15.33:0/3929228453 >> 172.21.15.33:0/3929228453 conn(0x7f3174076e70 msgr2=0x7f3174077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 -- 172.21.15.33:0/3929228453 shutdown_connections 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.200+0000 7f317a298700 1 -- 172.21.15.33:0/3929228453 wait complete. 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 Processor -- start 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 -- start start 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174069210 0x7f31741974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 0x7f31741979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174106fe0 0x7f317419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317419c3b0 con 0x7f3174069bd0 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317419c520 con 0x7f3174106fe0 2024-05-08T20:03:50.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.201+0000 7f317a298700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317419c6e0 con 0x7f3174069210 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 0x7f31741979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 0x7f31741979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:47952/0 (socket says 172.21.15.33:47952) 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 -- 172.21.15.33:0/2018937444 learned_addr learned my addr 172.21.15.33:0/2018937444 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f3178835700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174106fe0 0x7f317419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f3173fff700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174069210 0x7f31741974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 -- 172.21.15.33:0/2018937444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174069210 msgr2=0x7f31741974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3174069210 0x7f31741974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 -- 172.21.15.33:0/2018937444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174106fe0 msgr2=0x7f317419bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3174106fe0 0x7f317419bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 -- 172.21.15.33:0/2018937444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c009d00 con 0x7f3174069bd0 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31737fe700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 0x7f31741979f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f316800e9a0 tx=0x7f316800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168009790 con 0x7f3174069bd0 2024-05-08T20:03:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317419c9c0 con 0x7f3174069bd0 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3168010430 con 0x7f3174069bd0 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3168018680 con 0x7f3174069bd0 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.202+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3174100060 con 0x7f3174069bd0 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.203+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31741112a0 con 0x7f3174069bd0 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.205+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3168010910 con 0x7f3174069bd0 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.206+0000 7f31717fa700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f315c0a11b0 0x7f315c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.206+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3168014070 con 0x7f3174069bd0 2024-05-08T20:03:50.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.206+0000 7f31717fa700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] conn(0x7f315c0aa990 0x7f315c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.206+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 --> [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f315c0ad460 con 0x7f315c0aa990 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.206+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31680cd560 con 0x7f3174069bd0 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.206+0000 7f3178835700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] conn(0x7f315c0aa990 0x7f315c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.207+0000 7f3178835700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] conn(0x7f315c0aa990 0x7f315c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.208+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== osd.6 v2:172.21.15.33:6818/469932513 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f315c0ad460 con 0x7f315c0aa990 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.208+0000 7f3173fff700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f315c0a11b0 0x7f315c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.208+0000 7f3173fff700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f315c0a11b0 0x7f315c0a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3164007be0 tx=0x7f31640073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.234+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 --> [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31740ff230 con 0x7f315c0aa990 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.234+0000 7f31717fa700 1 -- 172.21.15.33:0/2018937444 <== osd.6 v2:172.21.15.33:6818/469932513 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f31740ff230 con 0x7f315c0aa990 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] conn(0x7f315c0aa990 msgr2=0x7f315c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] conn(0x7f315c0aa990 0x7f315c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f315c0a11b0 msgr2=0x7f315c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f315c0a11b0 0x7f315c0a3670 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3164007be0 tx=0x7f31640073d0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 msgr2=0x7f31741979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 --2- 172.21.15.33:0/2018937444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3174069bd0 0x7f31741979f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f316800e9a0 tx=0x7f316800ecb0 comp rx=0 tx=0).stop 2024-05-08T20:03:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f3178835700 1 -- 172.21.15.33:0/2018937444 reap_dead start 2024-05-08T20:03:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 shutdown_connections 2024-05-08T20:03:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 >> 172.21.15.33:0/2018937444 conn(0x7f3174076e70 msgr2=0x7f31740fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 shutdown_connections 2024-05-08T20:03:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:50.235+0000 7f317a298700 1 -- 172.21.15.33:0/2018937444 wait complete. 2024-05-08T20:03:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:50.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:50 smithi082 ceph-mon[46774]: pgmap v231: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-05-08T20:03:50.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:50 smithi132 ceph-mon[47484]: pgmap v231: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-05-08T20:03:50.749 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:51.010 INFO:teuthology.orchestra.run.smithi033.stdout:103079215146 2024-05-08T20:03:51.011 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-08T20:03:51.058 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:51.059 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:51.763 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:52.313 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:52 smithi033 ceph-mon[42490]: pgmap v232: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:03:52.519 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:52.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:52 smithi082 ceph-mon[46774]: pgmap v232: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:03:52.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:52 smithi132 ceph-mon[47484]: pgmap v232: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:03:53.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.175+0000 7fe15e62e700 1 -- 172.21.15.33:0/2510242527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe158100aa0 msgr2=0x7fe158104ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.175+0000 7fe15e62e700 1 --2- 172.21.15.33:0/2510242527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe158100aa0 0x7fe158104ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009990 tx=0x7fe14c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.176+0000 7fe15e62e700 1 -- 172.21.15.33:0/2510242527 shutdown_connections 2024-05-08T20:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.176+0000 7fe15e62e700 1 --2- 172.21.15.33:0/2510242527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1581051b0 0x7fe15810cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.176+0000 7fe15e62e700 1 --2- 172.21.15.33:0/2510242527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe1581000f0 0x7fe1581004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.177+0000 7fe15e62e700 1 --2- 172.21.15.33:0/2510242527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe158100aa0 0x7fe158104ad0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.177+0000 7fe15e62e700 1 -- 172.21.15.33:0/2510242527 >> 172.21.15.33:0/2510242527 conn(0x7fe158076ea0 msgr2=0x7fe1580772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.177+0000 7fe15e62e700 1 -- 172.21.15.33:0/2510242527 shutdown_connections 2024-05-08T20:03:53.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.177+0000 7fe15e62e700 1 -- 172.21.15.33:0/2510242527 wait complete. 2024-05-08T20:03:53.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 Processor -- start 2024-05-08T20:03:53.167 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 -- start start 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1581000f0 0x7fe1581963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158100aa0 0x7fe158196930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1581051b0 0x7fe15819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15819b2a0 con 0x7fe1581000f0 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15819b410 con 0x7fe158100aa0 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe15e62e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15819b5d0 con 0x7fe1581051b0 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.178+0000 7fe157fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1581000f0 0x7fe1581963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1581000f0 0x7fe1581963f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58244/0 (socket says 172.21.15.33:58244) 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 -- 172.21.15.33:0/3963086969 learned_addr learned my addr 172.21.15.33:0/3963086969 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:53.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe15cbcb700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1581051b0 0x7fe15819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe1577fe700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158100aa0 0x7fe158196930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 -- 172.21.15.33:0/3963086969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1581051b0 msgr2=0x7fe15819ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.169 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1581051b0 0x7fe15819ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 -- 172.21.15.33:0/3963086969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158100aa0 msgr2=0x7fe158196930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe158100aa0 0x7fe158196930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 -- 172.21.15.33:0/3963086969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0095f0 con 0x7fe1581000f0 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe157fff700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1581000f0 0x7fe1581963f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e9a0 tx=0x7fe14800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148009790 con 0x7fe1581000f0 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15819b8b0 con 0x7fe1581000f0 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe148010430 con 0x7fe1581000f0 2024-05-08T20:03:53.170 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.179+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe148018680 con 0x7fe1581000f0 2024-05-08T20:03:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.180+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158069810 con 0x7fe1581000f0 2024-05-08T20:03:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.181+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe158110240 con 0x7fe1581000f0 2024-05-08T20:03:53.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.182+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fe148010910 con 0x7fe1581000f0 2024-05-08T20:03:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.183+0000 7fe1557fa700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe1400a11b0 0x7fe1400a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.183+0000 7fe1577fe700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe1400a11b0 0x7fe1400a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.183+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe148014070 con 0x7fe1581000f0 2024-05-08T20:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.183+0000 7fe1557fa700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] conn(0x7fe1400aa990 0x7fe1400acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.183+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 --> [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe1400ad460 con 0x7fe1400aa990 2024-05-08T20:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.183+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1480ccf20 con 0x7fe1581000f0 2024-05-08T20:03:53.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.184+0000 7fe15cbcb700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] conn(0x7fe1400aa990 0x7fe1400acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.184+0000 7fe1577fe700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe1400a11b0 0x7fe1400a3670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe158197900 tx=0x7fe14c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.184+0000 7fe15cbcb700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] conn(0x7fe1400aa990 0x7fe1400acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.185+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== osd.0 v2:172.21.15.33:6802/2726923319 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe1400ad460 con 0x7fe1400aa990 2024-05-08T20:03:53.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.206+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 --> [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe1581015b0 con 0x7fe1400aa990 2024-05-08T20:03:53.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.206+0000 7fe1557fa700 1 -- 172.21.15.33:0/3963086969 <== osd.0 v2:172.21.15.33:6802/2726923319 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe1581015b0 con 0x7fe1400aa990 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] conn(0x7fe1400aa990 msgr2=0x7fe1400acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] conn(0x7fe1400aa990 0x7fe1400acdb0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe1400a11b0 msgr2=0x7fe1400a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fe1400a11b0 0x7fe1400a3670 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe158197900 tx=0x7fe14c00b260 comp rx=0 tx=0).stop 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1581000f0 msgr2=0x7fe1581963f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 --2- 172.21.15.33:0/3963086969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1581000f0 0x7fe1581963f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe14800e9a0 tx=0x7fe14800ecb0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15cbcb700 1 -- 172.21.15.33:0/3963086969 reap_dead start 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 shutdown_connections 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 >> 172.21.15.33:0/3963086969 conn(0x7fe158076ea0 msgr2=0x7fe158103e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 shutdown_connections 2024-05-08T20:03:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.207+0000 7fe15e62e700 1 -- 172.21.15.33:0/3963086969 wait complete. 2024-05-08T20:03:53.479 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 -- 172.21.15.33:0/144971361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc104650 msgr2=0x7f18bc104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 --2- 172.21.15.33:0/144971361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc104650 0x7f18bc104a30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f18b8009990 tx=0x7f18b8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 -- 172.21.15.33:0/144971361 shutdown_connections 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 --2- 172.21.15.33:0/144971361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18bc100300 0x7f18bc10c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 --2- 172.21.15.33:0/144971361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc104650 0x7f18bc104a30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 --2- 172.21.15.33:0/144971361 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18bc0ff940 0x7f18bc0ffdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 -- 172.21.15.33:0/144971361 >> 172.21.15.33:0/144971361 conn(0x7f18bc075260 msgr2=0x7f18bc075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 -- 172.21.15.33:0/144971361 shutdown_connections 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.224+0000 7f18c3ee5700 1 -- 172.21.15.33:0/144971361 wait complete. 2024-05-08T20:03:53.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 Processor -- start 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 -- start start 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc0ff940 0x7f18bc1962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18bc100300 0x7f18bc196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18bc104650 0x7f18bc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc19b1f0 con 0x7f18bc0ff940 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc19b360 con 0x7f18bc104650 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c3ee5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc19b520 con 0x7f18bc100300 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc0ff940 0x7f18bc1962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc0ff940 0x7f18bc1962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58258/0 (socket says 172.21.15.33:58258) 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 -- 172.21.15.33:0/246076472 learned_addr learned my addr 172.21.15.33:0/246076472 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1480700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18bc100300 0x7f18bc196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c2482700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18bc104650 0x7f18bc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 -- 172.21.15.33:0/246076472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18bc100300 msgr2=0x7f18bc196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18bc100300 0x7f18bc196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 -- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18bc104650 msgr2=0x7f18bc19abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18bc104650 0x7f18bc19abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.225+0000 7f18c1c81700 1 -- 172.21.15.33:0/246076472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80095f0 con 0x7f18bc0ff940 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.226+0000 7f18c1c81700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc0ff940 0x7f18bc1962f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f18b80098e0 tx=0x7f18b800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.226+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b801d070 con 0x7f18bc0ff940 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.226+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f18b80036f0 con 0x7f18bc0ff940 2024-05-08T20:03:53.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.226+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc19b7a0 con 0x7f18bc0ff940 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.226+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8005590 con 0x7f18bc0ff940 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.226+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc1a2e90 con 0x7f18bc0ff940 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.227+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18bc100d60 con 0x7f18bc0ff940 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.228+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f18b80038d0 con 0x7f18bc0ff940 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18b2ffd700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f18a80a11b0 0x7f18a80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18c1480700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f18a80a11b0 0x7f18a80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f18b80cd9c0 con 0x7f18bc0ff940 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18b2ffd700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] conn(0x7f18a80aa990 0x7f18a80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 --> [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f18a80ad460 con 0x7f18a80aa990 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18b80cdd30 con 0x7f18bc0ff940 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18c1480700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f18a80a11b0 0x7f18a80a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18bc197850 tx=0x7f18ac00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.229+0000 7f18c2482700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] conn(0x7f18a80aa990 0x7f18a80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.230+0000 7f18c2482700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] conn(0x7f18a80aa990 0x7f18a80acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.231+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== osd.4 v2:172.21.15.82:6808/2673475836 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f18a80ad460 con 0x7f18a80aa990 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.250+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 --> [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18bc110130 con 0x7f18a80aa990 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.250+0000 7f18b2ffd700 1 -- 172.21.15.33:0/246076472 <== osd.4 v2:172.21.15.82:6808/2673475836 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f18bc110130 con 0x7f18a80aa990 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] conn(0x7f18a80aa990 msgr2=0x7f18a80acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] conn(0x7f18a80aa990 0x7f18a80acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f18a80a11b0 msgr2=0x7f18a80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f18a80a11b0 0x7f18a80a3670 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f18bc197850 tx=0x7f18ac00b410 comp rx=0 tx=0).stop 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc0ff940 msgr2=0x7f18bc1962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 --2- 172.21.15.33:0/246076472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18bc0ff940 0x7f18bc1962f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f18b80098e0 tx=0x7f18b800f690 comp rx=0 tx=0).stop 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c2482700 1 -- 172.21.15.33:0/246076472 reap_dead start 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 shutdown_connections 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 >> 172.21.15.33:0/246076472 conn(0x7f18bc075260 msgr2=0x7f18bc0fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:53.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 shutdown_connections 2024-05-08T20:03:53.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.251+0000 7f18c3ee5700 1 -- 172.21.15.33:0/246076472 wait complete. 2024-05-08T20:03:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.810+0000 7f337a83b700 1 -- 172.21.15.33:0/2365728129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741012f0 msgr2=0x7f337410d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.810+0000 7f337a83b700 1 --2- 172.21.15.33:0/2365728129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741012f0 0x7f337410d540 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f33680099c0 tx=0x7f3368009cd0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.800 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 -- 172.21.15.33:0/2365728129 shutdown_connections 2024-05-08T20:03:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 --2- 172.21.15.33:0/2365728129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f337410da80 0x7f337410fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 --2- 172.21.15.33:0/2365728129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33741009d0 0x7f3374100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 --2- 172.21.15.33:0/2365728129 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741012f0 0x7f337410d540 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 -- 172.21.15.33:0/2365728129 >> 172.21.15.33:0/2365728129 conn(0x7f3374075f80 msgr2=0x7f3374076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 -- 172.21.15.33:0/2365728129 shutdown_connections 2024-05-08T20:03:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 -- 172.21.15.33:0/2365728129 wait complete. 2024-05-08T20:03:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 Processor -- start 2024-05-08T20:03:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.811+0000 7f337a83b700 1 -- start start 2024-05-08T20:03:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f337a83b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741009d0 0x7f33741996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.803 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f337a83b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33741012f0 0x7f3374199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f337a83b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337410da80 0x7f337419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f337a83b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337419e5a0 con 0x7f33741009d0 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f337a83b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337419e710 con 0x7f33741012f0 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f337a83b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337419e8d0 con 0x7f337410da80 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741009d0 0x7f33741996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741009d0 0x7f33741996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58276/0 (socket says 172.21.15.33:58276) 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 -- 172.21.15.33:0/1347948612 learned_addr learned my addr 172.21.15.33:0/1347948612 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3378dd8700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337410da80 0x7f337419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f33737fe700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33741012f0 0x7f3374199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 -- 172.21.15.33:0/1347948612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337410da80 msgr2=0x7f337419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337410da80 0x7f337419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 -- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33741012f0 msgr2=0x7f3374199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33741012f0 0x7f3374199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.812+0000 7f3373fff700 1 -- 172.21.15.33:0/1347948612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33680095f0 con 0x7f33741009d0 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.813+0000 7f3373fff700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741009d0 0x7f33741996a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f336400e9a0 tx=0x7f336400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.813+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364009790 con 0x7f33741009d0 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.813+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337419ebb0 con 0x7f33741009d0 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.813+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3364010430 con 0x7f33741009d0 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.813+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3364018680 con 0x7f33741009d0 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.813+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33741a6410 con 0x7f33741009d0 2024-05-08T20:03:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.814+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f33741134d0 con 0x7f33741009d0 2024-05-08T20:03:53.806 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.815+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3364010910 con 0x7f33741009d0 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.816+0000 7f33717fa700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f335c0a11b0 0x7f335c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.816+0000 7f33737fe700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f335c0a11b0 0x7f335c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.816+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3364014070 con 0x7f33741009d0 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.816+0000 7f33717fa700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] conn(0x7f335c0aa990 0x7f335c0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.816+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 --> [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f335c0ad460 con 0x7f335c0aa990 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.816+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33640cd580 con 0x7f33741009d0 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.817+0000 7f33737fe700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f335c0a11b0 0x7f335c0a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3368000c00 tx=0x7f3368005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.817+0000 7f3378dd8700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] conn(0x7f335c0aa990 0x7f335c0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:53.807 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.817+0000 7f3378dd8700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] conn(0x7f335c0aa990 0x7f335c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:53.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.818+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== osd.1 v2:172.21.15.82:6800/2641494895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f335c0ad460 con 0x7f335c0aa990 2024-05-08T20:03:53.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.835+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 --> [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33741004e0 con 0x7f335c0aa990 2024-05-08T20:03:53.825 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f33717fa700 1 -- 172.21.15.33:0/1347948612 <== osd.1 v2:172.21.15.82:6800/2641494895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f33741004e0 con 0x7f335c0aa990 2024-05-08T20:03:53.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] conn(0x7f335c0aa990 msgr2=0x7f335c0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.826 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f337a83b700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] conn(0x7f335c0aa990 0x7f335c0acdb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f335c0a11b0 msgr2=0x7f335c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f337a83b700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f335c0a11b0 0x7f335c0a3670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3368000c00 tx=0x7f3368005fb0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741009d0 msgr2=0x7f33741996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f337a83b700 1 --2- 172.21.15.33:0/1347948612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33741009d0 0x7f33741996a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f336400e9a0 tx=0x7f336400ecb0 comp rx=0 tx=0).stop 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.836+0000 7f3378dd8700 1 -- 172.21.15.33:0/1347948612 reap_dead start 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.837+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 shutdown_connections 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.837+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 >> 172.21.15.33:0/1347948612 conn(0x7f3374075f80 msgr2=0x7f337410f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.837+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 shutdown_connections 2024-05-08T20:03:53.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.837+0000 7f337a83b700 1 -- 172.21.15.33:0/1347948612 wait complete. 2024-05-08T20:03:54.110 INFO:teuthology.orchestra.run.smithi033.stdout:184683593760 2024-05-08T20:03:54.110 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-08T20:03:54.314 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 -- 172.21.15.33:0/3995841134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc107100 msgr2=0x7ff5fc1074e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 --2- 172.21.15.33:0/3995841134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc107100 0x7ff5fc1074e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009990 tx=0x7ff5f8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 -- 172.21.15.33:0/3995841134 shutdown_connections 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 --2- 172.21.15.33:0/3995841134 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5fc06a020 0x7ff5fc10de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 --2- 172.21.15.33:0/3995841134 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc107100 0x7ff5fc1074e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 --2- 172.21.15.33:0/3995841134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5fc069660 0x7ff5fc069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 -- 172.21.15.33:0/3995841134 >> 172.21.15.33:0/3995841134 conn(0x7ff5fc075f80 msgr2=0x7ff5fc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 -- 172.21.15.33:0/3995841134 shutdown_connections 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.870+0000 7ff6043e1700 1 -- 172.21.15.33:0/3995841134 wait complete. 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 Processor -- start 2024-05-08T20:03:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 -- start start 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc069660 0x7ff5fc197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5fc06a020 0x7ff5fc197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5fc107100 0x7ff5fc19bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc19c350 con 0x7ff5fc069660 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc19c4c0 con 0x7ff5fc06a020 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.871+0000 7ff6043e1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc19c680 con 0x7ff5fc107100 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc069660 0x7ff5fc197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc069660 0x7ff5fc197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58286/0 (socket says 172.21.15.33:58286) 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 -- 172.21.15.33:0/1017511368 learned_addr learned my addr 172.21.15.33:0/1017511368 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60297e700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5fc107100 0x7ff5fc19bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60197c700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5fc06a020 0x7ff5fc197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 -- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5fc107100 msgr2=0x7ff5fc19bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5fc107100 0x7ff5fc19bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 -- 172.21.15.33:0/1017511368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5fc06a020 msgr2=0x7ff5fc197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff5fc06a020 0x7ff5fc197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 -- 172.21.15.33:0/1017511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4009c40 con 0x7ff5fc069660 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff60217d700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc069660 0x7ff5fc197450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8005910 tx=0x7ff5f8005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f801d070 con 0x7ff5fc069660 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff5f800fe10 con 0x7ff5fc069660 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80173f0 con 0x7ff5fc069660 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.872+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f80095f0 con 0x7ff5fc069660 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.873+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc1a3ff0 con 0x7ff5fc069660 2024-05-08T20:03:54.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.874+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5fc1026e0 con 0x7ff5fc069660 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.875+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff5f800f930 con 0x7ff5fc069660 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.876+0000 7ff5f37fe700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff5e80a11b0 0x7ff5e80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.876+0000 7ff60197c700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff5e80a11b0 0x7ff5e80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.876+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff5f80ce560 con 0x7ff5fc069660 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.876+0000 7ff5f37fe700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] conn(0x7ff5e80aa990 0x7ff5e80acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.876+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 --> [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5e80ad460 con 0x7ff5e80aa990 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.876+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5f80cea00 con 0x7ff5fc069660 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.876+0000 7ff60197c700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff5e80a11b0 0x7ff5e80a3670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc1989b0 tx=0x7ff5ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.877+0000 7ff60297e700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] conn(0x7ff5e80aa990 0x7ff5e80acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.877+0000 7ff60297e700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] conn(0x7ff5e80aa990 0x7ff5e80acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.878+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== osd.8 v2:172.21.15.132:6816/909790708 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff5e80ad460 con 0x7ff5e80aa990 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.895+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 --> [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff5fc111280 con 0x7ff5e80aa990 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff5f37fe700 1 -- 172.21.15.33:0/1017511368 <== osd.8 v2:172.21.15.132:6816/909790708 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff5fc111280 con 0x7ff5e80aa990 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] conn(0x7ff5e80aa990 msgr2=0x7ff5e80acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] conn(0x7ff5e80aa990 0x7ff5e80acdb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff5e80a11b0 msgr2=0x7ff5e80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff5e80a11b0 0x7ff5e80a3670 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc1989b0 tx=0x7ff5ec009260 comp rx=0 tx=0).stop 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc069660 msgr2=0x7ff5fc197450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 --2- 172.21.15.33:0/1017511368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff5fc069660 0x7ff5fc197450 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8005910 tx=0x7ff5f8005ef0 comp rx=0 tx=0).stop 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff60297e700 1 -- 172.21.15.33:0/1017511368 reap_dead start 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 shutdown_connections 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 >> 172.21.15.33:0/1017511368 conn(0x7ff5fc075f80 msgr2=0x7ff5fc0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 shutdown_connections 2024-05-08T20:03:54.320 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:53.896+0000 7ff6043e1700 1 -- 172.21.15.33:0/1017511368 wait complete. 2024-05-08T20:03:54.420 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:54.437 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:54 smithi033 ceph-mon[42490]: pgmap v233: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T20:03:54.492 INFO:teuthology.orchestra.run.smithi033.stdout:34359738422 2024-05-08T20:03:54.492 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-08T20:03:54.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:54 smithi082 ceph-mon[46774]: pgmap v233: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T20:03:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:54 smithi132 ceph-mon[47484]: pgmap v233: 97 pgs: 97 active+clean; 633 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T20:03:54.761 INFO:teuthology.orchestra.run.smithi033.stdout:55834574898 2024-05-08T20:03:54.762 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2545240031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc1063c0 msgr2=0x7fd9bc10dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 --2- 172.21.15.33:0/2545240031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc1063c0 0x7fd9bc10dee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400b0d0 tx=0x7fd9b400b3e0 comp rx=0 tx=0).stop 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2545240031 shutdown_connections 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 --2- 172.21.15.33:0/2545240031 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc1063c0 0x7fd9bc10dee0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 --2- 172.21.15.33:0/2545240031 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9bc0ffba0 0x7fd9bc0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 --2- 172.21.15.33:0/2545240031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc100550 0x7fd9bc105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2545240031 >> 172.21.15.33:0/2545240031 conn(0x7fd9bc075260 msgr2=0x7fd9bc075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2545240031 shutdown_connections 2024-05-08T20:03:55.003 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.013+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2545240031 wait complete. 2024-05-08T20:03:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 Processor -- start 2024-05-08T20:03:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 -- start start 2024-05-08T20:03:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc0ffba0 0x7fd9bc100b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9bc100550 0x7fd9bc101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc1063c0 0x7fd9bc1015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:55.005 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1a5890 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1a5a00 con 0x7fd9bc100550 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c2f08700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9bc1a5bc0 con 0x7fd9bc1063c0 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c0ca4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc0ffba0 0x7fd9bc100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c0ca4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc0ffba0 0x7fd9bc100b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58300/0 (socket says 172.21.15.33:58300) 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c0ca4700 1 -- 172.21.15.33:0/2477808364 learned_addr learned my addr 172.21.15.33:0/2477808364 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.014+0000 7fd9c14a5700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc1063c0 0x7fd9bc1015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9bbfff700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9bc100550 0x7fd9bc101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c0ca4700 1 -- 172.21.15.33:0/2477808364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc1063c0 msgr2=0x7fd9bc1015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c0ca4700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc1063c0 0x7fd9bc1015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c0ca4700 1 -- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9bc100550 msgr2=0x7fd9bc101060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c0ca4700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9bc100550 0x7fd9bc101060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c0ca4700 1 -- 172.21.15.33:0/2477808364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4009d00 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c14a5700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9bc1063c0 0x7fd9bc1015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:03:55.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c0ca4700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc0ffba0 0x7fd9bc100b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000d980 tx=0x7fd9b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:55.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0004220 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd9b0007640 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b000f690 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.015+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9bc1a5ea0 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.016+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9bc1a6260 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.016+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9bc0683c0 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.018+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd9b0004410 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.018+0000 7fd9b9ffb700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd9ac0a11b0 0x7fd9ac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.018+0000 7fd9bbfff700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd9ac0a11b0 0x7fd9ac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.018+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd9b00ccd50 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.019+0000 7fd9b9ffb700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] conn(0x7fd9ac0aa990 0x7fd9ac0acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.019+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 --> [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9ac0ad460 con 0x7fd9ac0aa990 2024-05-08T20:03:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.019+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9b00cd1f0 con 0x7fd9bc0ffba0 2024-05-08T20:03:55.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.019+0000 7fd9bbfff700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd9ac0a11b0 0x7fd9ac0a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc102250 tx=0x7fd9a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:55.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.019+0000 7fd9c14a5700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] conn(0x7fd9ac0aa990 0x7fd9ac0acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:55.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.019+0000 7fd9c14a5700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] conn(0x7fd9ac0aa990 0x7fd9ac0acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:55.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.020+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== osd.10 v2:172.21.15.82:6824/3525934345 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd9ac0ad460 con 0x7fd9ac0aa990 2024-05-08T20:03:55.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.037+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 --> [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9bc111260 con 0x7fd9ac0aa990 2024-05-08T20:03:55.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.037+0000 7fd9b9ffb700 1 -- 172.21.15.33:0/2477808364 <== osd.10 v2:172.21.15.82:6824/3525934345 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd9bc111260 con 0x7fd9ac0aa990 2024-05-08T20:03:55.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] conn(0x7fd9ac0aa990 msgr2=0x7fd9ac0acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:55.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] conn(0x7fd9ac0aa990 0x7fd9ac0acdb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:55.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd9ac0a11b0 msgr2=0x7fd9ac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:55.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd9ac0a11b0 0x7fd9ac0a3670 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc102250 tx=0x7fd9a8009260 comp rx=0 tx=0).stop 2024-05-08T20:03:55.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc0ffba0 msgr2=0x7fd9bc100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:55.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 --2- 172.21.15.33:0/2477808364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9bc0ffba0 0x7fd9bc100b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd9b000d980 tx=0x7fd9b000dc90 comp rx=0 tx=0).stop 2024-05-08T20:03:55.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c14a5700 1 -- 172.21.15.33:0/2477808364 reap_dead start 2024-05-08T20:03:55.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 shutdown_connections 2024-05-08T20:03:55.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 >> 172.21.15.33:0/2477808364 conn(0x7fd9bc075260 msgr2=0x7fd9bc0fe9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:55.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 shutdown_connections 2024-05-08T20:03:55.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:55.038+0000 7fd9c2f08700 1 -- 172.21.15.33:0/2477808364 wait complete. 2024-05-08T20:03:55.129 INFO:teuthology.orchestra.run.smithi033.stdout:133143986215 2024-05-08T20:03:55.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-08T20:03:55.444 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:55.848 INFO:teuthology.orchestra.run.smithi033.stdout:236223201305 2024-05-08T20:03:55.848 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-08T20:03:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:56.211 INFO:teuthology.orchestra.run.smithi033.stdout:287762808850 2024-05-08T20:03:56.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-08T20:03:56.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:56 smithi033 ceph-mon[42490]: pgmap v234: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-08T20:03:56.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:56 smithi082 ceph-mon[46774]: pgmap v234: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-08T20:03:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:56 smithi132 ceph-mon[47484]: pgmap v234: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-05-08T20:03:57.197 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.921+0000 7f4bdd94c700 1 -- 172.21.15.33:0/568463889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd80691e0 msgr2=0x7f4bd80695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.921+0000 7f4bdd94c700 1 --2- 172.21.15.33:0/568463889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd80691e0 0x7f4bd80695c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009990 tx=0x7f4bc8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.923+0000 7f4bdd94c700 1 -- 172.21.15.33:0/568463889 shutdown_connections 2024-05-08T20:03:57.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.923+0000 7f4bdd94c700 1 --2- 172.21.15.33:0/568463889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd810da40 0x7f4bd810fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.923+0000 7f4bdd94c700 1 --2- 172.21.15.33:0/568463889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd80691e0 0x7f4bd80695c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.923+0000 7f4bdd94c700 1 --2- 172.21.15.33:0/568463889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bd8069b00 0x7f4bd810d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.198 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.923+0000 7f4bdd94c700 1 -- 172.21.15.33:0/568463889 >> 172.21.15.33:0/568463889 conn(0x7f4bd8076e70 msgr2=0x7f4bd8077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.923+0000 7f4bdd94c700 1 -- 172.21.15.33:0/568463889 shutdown_connections 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.923+0000 7f4bdd94c700 1 -- 172.21.15.33:0/568463889 wait complete. 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 Processor -- start 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 -- start start 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80691e0 0x7f4bd8199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bd8069b00 0x7f4bd8199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd810da40 0x7f4bd819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd819e620 con 0x7f4bd810da40 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd819e790 con 0x7f4bd80691e0 2024-05-08T20:03:57.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.924+0000 7f4bdd94c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd819e950 con 0x7f4bd8069b00 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80691e0 0x7f4bd8199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80691e0 0x7f4bd8199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:39436/0 (socket says 172.21.15.33:39436) 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 -- 172.21.15.33:0/389161452 learned_addr learned my addr 172.21.15.33:0/389161452 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd67fc700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bd8069b00 0x7f4bd8199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd77fe700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd810da40 0x7f4bd819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 -- 172.21.15.33:0/389161452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bd8069b00 msgr2=0x7f4bd8199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bd8069b00 0x7f4bd8199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 -- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd810da40 msgr2=0x7f4bd819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bd810da40 0x7f4bd819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 -- 172.21.15.33:0/389161452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd0009c40 con 0x7f4bd80691e0 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.925+0000 7f4bd6ffd700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80691e0 0x7f4bd8199770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8005910 tx=0x7f4bc8005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:57.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.926+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc801d070 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.926+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4bc800fe10 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.926+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc80095f0 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.926+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd81a62c0 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.927+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4bd8113520 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.927+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80173f0 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.929+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f4bc800f930 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.929+0000 7f4bdc94a700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f4bc00a1230 0x7f4bc00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.930+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4bc80ce930 con 0x7f4bd80691e0 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.930+0000 7f4bdc94a700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] conn(0x7f4bc00aaa10 0x7f4bc00ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.930+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 --> [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4bc00ad4e0 con 0x7f4bc00aaa10 2024-05-08T20:03:57.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.930+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4bc80ceca0 con 0x7f4bd80691e0 2024-05-08T20:03:57.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.930+0000 7f4bd67fc700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f4bc00a1230 0x7f4bc00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.930+0000 7f4bd77fe700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] conn(0x7f4bc00aaa10 0x7f4bc00ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.931+0000 7f4bd77fe700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] conn(0x7f4bc00aaa10 0x7f4bc00ace30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:57.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.931+0000 7f4bd67fc700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f4bc00a1230 0x7f4bc00a36f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4bd819ac80 tx=0x7f4bcc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:57.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.931+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== osd.7 v2:172.21.15.82:6816/3754120069 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f4bc00ad4e0 con 0x7f4bc00aaa10 2024-05-08T20:03:57.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.949+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 --> [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4bd8100470 con 0x7f4bc00aaa10 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdc94a700 1 -- 172.21.15.33:0/389161452 <== osd.7 v2:172.21.15.82:6816/3754120069 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4bd8100470 con 0x7f4bc00aaa10 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] conn(0x7f4bc00aaa10 msgr2=0x7f4bc00ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] conn(0x7f4bc00aaa10 0x7f4bc00ace30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f4bc00a1230 msgr2=0x7f4bc00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f4bc00a1230 0x7f4bc00a36f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4bd819ac80 tx=0x7f4bcc009260 comp rx=0 tx=0).stop 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80691e0 msgr2=0x7f4bd8199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 --2- 172.21.15.33:0/389161452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4bd80691e0 0x7f4bd8199770 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8005910 tx=0x7f4bc8005ef0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bd77fe700 1 -- 172.21.15.33:0/389161452 reap_dead start 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 shutdown_connections 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.950+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 >> 172.21.15.33:0/389161452 conn(0x7f4bd8076e70 msgr2=0x7f4bd810f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.951+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 shutdown_connections 2024-05-08T20:03:57.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:56.951+0000 7f4bdd94c700 1 -- 172.21.15.33:0/389161452 wait complete. 2024-05-08T20:03:57.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.555+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/2492526740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0107020 msgr2=0x7f0fa0107400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.555+0000 7f0fa7cf5700 1 --2- 172.21.15.33:0/2492526740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0107020 0x7f0fa0107400 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009990 tx=0x7f0f9c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.555+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/2492526740 shutdown_connections 2024-05-08T20:03:57.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.555+0000 7f0fa7cf5700 1 --2- 172.21.15.33:0/2492526740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa00692f0 0x7f0fa010de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.555+0000 7f0fa7cf5700 1 --2- 172.21.15.33:0/2492526740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0107020 0x7f0fa0107400 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.555+0000 7f0fa7cf5700 1 --2- 172.21.15.33:0/2492526740 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fa0068950 0x7f0fa0068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.555+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/2492526740 >> 172.21.15.33:0/2492526740 conn(0x7f0fa0075f80 msgr2=0x7f0fa0076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.556+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/2492526740 shutdown_connections 2024-05-08T20:03:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.556+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/2492526740 wait complete. 2024-05-08T20:03:57.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.556+0000 7f0fa7cf5700 1 Processor -- start 2024-05-08T20:03:57.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.556+0000 7f0fa7cf5700 1 -- start start 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.556+0000 7f0fa7cf5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0068950 0x7f0fa0197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.556+0000 7f0fa7cf5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fa00692f0 0x7f0fa0197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa7cf5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0107020 0x7f0fa019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa7cf5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa019c410 con 0x7f0fa0068950 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa7cf5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa019c580 con 0x7f0fa00692f0 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa7cf5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa019c740 con 0x7f0fa0107020 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0068950 0x7f0fa0197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0068950 0x7f0fa0197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58344/0 (socket says 172.21.15.33:58344) 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 -- 172.21.15.33:0/3081670242 learned_addr learned my addr 172.21.15.33:0/3081670242 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5290700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fa00692f0 0x7f0fa0197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa6292700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0107020 0x7f0fa019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 -- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0107020 msgr2=0x7f0fa019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0107020 0x7f0fa019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 -- 172.21.15.33:0/3081670242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fa00692f0 msgr2=0x7f0fa0197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0fa00692f0 0x7f0fa0197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 -- 172.21.15.33:0/3081670242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0095f0 con 0x7f0fa0068950 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa5a91700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0068950 0x7f0fa0197580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c005910 tx=0x7f0f9c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c01d070 con 0x7f0fa0068950 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0f9c003680 con 0x7f0fa0068950 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa019c9c0 con 0x7f0fa0068950 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.557+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0173f0 con 0x7f0fa0068950 2024-05-08T20:03:57.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.558+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa01a4280 con 0x7f0fa0068950 2024-05-08T20:03:57.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.558+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fa01112f0 con 0x7f0fa0068950 2024-05-08T20:03:57.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.560+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0f9c00fad0 con 0x7f0fa0068950 2024-05-08T20:03:57.550 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.560+0000 7f0f96ffd700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0f8c0a1230 0x7f0f8c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0fa5290700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0f8c0a1230 0x7f0f8c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0f9c0cddc0 con 0x7f0fa0068950 2024-05-08T20:03:57.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0f96ffd700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] conn(0x7f0f8c0aaa10 0x7f0f8c0ace30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:57.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 --> [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f8c0ad4e0 con 0x7f0f8c0aaa10 2024-05-08T20:03:57.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f9c0ce130 con 0x7f0fa0068950 2024-05-08T20:03:57.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0fa5290700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0f8c0a1230 0x7f0f8c0a36f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00766a0 tx=0x7f0f900073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:57.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0fa6292700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] conn(0x7f0f8c0aaa10 0x7f0f8c0ace30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:57.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.561+0000 7f0fa6292700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] conn(0x7f0f8c0aaa10 0x7f0f8c0ace30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:57.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.562+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== osd.5 v2:172.21.15.132:6808/2308536934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f0f8c0ad4e0 con 0x7f0f8c0aaa10 2024-05-08T20:03:57.568 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.579+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 --> [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fa0061620 con 0x7f0f8c0aaa10 2024-05-08T20:03:57.569 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0f96ffd700 1 -- 172.21.15.33:0/3081670242 <== osd.5 v2:172.21.15.132:6808/2308536934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0fa0061620 con 0x7f0f8c0aaa10 2024-05-08T20:03:57.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] conn(0x7f0f8c0aaa10 msgr2=0x7f0f8c0ace30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] conn(0x7f0f8c0aaa10 0x7f0f8c0ace30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0f8c0a1230 msgr2=0x7f0f8c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0f8c0a1230 0x7f0f8c0a36f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00766a0 tx=0x7f0f900073d0 comp rx=0 tx=0).stop 2024-05-08T20:03:57.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0068950 msgr2=0x7f0fa0197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:57.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 --2- 172.21.15.33:0/3081670242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0fa0068950 0x7f0fa0197580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c005910 tx=0x7f0f9c00f690 comp rx=0 tx=0).stop 2024-05-08T20:03:57.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa6292700 1 -- 172.21.15.33:0/3081670242 reap_dead start 2024-05-08T20:03:57.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 shutdown_connections 2024-05-08T20:03:57.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 >> 172.21.15.33:0/3081670242 conn(0x7f0fa0075f80 msgr2=0x7f0fa00feda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:57.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 shutdown_connections 2024-05-08T20:03:57.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:57.580+0000 7f0fa7cf5700 1 -- 172.21.15.33:0/3081670242 wait complete. 2024-05-08T20:03:57.920 INFO:teuthology.orchestra.run.smithi033.stdout:206158430237 2024-05-08T20:03:57.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 -- 172.21.15.33:0/3158606640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0068bb0 msgr2=0x7f5ad0068f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/3158606640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0068bb0 0x7f5ad0068f90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009990 tx=0x7f5ac0009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 -- 172.21.15.33:0/3158606640 shutdown_connections 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/3158606640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ad0106340 0x7f5ad010dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/3158606640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0068bb0 0x7f5ad0068f90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/3158606640 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ad0069560 0x7f5ad0105c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 -- 172.21.15.33:0/3158606640 >> 172.21.15.33:0/3158606640 conn(0x7f5ad0075f80 msgr2=0x7f5ad0076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 -- 172.21.15.33:0/3158606640 shutdown_connections 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.463+0000 7f5ad55dc700 1 -- 172.21.15.33:0/3158606640 wait complete. 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 Processor -- start 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 -- start start 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ad0068bb0 0x7f5ad01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ad0069560 0x7f5ad0199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0106340 0x7f5ad019dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad019e5b0 con 0x7f5ad0106340 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad019e720 con 0x7f5ad0069560 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ad55dc700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad019e8e0 con 0x7f5ad0068bb0 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0106340 0x7f5ad019dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5acf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0106340 0x7f5ad019dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58360/0 (socket says 172.21.15.33:58360) 2024-05-08T20:03:58.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5acf7fe700 1 -- 172.21.15.33:0/1846253431 learned_addr learned my addr 172.21.15.33:0/1846253431 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5aceffd700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ad0068bb0 0x7f5ad01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.464+0000 7f5ac67fc700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ad0069560 0x7f5ad0199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5acf7fe700 1 -- 172.21.15.33:0/1846253431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ad0068bb0 msgr2=0x7f5ad01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5acf7fe700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ad0068bb0 0x7f5ad01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5acf7fe700 1 -- 172.21.15.33:0/1846253431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ad0069560 msgr2=0x7f5ad0199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5acf7fe700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ad0069560 0x7f5ad0199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5acf7fe700 1 -- 172.21.15.33:0/1846253431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac00095f0 con 0x7f5ad0106340 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5acf7fe700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0106340 0x7f5ad019dfa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ef30 tx=0x7f5ac800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5accff9700 1 -- 172.21.15.33:0/1846253431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8004bb0 con 0x7f5ad0106340 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5accff9700 1 -- 172.21.15.33:0/1846253431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5ac800f040 con 0x7f5ad0106340 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5accff9700 1 -- 172.21.15.33:0/1846253431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800cac0 con 0x7f5ad0106340 2024-05-08T20:03:58.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad019ebc0 con 0x7f5ad0106340 2024-05-08T20:03:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.465+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad0107f60 con 0x7f5ad0106340 2024-05-08T20:03:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.467+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad019ede0 con 0x7f5ad0106340 2024-05-08T20:03:58.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.469+0000 7f5accff9700 1 -- 172.21.15.33:0/1846253431 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5ac800cc40 con 0x7f5ad0106340 2024-05-08T20:03:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.470+0000 7f5accff9700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5abc0a11b0 0x7f5abc0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.470+0000 7f5aceffd700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5abc0a11b0 0x7f5abc0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.470+0000 7f5accff9700 1 -- 172.21.15.33:0/1846253431 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5ac80db350 con 0x7f5ad0106340 2024-05-08T20:03:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.470+0000 7f5aceffd700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5abc0a11b0 0x7f5abc0a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000b2e0 tx=0x7f5ac0005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.475+0000 7f5accff9700 1 -- 172.21.15.33:0/1846253431 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5ac80d8060 con 0x7f5ad0106340 2024-05-08T20:03:58.507 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:58 smithi033 ceph-mon[42490]: pgmap v235: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T20:03:58.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 -- 172.21.15.33:0/69068828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068105f00 msgr2=0x7f30681062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.540 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 --2- 172.21.15.33:0/69068828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068105f00 0x7f30681062e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3058009990 tx=0x7f3058009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 -- 172.21.15.33:0/69068828 shutdown_connections 2024-05-08T20:03:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 --2- 172.21.15.33:0/69068828 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3068100890 0x7f306810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 --2- 172.21.15.33:0/69068828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068105f00 0x7f30681062e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 --2- 172.21.15.33:0/69068828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30680ffed0 0x7f3068100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 -- 172.21.15.33:0/69068828 >> 172.21.15.33:0/69068828 conn(0x7f3068075f80 msgr2=0x7f3068076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 -- 172.21.15.33:0/69068828 shutdown_connections 2024-05-08T20:03:58.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.551+0000 7f306d67a700 1 -- 172.21.15.33:0/69068828 wait complete. 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 Processor -- start 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 -- start start 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30680ffed0 0x7f30681963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068100890 0x7f3068196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3068105f00 0x7f306819acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306819b2d0 con 0x7f3068100890 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306819b440 con 0x7f30680ffed0 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.552+0000 7f306d67a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306819b600 con 0x7f3068105f00 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068100890 0x7f3068196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068100890 0x7f3068196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58368/0 (socket says 172.21.15.33:58368) 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 -- 172.21.15.33:0/1048515034 learned_addr learned my addr 172.21.15.33:0/1048515034 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:58.543 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f3066ffd700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30680ffed0 0x7f30681963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30677fe700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3068105f00 0x7f306819acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 -- 172.21.15.33:0/1048515034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3068105f00 msgr2=0x7f306819acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3068105f00 0x7f306819acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 -- 172.21.15.33:0/1048515034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30680ffed0 msgr2=0x7f30681963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f30680ffed0 0x7f30681963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 -- 172.21.15.33:0/1048515034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580095f0 con 0x7f3068100890 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f30667fc700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068100890 0x7f3068196910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f305c00eab0 tx=0x7f305c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c013070 con 0x7f3068100890 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f306d67a700 1 -- 172.21.15.33:0/1048515034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306819b8e0 con 0x7f3068100890 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f305c017410 con 0x7f3068100890 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.553+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c009790 con 0x7f3068100890 2024-05-08T20:03:58.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.554+0000 7f306d67a700 1 -- 172.21.15.33:0/1048515034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3068068b20 con 0x7f3068100890 2024-05-08T20:03:58.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.555+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30681101c0 con 0x7f3068100890 2024-05-08T20:03:58.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.557+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f305c017910 con 0x7f3068100890 2024-05-08T20:03:58.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.557+0000 7f304ffff700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f30500a11b0 0x7f30500a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.557+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f305c0ccd90 con 0x7f3068100890 2024-05-08T20:03:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.557+0000 7f3066ffd700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f30500a11b0 0x7f30500a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.558+0000 7f304ffff700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] conn(0x7f30500aa990 0x7f30500acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.558+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 --> [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30500ad460 con 0x7f30500aa990 2024-05-08T20:03:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.558+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f305c00bea0 con 0x7f3068100890 2024-05-08T20:03:58.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.558+0000 7f30677fe700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] conn(0x7f30500aa990 0x7f30500acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.558+0000 7f30677fe700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] conn(0x7f30500aa990 0x7f30500acdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:58.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.558+0000 7f3066ffd700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f30500a11b0 0x7f30500a3670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f305800b2e0 tx=0x7f3058005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:58.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.559+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== osd.9 v2:172.21.15.33:6826/185298138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f30500ad460 con 0x7f30500aa990 2024-05-08T20:03:58.570 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.581+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 --> [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3068068ef0 con 0x7f30500aa990 2024-05-08T20:03:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.581+0000 7f304ffff700 1 -- 172.21.15.33:0/1048515034 <== osd.9 v2:172.21.15.33:6826/185298138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3068068ef0 con 0x7f30500aa990 2024-05-08T20:03:58.571 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] conn(0x7f30500aa990 msgr2=0x7f30500acdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] conn(0x7f30500aa990 0x7f30500acdb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f30500a11b0 msgr2=0x7f30500a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f30500a11b0 0x7f30500a3670 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f305800b2e0 tx=0x7f3058005fd0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068100890 msgr2=0x7f3068196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 --2- 172.21.15.33:0/1048515034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3068100890 0x7f3068196910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f305c00eab0 tx=0x7f305c00edc0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f30677fe700 1 -- 172.21.15.33:0/1048515034 reap_dead start 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 shutdown_connections 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 >> 172.21.15.33:0/1048515034 conn(0x7f3068075f80 msgr2=0x7f30680fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:58.572 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 shutdown_connections 2024-05-08T20:03:58.573 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.582+0000 7f304dffb700 1 -- 172.21.15.33:0/1048515034 wait complete. 2024-05-08T20:03:58.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 -- 172.21.15.33:0/4128781501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c107010 msgr2=0x7fa24c1073f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 --2- 172.21.15.33:0/4128781501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c107010 0x7fa24c1073f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa240009990 tx=0x7fa240009ca0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 -- 172.21.15.33:0/4128781501 shutdown_connections 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 --2- 172.21.15.33:0/4128781501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24c101a30 0x7fa24c10de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 --2- 172.21.15.33:0/4128781501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c107010 0x7fa24c1073f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 --2- 172.21.15.33:0/4128781501 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c101090 0x7fa24c1014f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 -- 172.21.15.33:0/4128781501 >> 172.21.15.33:0/4128781501 conn(0x7fa24c074d30 msgr2=0x7fa24c0ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 -- 172.21.15.33:0/4128781501 shutdown_connections 2024-05-08T20:03:58.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.594+0000 7fa250822700 1 -- 172.21.15.33:0/4128781501 wait complete. 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.595+0000 7fa250822700 1 Processor -- start 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.595+0000 7fa250822700 1 -- start start 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa250822700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24c101090 0x7fa24c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa250822700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c101a30 0x7fa24c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa250822700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c107010 0x7fa24c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa250822700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c19c360 con 0x7fa24c101a30 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa250822700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c19c4d0 con 0x7fa24c107010 2024-05-08T20:03:58.585 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa250822700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24c19c690 con 0x7fa24c101090 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c107010 0x7fa24c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c107010 0x7fa24c19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:39498/0 (socket says 172.21.15.33:39498) 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 -- 172.21.15.33:0/148567085 learned_addr learned my addr 172.21.15.33:0/148567085 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa249d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c101a30 0x7fa24c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24a59c700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24c101090 0x7fa24c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 -- 172.21.15.33:0/148567085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24c101090 msgr2=0x7fa24c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24c101090 0x7fa24c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 -- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c101a30 msgr2=0x7fa24c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c101a30 0x7fa24c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.596+0000 7fa24ad9d700 1 -- 172.21.15.33:0/148567085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2400095f0 con 0x7fa24c107010 2024-05-08T20:03:58.587 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.597+0000 7fa24ad9d700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c107010 0x7fa24c19bd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ef30 tx=0x7fa24400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:58.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.597+0000 7fa23b7fe700 1 -- 172.21.15.33:0/148567085 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244018070 con 0x7fa24c107010 2024-05-08T20:03:58.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.597+0000 7fa23b7fe700 1 -- 172.21.15.33:0/148567085 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa24400f040 con 0x7fa24c107010 2024-05-08T20:03:58.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.597+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24c19c910 con 0x7fa24c107010 2024-05-08T20:03:58.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.597+0000 7fa23b7fe700 1 -- 172.21.15.33:0/148567085 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400cd50 con 0x7fa24c107010 2024-05-08T20:03:58.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.597+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c1a41d0 con 0x7fa24c107010 2024-05-08T20:03:58.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.598+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24c109530 con 0x7fa24c107010 2024-05-08T20:03:58.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.599+0000 7fa23b7fe700 1 -- 172.21.15.33:0/148567085 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa244003a00 con 0x7fa24c107010 2024-05-08T20:03:58.589 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.600+0000 7fa23b7fe700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2340a1230 0x7fa2340a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:58.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.600+0000 7fa24a59c700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2340a1230 0x7fa2340a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:58.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.600+0000 7fa23b7fe700 1 -- 172.21.15.33:0/148567085 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa2440cc5c0 con 0x7fa24c107010 2024-05-08T20:03:58.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.601+0000 7fa24a59c700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2340a1230 0x7fa2340a36f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b2e0 tx=0x7fa240005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:58.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.604+0000 7fa23b7fe700 1 -- 172.21.15.33:0/148567085 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa244095d30 con 0x7fa24c107010 2024-05-08T20:03:58.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:58 smithi082 ceph-mon[46774]: pgmap v235: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T20:03:58.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:58 smithi132 ceph-mon[47484]: pgmap v235: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-05-08T20:03:58.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.723+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f5ad019aa60 con 0x7f5ad0106340 2024-05-08T20:03:58.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.724+0000 7f5accff9700 1 -- 172.21.15.33:0/1846253431 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f5ac809d350 con 0x7f5ad0106340 2024-05-08T20:03:58.713 INFO:teuthology.orchestra.run.smithi033.stdout:322122547215 2024-05-08T20:03:58.715 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5abc0a11b0 msgr2=0x7f5abc0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5abc0a11b0 0x7f5abc0a3670 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ac000b2e0 tx=0x7f5ac0005960 comp rx=0 tx=0).stop 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0106340 msgr2=0x7f5ad019dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0106340 0x7f5ad019dfa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ef30 tx=0x7f5ac800c3a0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 shutdown_connections 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ad0106340 0x7f5ad019dfa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5abc0a11b0 0x7f5abc0a3670 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ad0068bb0 0x7f5ad01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 --2- 172.21.15.33:0/1846253431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ad0069560 0x7f5ad0199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 >> 172.21.15.33:0/1846253431 conn(0x7f5ad0075f80 msgr2=0x7f5ad010c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 shutdown_connections 2024-05-08T20:03:58.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.726+0000 7f5ad55dc700 1 -- 172.21.15.33:0/1846253431 wait complete. 2024-05-08T20:03:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.826+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa24c04ec90 con 0x7fa24c107010 2024-05-08T20:03:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.826+0000 7fa23b7fe700 1 -- 172.21.15.33:0/148567085 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa244099350 con 0x7fa24c107010 2024-05-08T20:03:58.816 INFO:teuthology.orchestra.run.smithi033.stdout:103079215147 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2340a1230 msgr2=0x7fa2340a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2340a1230 0x7fa2340a36f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b2e0 tx=0x7fa240005960 comp rx=0 tx=0).stop 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c107010 msgr2=0x7fa24c19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c107010 0x7fa24c19bd50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ef30 tx=0x7fa24400c3a0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 shutdown_connections 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa24c107010 0x7fa24c19bd50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2340a1230 0x7fa2340a36f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24c101090 0x7fa24c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 --2- 172.21.15.33:0/148567085 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa24c101a30 0x7fa24c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 >> 172.21.15.33:0/148567085 conn(0x7fa24c074d30 msgr2=0x7fa24c0760a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 shutdown_connections 2024-05-08T20:03:58.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:58.829+0000 7fa250822700 1 -- 172.21.15.33:0/148567085 wait complete. 2024-05-08T20:03:58.968 INFO:teuthology.orchestra.run.smithi033.stdout:154618822692 2024-05-08T20:03:58.968 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-08T20:03:59.300 INFO:teuthology.orchestra.run.smithi033.stdout:266287972374 2024-05-08T20:03:59.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-08T20:03:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 -- 172.21.15.33:0/4158864937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac069960 msgr2=0x7f92ac069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 --2- 172.21.15.33:0/4158864937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac069960 0x7f92ac069d40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f929c00b0a0 tx=0x7f929c00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 -- 172.21.15.33:0/4158864937 shutdown_connections 2024-05-08T20:03:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 --2- 172.21.15.33:0/4158864937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92ac1062c0 0x7f92ac10de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 --2- 172.21.15.33:0/4158864937 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac069960 0x7f92ac069d40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 --2- 172.21.15.33:0/4158864937 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac06a310 0x7f92ac105be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 -- 172.21.15.33:0/4158864937 >> 172.21.15.33:0/4158864937 conn(0x7f92ac076f40 msgr2=0x7f92ac077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 -- 172.21.15.33:0/4158864937 shutdown_connections 2024-05-08T20:03:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.512+0000 7f92b110f700 1 -- 172.21.15.33:0/4158864937 wait complete. 2024-05-08T20:03:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.513+0000 7f92b110f700 1 Processor -- start 2024-05-08T20:03:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.513+0000 7f92b110f700 1 -- start start 2024-05-08T20:03:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92b110f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92ac069960 0x7f92ac197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92b110f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac06a310 0x7f92ac197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92b110f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac1062c0 0x7f92ac19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92b110f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac19c480 con 0x7f92ac06a310 2024-05-08T20:03:59.505 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92b110f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac19c5f0 con 0x7f92ac1062c0 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92b110f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ac19c7b0 con 0x7f92ac069960 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac06a310 0x7f92ac197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac06a310 0x7f92ac197ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58412/0 (socket says 172.21.15.33:58412) 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 -- 172.21.15.33:0/1331971790 learned_addr learned my addr 172.21.15.33:0/1331971790 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aad9d700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92ac069960 0x7f92ac197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92ab59e700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac1062c0 0x7f92ac19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 -- 172.21.15.33:0/1331971790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92ac069960 msgr2=0x7f92ac197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92ac069960 0x7f92ac197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 -- 172.21.15.33:0/1331971790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac1062c0 msgr2=0x7f92ac19be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac1062c0 0x7f92ac19be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 -- 172.21.15.33:0/1331971790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c009d00 con 0x7f92ac06a310 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.514+0000 7f92aa59c700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac06a310 0x7f92ac197ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f929400c9e0 tx=0x7f929400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:59.506 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.515+0000 7f92a3fff700 1 -- 172.21.15.33:0/1331971790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294007aa0 con 0x7f92ac06a310 2024-05-08T20:03:59.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.515+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ac19ca90 con 0x7f92ac06a310 2024-05-08T20:03:59.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.515+0000 7f92a3fff700 1 -- 172.21.15.33:0/1331971790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f929400ce80 con 0x7f92ac06a310 2024-05-08T20:03:59.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.515+0000 7f92a3fff700 1 -- 172.21.15.33:0/1331971790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294018660 con 0x7f92ac06a310 2024-05-08T20:03:59.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.515+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ac1a42f0 con 0x7f92ac06a310 2024-05-08T20:03:59.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.516+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ac109580 con 0x7f92ac06a310 2024-05-08T20:03:59.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.518+0000 7f92a3fff700 1 -- 172.21.15.33:0/1331971790 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f929400f450 con 0x7f92ac06a310 2024-05-08T20:03:59.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:59 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1846253431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T20:03:59.508 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:03:59 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/148567085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T20:03:59.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.519+0000 7f92a3fff700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f92980a1230 0x7f92980a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:03:59.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.519+0000 7f92aad9d700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f92980a1230 0x7f92980a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:03:59.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.519+0000 7f92a3fff700 1 -- 172.21.15.33:0/1331971790 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f92940cc770 con 0x7f92ac06a310 2024-05-08T20:03:59.509 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.519+0000 7f92aad9d700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f92980a1230 0x7f92980a36f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f929c009fd0 tx=0x7f929c00b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:03:59.512 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.523+0000 7f92a3fff700 1 -- 172.21.15.33:0/1331971790 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9294095f50 con 0x7f92ac06a310 2024-05-08T20:03:59.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:59 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1846253431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T20:03:59.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:03:59 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/148567085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T20:03:59.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:59 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1846253431' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T20:03:59.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:03:59 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/148567085' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T20:03:59.626 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547214 got 322122547215 for osd.11 2024-05-08T20:03:59.626 DEBUG:teuthology.parallel:result is None 2024-05-08T20:03:59.652 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:03:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.761+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f92ac198890 con 0x7f92ac06a310 2024-05-08T20:03:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.761+0000 7f92a3fff700 1 -- 172.21.15.33:0/1331971790 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9294099570 con 0x7f92ac06a310 2024-05-08T20:03:59.752 INFO:teuthology.orchestra.run.smithi033.stdout:77309411376 2024-05-08T20:03:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f92980a1230 msgr2=0x7f92980a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f92980a1230 0x7f92980a36f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f929c009fd0 tx=0x7f929c00b7b0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac06a310 msgr2=0x7f92ac197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:03:59.753 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac06a310 0x7f92ac197ac0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f929400c9e0 tx=0x7f929400ccf0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 shutdown_connections 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92ac1062c0 0x7f92ac19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f92980a1230 0x7f92980a36f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92ac069960 0x7f92ac197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 --2- 172.21.15.33:0/1331971790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92ac06a310 0x7f92ac197ac0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 >> 172.21.15.33:0/1331971790 conn(0x7f92ac076f40 msgr2=0x7f92ac0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 shutdown_connections 2024-05-08T20:03:59.754 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:03:59.764+0000 7f92b110f700 1 -- 172.21.15.33:0/1331971790 wait complete. 2024-05-08T20:03:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:00.203 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411374 got 77309411376 for osd.2 2024-05-08T20:04:00.203 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:00.441 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:00 smithi033 ceph-mon[42490]: pgmap v236: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T20:04:00.441 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:00 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1331971790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T20:04:00.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:00 smithi082 ceph-mon[46774]: pgmap v236: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T20:04:00.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:00 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1331971790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T20:04:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:00 smithi132 ceph-mon[47484]: pgmap v236: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T20:04:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:00 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1331971790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T20:04:00.664 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215146 got 103079215147 for osd.3 2024-05-08T20:04:00.664 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:00.857 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:00.858 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:01.109 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 -- 172.21.15.33:0/3288343447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510101410 msgr2=0x7f551010cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 --2- 172.21.15.33:0/3288343447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510101410 0x7f551010cd70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f550800b0d0 tx=0x7f550800b3e0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 -- 172.21.15.33:0/3288343447 shutdown_connections 2024-05-08T20:04:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 --2- 172.21.15.33:0/3288343447 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510101410 0x7f551010cd70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 --2- 172.21.15.33:0/3288343447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5510104ed0 0x7f55101052b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 --2- 172.21.15.33:0/3288343447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510100a50 0x7f5510100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.171 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 -- 172.21.15.33:0/3288343447 >> 172.21.15.33:0/3288343447 conn(0x7f5510075260 msgr2=0x7f5510075670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 -- 172.21.15.33:0/3288343447 shutdown_connections 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 -- 172.21.15.33:0/3288343447 wait complete. 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.023+0000 7f5516135700 1 Processor -- start 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f5516135700 1 -- start start 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f5516135700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510100a50 0x7f5510101bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f5516135700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101410 0x7f5510102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f5516135700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5510104ed0 0x7f5510102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f5516135700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101a5930 con 0x7f5510100a50 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f5516135700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101a5aa0 con 0x7f5510101410 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f5516135700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101a5c60 con 0x7f5510104ed0 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510100a50 0x7f5510101bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.172 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f550f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510100a50 0x7f5510101bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58420/0 (socket says 172.21.15.33:58420) 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f550f7fe700 1 -- 172.21.15.33:0/1132567950 learned_addr learned my addr 172.21.15.33:0/1132567950 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f550ffff700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5510104ed0 0x7f5510102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.024+0000 7f550effd700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101410 0x7f5510102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550f7fe700 1 -- 172.21.15.33:0/1132567950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5510104ed0 msgr2=0x7f5510102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550f7fe700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5510104ed0 0x7f5510102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550f7fe700 1 -- 172.21.15.33:0/1132567950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101410 msgr2=0x7f5510102110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550f7fe700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101410 0x7f5510102110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550f7fe700 1 -- 172.21.15.33:0/1132567950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009d00 con 0x7f5510100a50 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550f7fe700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510100a50 0x7f5510101bd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f550000d950 tx=0x7f550000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550cff9700 1 -- 172.21.15.33:0/1132567950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000f890 con 0x7f5510100a50 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550cff9700 1 -- 172.21.15.33:0/1132567950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5500010460 con 0x7f5510100a50 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f550cff9700 1 -- 172.21.15.33:0/1132567950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000e610 con 0x7f5510100a50 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55101a5f40 con 0x7f5510100a50 2024-05-08T20:04:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.025+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55101a63b0 con 0x7f5510100a50 2024-05-08T20:04:01.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.026+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5510109440 con 0x7f5510100a50 2024-05-08T20:04:01.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.028+0000 7f550cff9700 1 -- 172.21.15.33:0/1132567950 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5500010960 con 0x7f5510100a50 2024-05-08T20:04:01.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.028+0000 7f550cff9700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54fc0a1230 0x7f54fc0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.028+0000 7f550cff9700 1 -- 172.21.15.33:0/1132567950 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f55000cc590 con 0x7f5510100a50 2024-05-08T20:04:01.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.028+0000 7f550effd700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54fc0a1230 0x7f54fc0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.029+0000 7f550effd700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54fc0a1230 0x7f54fc0a36f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5510103300 tx=0x7f54f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:01.174 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.032+0000 7f550cff9700 1 -- 172.21.15.33:0/1132567950 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5500095d70 con 0x7f5510100a50 2024-05-08T20:04:01.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.274+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5510103150 con 0x7f5510100a50 2024-05-08T20:04:01.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.274+0000 7f550cff9700 1 -- 172.21.15.33:0/1132567950 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5500020090 con 0x7f5510100a50 2024-05-08T20:04:01.264 INFO:teuthology.orchestra.run.smithi033.stdout:55834574900 2024-05-08T20:04:01.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54fc0a1230 msgr2=0x7f54fc0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54fc0a1230 0x7f54fc0a36f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5510103300 tx=0x7f54f8009260 comp rx=0 tx=0).stop 2024-05-08T20:04:01.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510100a50 msgr2=0x7f5510101bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510100a50 0x7f5510101bd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f550000d950 tx=0x7f550000dc60 comp rx=0 tx=0).stop 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 shutdown_connections 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f54fc0a1230 0x7f54fc0a36f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5510104ed0 0x7f5510102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5510100a50 0x7f5510101bd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 --2- 172.21.15.33:0/1132567950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5510101410 0x7f5510102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 >> 172.21.15.33:0/1132567950 conn(0x7f5510075260 msgr2=0x7f55100ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 shutdown_connections 2024-05-08T20:04:01.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.277+0000 7f5516135700 1 -- 172.21.15.33:0/1132567950 wait complete. 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 -- 172.21.15.33:0/3937432145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc068950 msgr2=0x7fdcdc068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 --2- 172.21.15.33:0/3937432145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc068950 0x7fdcdc068db0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0009990 tx=0x7fdcd0009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 -- 172.21.15.33:0/3937432145 shutdown_connections 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 --2- 172.21.15.33:0/3937432145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc0692f0 0x7fdcdc10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 --2- 172.21.15.33:0/3937432145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcdc107020 0x7fdcdc107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 --2- 172.21.15.33:0/3937432145 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc068950 0x7fdcdc068db0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 -- 172.21.15.33:0/3937432145 >> 172.21.15.33:0/3937432145 conn(0x7fdcdc075f80 msgr2=0x7fdcdc076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 -- 172.21.15.33:0/3937432145 shutdown_connections 2024-05-08T20:04:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.526+0000 7fdce273b700 1 -- 172.21.15.33:0/3937432145 wait complete. 2024-05-08T20:04:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.527+0000 7fdce273b700 1 Processor -- start 2024-05-08T20:04:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.527+0000 7fdce273b700 1 -- start start 2024-05-08T20:04:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce273b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc068950 0x7fdcdc0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce273b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcdc0692f0 0x7fdcdc1004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce273b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc107020 0x7fdcdc100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce273b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1a5830 con 0x7fdcdc107020 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce273b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1a59a0 con 0x7fdcdc068950 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce273b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc1a5b60 con 0x7fdcdc0692f0 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc107020 0x7fdcdc100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc107020 0x7fdcdc100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58438/0 (socket says 172.21.15.33:58438) 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 -- 172.21.15.33:0/273554650 learned_addr learned my addr 172.21.15.33:0/273554650 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdcdb7fe700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcdc0692f0 0x7fdcdc1004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdcdbfff700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc068950 0x7fdcdc0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 -- 172.21.15.33:0/273554650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcdc0692f0 msgr2=0x7fdcdc1004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcdc0692f0 0x7fdcdc1004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 -- 172.21.15.33:0/273554650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc068950 msgr2=0x7fdcdc0fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc068950 0x7fdcdc0fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 -- 172.21.15.33:0/273554650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00095f0 con 0x7fdcdc107020 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdcdbfff700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc068950 0x7fdcdc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce0cd8700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc107020 0x7fdcdc100a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4007ee0 tx=0x7fdcd400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdcd97fa700 1 -- 172.21.15.33:0/273554650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd400ddd0 con 0x7fdcdc107020 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdcd97fa700 1 -- 172.21.15.33:0/273554650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcd400f040 con 0x7fdcdc107020 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.528+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc1a5e40 con 0x7fdcdc107020 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.529+0000 7fdcd97fa700 1 -- 172.21.15.33:0/273554650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd4015400 con 0x7fdcdc107020 2024-05-08T20:04:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.529+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc1a62b0 con 0x7fdcdc107020 2024-05-08T20:04:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.530+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc109540 con 0x7fdcdc107020 2024-05-08T20:04:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.531+0000 7fdcd97fa700 1 -- 172.21.15.33:0/273554650 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fdcd4003a00 con 0x7fdcdc107020 2024-05-08T20:04:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.531+0000 7fdcd97fa700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fdcc40a12b0 0x7fdcc40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.532+0000 7fdcdbfff700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fdcc40a12b0 0x7fdcc40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.532+0000 7fdcd97fa700 1 -- 172.21.15.33:0/273554650 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdcd40cc200 con 0x7fdcdc107020 2024-05-08T20:04:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.532+0000 7fdcdbfff700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fdcc40a12b0 0x7fdcc40a3770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdccc005e10 tx=0x7fdccc005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:01.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.536+0000 7fdcd97fa700 1 -- 172.21.15.33:0/273554650 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fdcd40958e0 con 0x7fdcdc107020 2024-05-08T20:04:01.664 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.762+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fdcdc1026d0 con 0x7fdcdc107020 2024-05-08T20:04:01.752 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.763+0000 7fdcd97fa700 1 -- 172.21.15.33:0/273554650 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdcd4098f00 con 0x7fdcdc107020 2024-05-08T20:04:01.753 INFO:teuthology.orchestra.run.smithi033.stdout:184683593762 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fdcc40a12b0 msgr2=0x7fdcc40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fdcc40a12b0 0x7fdcc40a3770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdccc005e10 tx=0x7fdccc005d60 comp rx=0 tx=0).stop 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc107020 msgr2=0x7fdcdc100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc107020 0x7fdcdc100a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdcd4007ee0 tx=0x7fdcd400d3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 shutdown_connections 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdcdc107020 0x7fdcdc100a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdcdc068950 0x7fdcdc0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fdcc40a12b0 0x7fdcc40a3770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.765+0000 7fdce273b700 1 --2- 172.21.15.33:0/273554650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcdc0692f0 0x7fdcdc1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:01.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.766+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 >> 172.21.15.33:0/273554650 conn(0x7fdcdc075f80 msgr2=0x7fdcdc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:01.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.766+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 shutdown_connections 2024-05-08T20:04:01.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:01.766+0000 7fdce273b700 1 -- 172.21.15.33:0/273554650 wait complete. 2024-05-08T20:04:01.969 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574898 got 55834574900 for osd.1 2024-05-08T20:04:01.969 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:02.263 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:02 smithi033 ceph-mon[42490]: pgmap v237: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T20:04:02.263 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:02 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1132567950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T20:04:02.264 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:02 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/273554650' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T20:04:02.267 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:02.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:02 smithi082 ceph-mon[46774]: pgmap v237: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T20:04:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:02 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1132567950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T20:04:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:02 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/273554650' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T20:04:02.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:02 smithi132 ceph-mon[47484]: pgmap v237: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T20:04:02.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:02 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1132567950' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T20:04:02.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:02 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/273554650' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T20:04:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 -- 172.21.15.33:0/1208279868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 msgr2=0x7f2bb010ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 --2- 172.21.15.33:0/1208279868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb010ddf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800b0a0 tx=0x7f2ba800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 -- 172.21.15.33:0/1208279868 shutdown_connections 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 --2- 172.21.15.33:0/1208279868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb010ddf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 --2- 172.21.15.33:0/1208279868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0107040 0x7f2bb0107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 --2- 172.21.15.33:0/1208279868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb0101020 0x7f2bb01014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 -- 172.21.15.33:0/1208279868 >> 172.21.15.33:0/1208279868 conn(0x7f2bb0078100 msgr2=0x7f2bb0078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 -- 172.21.15.33:0/1208279868 shutdown_connections 2024-05-08T20:04:02.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.861+0000 7f2bb6018700 1 -- 172.21.15.33:0/1208279868 wait complete. 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 Processor -- start 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 -- start start 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb0101020 0x7f2bb0197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb0197aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0107040 0x7f2bb019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb019c460 con 0x7f2bb01019e0 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb019c5d0 con 0x7f2bb0107040 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2bb6018700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb019c790 con 0x7f2bb0101020 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2baeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb0197aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2baeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb0197aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38510/0 (socket says 172.21.15.33:38510) 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2baeffd700 1 -- 172.21.15.33:0/2171375111 learned_addr learned my addr 172.21.15.33:0/2171375111 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:02.853 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2baffff700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0107040 0x7f2bb019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.862+0000 7f2baf7fe700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb0101020 0x7f2bb0197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2baeffd700 1 -- 172.21.15.33:0/2171375111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb0101020 msgr2=0x7f2bb0197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2baeffd700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb0101020 0x7f2bb0197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2baeffd700 1 -- 172.21.15.33:0/2171375111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0107040 msgr2=0x7f2bb019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2baeffd700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0107040 0x7f2bb019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2baeffd700 1 -- 172.21.15.33:0/2171375111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba8009d00 con 0x7f2bb01019e0 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2baffff700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0107040 0x7f2bb019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2baeffd700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb0197aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400d980 tx=0x7f2ba400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2bacff9700 1 -- 172.21.15.33:0/2171375111 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4004220 con 0x7f2bb01019e0 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2bacff9700 1 -- 172.21.15.33:0/2171375111 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2ba4007640 con 0x7f2bb01019e0 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2bacff9700 1 -- 172.21.15.33:0/2171375111 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400f690 con 0x7f2bb01019e0 2024-05-08T20:04:02.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb019ca70 con 0x7f2bb01019e0 2024-05-08T20:04:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.863+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb01a42d0 con 0x7f2bb01019e0 2024-05-08T20:04:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.865+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb01093b0 con 0x7f2bb01019e0 2024-05-08T20:04:02.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.865+0000 7f2bacff9700 1 -- 172.21.15.33:0/2171375111 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2ba4004410 con 0x7f2bb01019e0 2024-05-08T20:04:02.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.866+0000 7f2bacff9700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2b980a1230 0x7f2b980a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:02.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.866+0000 7f2baf7fe700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2b980a1230 0x7f2b980a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:02.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.866+0000 7f2bacff9700 1 -- 172.21.15.33:0/2171375111 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ba40cc600 con 0x7f2bb01019e0 2024-05-08T20:04:02.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.867+0000 7f2baf7fe700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2b980a1230 0x7f2b980a36f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0005950 tx=0x7f2ba000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:02.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:02.871+0000 7f2bacff9700 1 -- 172.21.15.33:0/2171375111 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2ba4095de0 con 0x7f2bb01019e0 2024-05-08T20:04:02.914 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593760 got 184683593762 for osd.6 2024-05-08T20:04:02.914 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:03.026 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:03.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.097+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2bb0102680 con 0x7f2bb01019e0 2024-05-08T20:04:03.087 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.098+0000 7f2bacff9700 1 -- 172.21.15.33:0/2171375111 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2ba4016090 con 0x7f2bb01019e0 2024-05-08T20:04:03.087 INFO:teuthology.orchestra.run.smithi033.stdout:133143986216 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2b980a1230 msgr2=0x7f2b980a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2b980a1230 0x7f2b980a36f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0005950 tx=0x7f2ba000b410 comp rx=0 tx=0).stop 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 msgr2=0x7f2bb0197aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb0197aa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400d980 tx=0x7f2ba400dc90 comp rx=0 tx=0).stop 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 shutdown_connections 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2bb0107040 0x7f2bb019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2b980a1230 0x7f2b980a36f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bb0101020 0x7f2bb0197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 --2- 172.21.15.33:0/2171375111 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bb01019e0 0x7f2bb0197aa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 >> 172.21.15.33:0/2171375111 conn(0x7f2bb0078100 msgr2=0x7f2bb00ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 shutdown_connections 2024-05-08T20:04:03.090 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:03.100+0000 7f2bb6018700 1 -- 172.21.15.33:0/2171375111 wait complete. 2024-05-08T20:04:03.443 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:03 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2171375111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T20:04:03.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:03 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2171375111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T20:04:03.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:03 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2171375111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T20:04:04.376 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:04 smithi033 ceph-mon[42490]: pgmap v238: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 -- 172.21.15.33:0/1322098605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 msgr2=0x7f62ec1062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 --2- 172.21.15.33:0/1322098605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1062e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009990 tx=0x7f62dc009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 -- 172.21.15.33:0/1322098605 shutdown_connections 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 --2- 172.21.15.33:0/1322098605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ec100890 0x7f62ec10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 --2- 172.21.15.33:0/1322098605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1062e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 --2- 172.21.15.33:0/1322098605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ec0ffed0 0x7f62ec100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 -- 172.21.15.33:0/1322098605 >> 172.21.15.33:0/1322098605 conn(0x7f62ec075f80 msgr2=0x7f62ec076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 -- 172.21.15.33:0/1322098605 shutdown_connections 2024-05-08T20:04:04.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.408+0000 7f62f1102700 1 -- 172.21.15.33:0/1322098605 wait complete. 2024-05-08T20:04:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.409+0000 7f62f1102700 1 Processor -- start 2024-05-08T20:04:04.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62f1102700 1 -- start start 2024-05-08T20:04:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62f1102700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ec0ffed0 0x7f62ec198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62f1102700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ec100890 0x7f62ec198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.400 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62f1102700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1a32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62f1102700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec199010 con 0x7f62ec105f00 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62f1102700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec1a37f0 con 0x7f62ec0ffed0 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62f1102700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ec1a3930 con 0x7f62ec100890 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1a32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1a32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38528/0 (socket says 172.21.15.33:38528) 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 -- 172.21.15.33:0/817813694 learned_addr learned my addr 172.21.15.33:0/817813694 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62ead9d700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ec0ffed0 0x7f62ec198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62ea59c700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ec100890 0x7f62ec198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 -- 172.21.15.33:0/817813694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ec100890 msgr2=0x7f62ec198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ec100890 0x7f62ec198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 -- 172.21.15.33:0/817813694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ec0ffed0 msgr2=0x7f62ec198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ec0ffed0 0x7f62ec198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.401 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.410+0000 7f62eb59e700 1 -- 172.21.15.33:0/817813694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc0095f0 con 0x7f62ec105f00 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.411+0000 7f62ead9d700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ec0ffed0 0x7f62ec198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.411+0000 7f62eb59e700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1a32b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62e4007f10 tx=0x7f62e400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.411+0000 7f62d3fff700 1 -- 172.21.15.33:0/817813694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4017070 con 0x7f62ec105f00 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.411+0000 7f62d3fff700 1 -- 172.21.15.33:0/817813694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f62e400f040 con 0x7f62ec105f00 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.411+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62ec1a3be0 con 0x7f62ec105f00 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.411+0000 7f62d3fff700 1 -- 172.21.15.33:0/817813694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e4005760 con 0x7f62ec105f00 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.411+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ec1a4090 con 0x7f62ec105f00 2024-05-08T20:04:04.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.412+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ec108420 con 0x7f62ec105f00 2024-05-08T20:04:04.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.414+0000 7f62d3fff700 1 -- 172.21.15.33:0/817813694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f62e40058c0 con 0x7f62ec105f00 2024-05-08T20:04:04.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.415+0000 7f62d3fff700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f62d40a11b0 0x7f62d40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.415+0000 7f62ead9d700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f62d40a11b0 0x7f62d40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.415+0000 7f62d3fff700 1 -- 172.21.15.33:0/817813694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f62e40cc790 con 0x7f62ec105f00 2024-05-08T20:04:04.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.416+0000 7f62ead9d700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f62d40a11b0 0x7f62d40a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62dc006010 tx=0x7f62dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:04.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.419+0000 7f62d3fff700 1 -- 172.21.15.33:0/817813694 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f62e4095e70 con 0x7f62ec105f00 2024-05-08T20:04:04.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 -- 172.21.15.33:0/236325209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c0692f0 msgr2=0x7f292c10de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 --2- 172.21.15.33:0/236325209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c0692f0 0x7f292c10de60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f292400b0d0 tx=0x7f292400b3e0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 -- 172.21.15.33:0/236325209 shutdown_connections 2024-05-08T20:04:04.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 --2- 172.21.15.33:0/236325209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c0692f0 0x7f292c10de60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 --2- 172.21.15.33:0/236325209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f292c107020 0x7f292c107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 --2- 172.21.15.33:0/236325209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f292c068950 0x7f292c068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 -- 172.21.15.33:0/236325209 >> 172.21.15.33:0/236325209 conn(0x7f292c075f80 msgr2=0x7f292c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.613+0000 7f2932538700 1 -- 172.21.15.33:0/236325209 shutdown_connections 2024-05-08T20:04:04.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.614+0000 7f2932538700 1 -- 172.21.15.33:0/236325209 wait complete. 2024-05-08T20:04:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.614+0000 7f2932538700 1 Processor -- start 2024-05-08T20:04:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.614+0000 7f2932538700 1 -- start start 2024-05-08T20:04:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2932538700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f292c068950 0x7f292c0fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2932538700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f292c0692f0 0x7f292c1004e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.605 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2932538700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c107020 0x7f292c100a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2932538700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c101f60 con 0x7f292c107020 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2932538700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c19b6e0 con 0x7f292c0692f0 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2932538700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292c19b8a0 con 0x7f292c068950 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2930ad5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c107020 0x7f292c100a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2930ad5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c107020 0x7f292c100a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38552/0 (socket says 172.21.15.33:38552) 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f2930ad5700 1 -- 172.21.15.33:0/2433529215 learned_addr learned my addr 172.21.15.33:0/2433529215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f292b7fe700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f292c0692f0 0x7f292c1004e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.615+0000 7f292bfff700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f292c068950 0x7f292c0fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2930ad5700 1 -- 172.21.15.33:0/2433529215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f292c068950 msgr2=0x7f292c0fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2930ad5700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f292c068950 0x7f292c0fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2930ad5700 1 -- 172.21.15.33:0/2433529215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f292c0692f0 msgr2=0x7f292c1004e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2930ad5700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f292c0692f0 0x7f292c1004e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2930ad5700 1 -- 172.21.15.33:0/2433529215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2924009d00 con 0x7f292c107020 2024-05-08T20:04:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f292bfff700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f292c068950 0x7f292c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2930ad5700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c107020 0x7f292c100a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f292400d010 tx=0x7f2924004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f29297fa700 1 -- 172.21.15.33:0/2433529215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292400e040 con 0x7f292c107020 2024-05-08T20:04:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292c19bb20 con 0x7f292c107020 2024-05-08T20:04:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f29297fa700 1 -- 172.21.15.33:0/2433529215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f29240077c0 con 0x7f292c107020 2024-05-08T20:04:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f29297fa700 1 -- 172.21.15.33:0/2433529215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924005240 con 0x7f292c107020 2024-05-08T20:04:04.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.616+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292c19c020 con 0x7f292c107020 2024-05-08T20:04:04.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.617+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292c109540 con 0x7f292c107020 2024-05-08T20:04:04.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.619+0000 7f29297fa700 1 -- 172.21.15.33:0/2433529215 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f292401b450 con 0x7f292c107020 2024-05-08T20:04:04.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.620+0000 7f29297fa700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29140a11b0 0x7f29140a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.620+0000 7f29297fa700 1 -- 172.21.15.33:0/2433529215 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f29240cdeb0 con 0x7f292c107020 2024-05-08T20:04:04.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.623+0000 7f292bfff700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29140a11b0 0x7f29140a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.613 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.623+0000 7f292bfff700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29140a11b0 0x7f29140a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f291c005fd0 tx=0x7f291c005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:04.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.629+0000 7f29297fa700 1 -- 172.21.15.33:0/2433529215 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f29240976a0 con 0x7f292c107020 2024-05-08T20:04:04.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:04 smithi082 ceph-mon[46774]: pgmap v238: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T20:04:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:04 smithi132 ceph-mon[47484]: pgmap v238: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-05-08T20:04:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.648+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f62ec1015b0 con 0x7f62ec105f00 2024-05-08T20:04:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.649+0000 7f62d3fff700 1 -- 172.21.15.33:0/817813694 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f62e4099490 con 0x7f62ec105f00 2024-05-08T20:04:04.639 INFO:teuthology.orchestra.run.smithi033.stdout:287762808851 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f62d40a11b0 msgr2=0x7f62d40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f62d40a11b0 0x7f62d40a3670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f62dc006010 tx=0x7f62dc01a040 comp rx=0 tx=0).stop 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 msgr2=0x7f62ec1a32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1a32b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f62e4007f10 tx=0x7f62e400d3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 shutdown_connections 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62ec105f00 0x7f62ec1a32b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f62ec0ffed0 0x7f62ec198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f62d40a11b0 0x7f62d40a3670 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 --2- 172.21.15.33:0/817813694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ec100890 0x7f62ec198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.641 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 >> 172.21.15.33:0/817813694 conn(0x7f62ec075f80 msgr2=0x7f62ec0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:04.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.651+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 shutdown_connections 2024-05-08T20:04:04.642 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.652+0000 7f62f1102700 1 -- 172.21.15.33:0/817813694 wait complete. 2024-05-08T20:04:04.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 -- 172.21.15.33:0/1158805341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8069210 msgr2=0x7f70b8069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1158805341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8069210 0x7f70b8069690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f70a80099c0 tx=0x7f70a8009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 -- 172.21.15.33:0/1158805341 shutdown_connections 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1158805341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b8069bd0 0x7f70b810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1158805341 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b8106fe0 0x7f70b81073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1158805341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8069210 0x7f70b8069690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 -- 172.21.15.33:0/1158805341 >> 172.21.15.33:0/1158805341 conn(0x7f70b8076e70 msgr2=0x7f70b8077280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 -- 172.21.15.33:0/1158805341 shutdown_connections 2024-05-08T20:04:04.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.774+0000 7f70c00a4700 1 -- 172.21.15.33:0/1158805341 wait complete. 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 Processor -- start 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 -- start start 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b8069210 0x7f70b80fff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b8069bd0 0x7f70b81004a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8106fe0 0x7f70b81009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81a5870 con 0x7f70b8106fe0 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81a59e0 con 0x7f70b8069bd0 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70c00a4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81a5ba0 con 0x7f70b8069210 2024-05-08T20:04:04.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8106fe0 0x7f70b81009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8106fe0 0x7f70b81009e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38568/0 (socket says 172.21.15.33:38568) 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 -- 172.21.15.33:0/1200873983 learned_addr learned my addr 172.21.15.33:0/1200873983 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70bd63f700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b8069bd0 0x7f70b81004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70bde40700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b8069210 0x7f70b80fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 -- 172.21.15.33:0/1200873983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b8069210 msgr2=0x7f70b80fff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b8069210 0x7f70b80fff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 -- 172.21.15.33:0/1200873983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b8069bd0 msgr2=0x7f70b81004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b8069bd0 0x7f70b81004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.775+0000 7f70be641700 1 -- 172.21.15.33:0/1200873983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a80095f0 con 0x7f70b8106fe0 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.776+0000 7f70be641700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8106fe0 0x7f70b81009e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f70b0007ee0 tx=0x7f70b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.776+0000 7f70aeffd700 1 -- 172.21.15.33:0/1200873983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0017070 con 0x7f70b8106fe0 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.776+0000 7f70aeffd700 1 -- 172.21.15.33:0/1200873983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f70b000f040 con 0x7f70b8106fe0 2024-05-08T20:04:04.767 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.776+0000 7f70aeffd700 1 -- 172.21.15.33:0/1200873983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0005740 con 0x7f70b8106fe0 2024-05-08T20:04:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.776+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b81a5e80 con 0x7f70b8106fe0 2024-05-08T20:04:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.776+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b81a6300 con 0x7f70b8106fe0 2024-05-08T20:04:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.777+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b81094c0 con 0x7f70b8106fe0 2024-05-08T20:04:04.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.779+0000 7f70aeffd700 1 -- 172.21.15.33:0/1200873983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f70b00058a0 con 0x7f70b8106fe0 2024-05-08T20:04:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.780+0000 7f70aeffd700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70a40a1230 0x7f70a40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.780+0000 7f70bde40700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70a40a1230 0x7f70a40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.780+0000 7f70aeffd700 1 -- 172.21.15.33:0/1200873983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f70b00cc690 con 0x7f70b8106fe0 2024-05-08T20:04:04.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.780+0000 7f70bde40700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70a40a1230 0x7f70a40a36f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70b400dad0 tx=0x7f70b400d4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:04.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.783+0000 7f70aeffd700 1 -- 172.21.15.33:0/1200873983 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f70b0095e70 con 0x7f70b8106fe0 2024-05-08T20:04:04.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.855+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f292c101480 con 0x7f292c107020 2024-05-08T20:04:04.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.856+0000 7f29297fa700 1 -- 172.21.15.33:0/2433529215 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f292409acc0 con 0x7f292c107020 2024-05-08T20:04:04.846 INFO:teuthology.orchestra.run.smithi033.stdout:206158430238 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.859+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29140a11b0 msgr2=0x7f29140a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.859+0000 7f2932538700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29140a11b0 0x7f29140a3670 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f291c005fd0 tx=0x7f291c005d40 comp rx=0 tx=0).stop 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.859+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c107020 msgr2=0x7f292c100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.859+0000 7f2932538700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c107020 0x7f292c100a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f292400d010 tx=0x7f2924004ab0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 shutdown_connections 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f292c107020 0x7f292c100a20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29140a11b0 0x7f29140a3670 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f292c068950 0x7f292c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 --2- 172.21.15.33:0/2433529215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f292c0692f0 0x7f292c1004e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:04.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 >> 172.21.15.33:0/2433529215 conn(0x7f292c075f80 msgr2=0x7f292c0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:04.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 shutdown_connections 2024-05-08T20:04:04.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:04.860+0000 7f2932538700 1 -- 172.21.15.33:0/2433529215 wait complete. 2024-05-08T20:04:04.964 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986215 got 133143986216 for osd.4 2024-05-08T20:04:04.964 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:05.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.038+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f70b81014e0 con 0x7f70b8106fe0 2024-05-08T20:04:05.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.039+0000 7f70aeffd700 1 -- 172.21.15.33:0/1200873983 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f70b0099490 con 0x7f70b8106fe0 2024-05-08T20:04:05.028 INFO:teuthology.orchestra.run.smithi033.stdout:236223201306 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70a40a1230 msgr2=0x7f70a40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70a40a1230 0x7f70a40a36f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f70b400dad0 tx=0x7f70b400d4b0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8106fe0 msgr2=0x7f70b81009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8106fe0 0x7f70b81009e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f70b0007ee0 tx=0x7f70b000d3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 shutdown_connections 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b8106fe0 0x7f70b81009e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f70a40a1230 0x7f70a40a36f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70b8069210 0x7f70b80fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 --2- 172.21.15.33:0/1200873983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f70b8069bd0 0x7f70b81004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 >> 172.21.15.33:0/1200873983 conn(0x7f70b8076e70 msgr2=0x7f70b80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:05.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 shutdown_connections 2024-05-08T20:04:05.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.041+0000 7f70c00a4700 1 -- 172.21.15.33:0/1200873983 wait complete. 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 -- 172.21.15.33:0/2189824735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180100890 msgr2=0x7f818010cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 --2- 172.21.15.33:0/2189824735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180100890 0x7f818010cd40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f817800b0a0 tx=0x7f817800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 -- 172.21.15.33:0/2189824735 shutdown_connections 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 --2- 172.21.15.33:0/2189824735 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180100890 0x7f818010cd40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 --2- 172.21.15.33:0/2189824735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8180105f00 0x7f81801062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 --2- 172.21.15.33:0/2189824735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81800ffed0 0x7f8180100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 -- 172.21.15.33:0/2189824735 >> 172.21.15.33:0/2189824735 conn(0x7f8180075f80 msgr2=0x7f8180076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 -- 172.21.15.33:0/2189824735 shutdown_connections 2024-05-08T20:04:05.465 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.475+0000 7f8185b87700 1 -- 172.21.15.33:0/2189824735 wait complete. 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 Processor -- start 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 -- start start 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffed0 0x7f81801975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8180100890 0x7f8180197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180105f00 0x7f818019beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818019c4c0 con 0x7f8180105f00 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818019c630 con 0x7f81800ffed0 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.476+0000 7f8185b87700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818019c7f0 con 0x7f8180100890 2024-05-08T20:04:05.467 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180105f00 0x7f818019beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180105f00 0x7f818019beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38576/0 (socket says 172.21.15.33:38576) 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 -- 172.21.15.33:0/1540976301 learned_addr learned my addr 172.21.15.33:0/1540976301 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817effd700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8180100890 0x7f8180197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817f7fe700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffed0 0x7f81801975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 -- 172.21.15.33:0/1540976301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8180100890 msgr2=0x7f8180197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8180100890 0x7f8180197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 -- 172.21.15.33:0/1540976301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffed0 msgr2=0x7f81801975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffed0 0x7f81801975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 -- 172.21.15.33:0/1540976301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8178009d00 con 0x7f8180105f00 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817ffff700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180105f00 0x7f818019beb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81780095e0 tx=0x7f817800ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817cff9700 1 -- 172.21.15.33:0/1540976301 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800e040 con 0x7f8180105f00 2024-05-08T20:04:05.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818019ca70 con 0x7f8180105f00 2024-05-08T20:04:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817cff9700 1 -- 172.21.15.33:0/1540976301 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8178007a50 con 0x7f8180105f00 2024-05-08T20:04:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f817cff9700 1 -- 172.21.15.33:0/1540976301 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178005670 con 0x7f8180105f00 2024-05-08T20:04:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.477+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81801a4330 con 0x7f8180105f00 2024-05-08T20:04:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.479+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81801015b0 con 0x7f8180105f00 2024-05-08T20:04:05.469 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.480+0000 7f817cff9700 1 -- 172.21.15.33:0/1540976301 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f817801bca0 con 0x7f8180105f00 2024-05-08T20:04:05.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.481+0000 7f817cff9700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f81680a11b0 0x7f81680a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.481+0000 7f817f7fe700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f81680a11b0 0x7f81680a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.481+0000 7f817cff9700 1 -- 172.21.15.33:0/1540976301 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f81780ce300 con 0x7f8180105f00 2024-05-08T20:04:05.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.481+0000 7f817f7fe700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f81680a11b0 0x7f81680a3670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8170005950 tx=0x7f817000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:05.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.486+0000 7f817cff9700 1 -- 172.21.15.33:0/1540976301 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8178097b70 con 0x7f8180105f00 2024-05-08T20:04:05.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:05 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/817813694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T20:04:05.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:05 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2433529215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T20:04:05.501 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:05 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1200873983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T20:04:05.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/817813694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T20:04:05.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2433529215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T20:04:05.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:05 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1200873983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T20:04:05.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:05 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/817813694' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T20:04:05.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:05 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2433529215' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T20:04:05.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:05 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1200873983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T20:04:05.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808850 got 287762808851 for osd.10 2024-05-08T20:04:05.688 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:05.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.723+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f818004ec60 con 0x7f8180105f00 2024-05-08T20:04:05.713 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.724+0000 7f817cff9700 1 -- 172.21.15.33:0/1540976301 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f817809b190 con 0x7f8180105f00 2024-05-08T20:04:05.713 INFO:teuthology.orchestra.run.smithi033.stdout:34359738424 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f81680a11b0 msgr2=0x7f81680a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f81680a11b0 0x7f81680a3670 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8170005950 tx=0x7f817000b410 comp rx=0 tx=0).stop 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180105f00 msgr2=0x7f818019beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180105f00 0x7f818019beb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81780095e0 tx=0x7f817800ce90 comp rx=0 tx=0).stop 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 shutdown_connections 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8180105f00 0x7f818019beb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81800ffed0 0x7f81801975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f81680a11b0 0x7f81680a3670 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 --2- 172.21.15.33:0/1540976301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8180100890 0x7f8180197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 >> 172.21.15.33:0/1540976301 conn(0x7f8180075f80 msgr2=0x7f81800ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 shutdown_connections 2024-05-08T20:04:05.716 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.726+0000 7f8185b87700 1 -- 172.21.15.33:0/1540976301 wait complete. 2024-05-08T20:04:05.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.983+0000 7f84247eb700 1 -- 172.21.15.33:0/2461590660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c0ffed0 msgr2=0x7f841c100350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.983+0000 7f84247eb700 1 --2- 172.21.15.33:0/2461590660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c0ffed0 0x7f841c100350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8410009990 tx=0x7f8410009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.973 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 -- 172.21.15.33:0/2461590660 shutdown_connections 2024-05-08T20:04:05.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 --2- 172.21.15.33:0/2461590660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f841c100890 0x7f841c10cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 --2- 172.21.15.33:0/2461590660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f841c105f00 0x7f841c1062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 --2- 172.21.15.33:0/2461590660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c0ffed0 0x7f841c100350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 -- 172.21.15.33:0/2461590660 >> 172.21.15.33:0/2461590660 conn(0x7f841c075f80 msgr2=0x7f841c076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:05.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 -- 172.21.15.33:0/2461590660 shutdown_connections 2024-05-08T20:04:05.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 -- 172.21.15.33:0/2461590660 wait complete. 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.984+0000 7f84247eb700 1 Processor -- start 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f84247eb700 1 -- start start 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f84247eb700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f841c0ffed0 0x7f841c1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f84247eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c100890 0x7f841c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f84247eb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f841c105f00 0x7f841c19bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f84247eb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c19c3b0 con 0x7f841c100890 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f84247eb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c19c520 con 0x7f841c105f00 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f84247eb700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c19c6e0 con 0x7f841c0ffed0 2024-05-08T20:04:05.975 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c100890 0x7f841c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c100890 0x7f841c1979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38586/0 (socket says 172.21.15.33:38586) 2024-05-08T20:04:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 -- 172.21.15.33:0/966208614 learned_addr learned my addr 172.21.15.33:0/966208614 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:05.976 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8422587700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f841c0ffed0 0x7f841c1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8422d88700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f841c105f00 0x7f841c19bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 -- 172.21.15.33:0/966208614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f841c0ffed0 msgr2=0x7f841c1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f841c0ffed0 0x7f841c1974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 -- 172.21.15.33:0/966208614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f841c105f00 msgr2=0x7f841c19bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f841c105f00 0x7f841c19bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.985+0000 7f8421d86700 1 -- 172.21.15.33:0/966208614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100095f0 con 0x7f841c100890 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.986+0000 7f8422d88700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f841c105f00 0x7f841c19bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.986+0000 7f8421d86700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c100890 0x7f841c1979f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8410005910 tx=0x7f8410004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.986+0000 7f840f7fe700 1 -- 172.21.15.33:0/966208614 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841001d070 con 0x7f841c100890 2024-05-08T20:04:05.979 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.986+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c19c960 con 0x7f841c100890 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.986+0000 7f840f7fe700 1 -- 172.21.15.33:0/966208614 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8410022470 con 0x7f841c100890 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.986+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c1a4220 con 0x7f841c100890 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.986+0000 7f840f7fe700 1 -- 172.21.15.33:0/966208614 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84100175f0 con 0x7f841c100890 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.987+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c1083a0 con 0x7f841c100890 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.988+0000 7f840f7fe700 1 -- 172.21.15.33:0/966208614 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f84100225e0 con 0x7f841c100890 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.989+0000 7f840f7fe700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84080a11b0 0x7f84080a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.989+0000 7f8422587700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84080a11b0 0x7f84080a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.989+0000 7f840f7fe700 1 -- 172.21.15.33:0/966208614 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f84100cddc0 con 0x7f841c100890 2024-05-08T20:04:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.989+0000 7f8422587700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84080a11b0 0x7f84080a3670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8418005950 tx=0x7f841800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:05.992+0000 7f840f7fe700 1 -- 172.21.15.33:0/966208614 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8410097630 con 0x7f841c100890 2024-05-08T20:04:06.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430237 got 206158430238 for osd.7 2024-05-08T20:04:06.067 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:06.088 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201305 got 236223201306 for osd.8 2024-05-08T20:04:06.088 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.219+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f841c1015b0 con 0x7f841c100890 2024-05-08T20:04:06.209 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.220+0000 7f840f7fe700 1 -- 172.21.15.33:0/966208614 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f841009ac50 con 0x7f841c100890 2024-05-08T20:04:06.210 INFO:teuthology.orchestra.run.smithi033.stdout:154618822694 2024-05-08T20:04:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84080a11b0 msgr2=0x7f84080a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:06.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84080a11b0 0x7f84080a3670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8418005950 tx=0x7f841800b410 comp rx=0 tx=0).stop 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c100890 msgr2=0x7f841c1979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c100890 0x7f841c1979f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8410005910 tx=0x7f8410004730 comp rx=0 tx=0).stop 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 shutdown_connections 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f841c105f00 0x7f841c19bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f84080a11b0 0x7f84080a3670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f841c0ffed0 0x7f841c1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 --2- 172.21.15.33:0/966208614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f841c100890 0x7f841c1979f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 >> 172.21.15.33:0/966208614 conn(0x7f841c075f80 msgr2=0x7f841c0fed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 shutdown_connections 2024-05-08T20:04:06.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.222+0000 7f84247eb700 1 -- 172.21.15.33:0/966208614 wait complete. 2024-05-08T20:04:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:06 smithi033 ceph-mon[42490]: pgmap v239: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T20:04:06.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:06 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1540976301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 -- 172.21.15.33:0/924090236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 msgr2=0x7f89a81062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 --2- 172.21.15.33:0/924090236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a81062e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f89a000b0a0 tx=0x7f89a000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 -- 172.21.15.33:0/924090236 shutdown_connections 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 --2- 172.21.15.33:0/924090236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89a8100890 0x7f89a810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 --2- 172.21.15.33:0/924090236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a81062e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 --2- 172.21.15.33:0/924090236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a80ffed0 0x7f89a8100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 -- 172.21.15.33:0/924090236 >> 172.21.15.33:0/924090236 conn(0x7f89a8075f80 msgr2=0x7f89a8076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 -- 172.21.15.33:0/924090236 shutdown_connections 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 -- 172.21.15.33:0/924090236 wait complete. 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 Processor -- start 2024-05-08T20:04:06.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.403+0000 7f89af12c700 1 -- start start 2024-05-08T20:04:06.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89af12c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89a80ffed0 0x7f89a8197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:06.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89af12c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a8100890 0x7f89a8197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89af12c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89af12c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a819c480 con 0x7f89a8105f00 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89af12c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a819c5f0 con 0x7f89a80ffed0 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89af12c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a819c7b0 con 0x7f89a8100890 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a819be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38602/0 (socket says 172.21.15.33:38602) 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 -- 172.21.15.33:0/1772977774 learned_addr learned my addr 172.21.15.33:0/1772977774 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89acec8700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89a80ffed0 0x7f89a8197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89a7fff700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a8100890 0x7f89a8197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 -- 172.21.15.33:0/1772977774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a8100890 msgr2=0x7f89a8197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a8100890 0x7f89a8197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 -- 172.21.15.33:0/1772977774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89a80ffed0 msgr2=0x7f89a8197580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89a80ffed0 0x7f89a8197580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 -- 172.21.15.33:0/1772977774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0009d00 con 0x7f89a8105f00 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89acec8700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89a80ffed0 0x7f89a8197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89a7fff700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a8100890 0x7f89a8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.404+0000 7f89ad6c9700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a819be70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f899800c900 tx=0x7f899800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.405+0000 7f89a5ffb700 1 -- 172.21.15.33:0/1772977774 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998007b00 con 0x7f89a8105f00 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.405+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a819ca90 con 0x7f89a8105f00 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.405+0000 7f89a5ffb700 1 -- 172.21.15.33:0/1772977774 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8998007c60 con 0x7f89a8105f00 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.405+0000 7f89a5ffb700 1 -- 172.21.15.33:0/1772977774 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8998018660 con 0x7f89a8105f00 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.405+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a81a42f0 con 0x7f89a8105f00 2024-05-08T20:04:06.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.406+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a81015b0 con 0x7f89a8105f00 2024-05-08T20:04:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.407+0000 7f89a5ffb700 1 -- 172.21.15.33:0/1772977774 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f899800f450 con 0x7f89a8105f00 2024-05-08T20:04:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.408+0000 7f89a5ffb700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f89900a11b0 0x7f89900a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.408+0000 7f89acec8700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f89900a11b0 0x7f89900a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.408+0000 7f89a5ffb700 1 -- 172.21.15.33:0/1772977774 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f89980cc850 con 0x7f89a8105f00 2024-05-08T20:04:06.399 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.408+0000 7f89acec8700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f89900a11b0 0x7f89900a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009cd0 tx=0x7f89a0009c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:06.402 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.413+0000 7f89a5ffb700 1 -- 172.21.15.33:0/1772977774 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8998096030 con 0x7f89a8105f00 2024-05-08T20:04:06.554 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738422 got 34359738424 for osd.0 2024-05-08T20:04:06.555 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:06.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.628+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f89a8198890 con 0x7f89a8105f00 2024-05-08T20:04:06.618 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.629+0000 7f89a5ffb700 1 -- 172.21.15.33:0/1772977774 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f8998099650 con 0x7f89a8105f00 2024-05-08T20:04:06.618 INFO:teuthology.orchestra.run.smithi033.stdout:266287972375 2024-05-08T20:04:06.620 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f89900a11b0 msgr2=0x7f89900a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f89900a11b0 0x7f89900a3670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009cd0 tx=0x7f89a0009c60 comp rx=0 tx=0).stop 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 msgr2=0x7f89a819be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a819be70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f899800c900 tx=0x7f899800ccc0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 shutdown_connections 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89a8105f00 0x7f89a819be70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89a80ffed0 0x7f89a8197580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f89900a11b0 0x7f89900a3670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 --2- 172.21.15.33:0/1772977774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a8100890 0x7f89a8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 >> 172.21.15.33:0/1772977774 conn(0x7f89a8075f80 msgr2=0x7f89a80ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 shutdown_connections 2024-05-08T20:04:06.621 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:06.631+0000 7f89af12c700 1 -- 172.21.15.33:0/1772977774 wait complete. 2024-05-08T20:04:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:06 smithi082 ceph-mon[46774]: pgmap v239: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T20:04:06.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:06 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1540976301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T20:04:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:06 smithi132 ceph-mon[47484]: pgmap v239: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 7 op/s 2024-05-08T20:04:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:06 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1540976301' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T20:04:06.690 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822692 got 154618822694 for osd.5 2024-05-08T20:04:06.691 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:07.002 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972374 got 266287972375 for osd.9 2024-05-08T20:04:07.002 DEBUG:teuthology.parallel:result is None 2024-05-08T20:04:07.005 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T20:04:07.005 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T20:04:07.265 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:07.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:07 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/966208614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T20:04:07.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:07 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1772977774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T20:04:07.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:07 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/966208614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T20:04:07.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:07 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1772977774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T20:04:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:07 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/966208614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T20:04:07.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:07 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1772977774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T20:04:08.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.499+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2216619388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 msgr2=0x7ff9ac105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:08.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.499+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2216619388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac105bd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009990 tx=0x7ff9a8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.499+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2216619388 shutdown_connections 2024-05-08T20:04:08.492 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.499+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2216619388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ac1062b0 0x7ff9ac10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.499+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2216619388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9ac101250 0x7ff9ac101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.499+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2216619388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac105bd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.499+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2216619388 >> 172.21.15.33:0/2216619388 conn(0x7ff9ac078100 msgr2=0x7ff9ac078510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.500+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2216619388 shutdown_connections 2024-05-08T20:04:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.500+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2216619388 wait complete. 2024-05-08T20:04:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.500+0000 7ff9b47e5700 1 Processor -- start 2024-05-08T20:04:08.493 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.500+0000 7ff9b47e5700 1 -- start start 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.500+0000 7ff9b47e5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9ac101250 0x7ff9ac197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.500+0000 7ff9b47e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.500+0000 7ff9b47e5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ac1062b0 0x7ff9ac19bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b47e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac19c390 con 0x7ff9ac101c00 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b47e5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac19c500 con 0x7ff9ac1062b0 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b47e5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac19c6c0 con 0x7ff9ac101250 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:08.494 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac1979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38620/0 (socket says 172.21.15.33:38620) 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 -- 172.21.15.33:0/2786240103 learned_addr learned my addr 172.21.15.33:0/2786240103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b2d82700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ac1062b0 0x7ff9ac19bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b2581700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9ac101250 0x7ff9ac197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 -- 172.21.15.33:0/2786240103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9ac101250 msgr2=0x7ff9ac197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9ac101250 0x7ff9ac197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 -- 172.21.15.33:0/2786240103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ac1062b0 msgr2=0x7ff9ac19bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ac1062b0 0x7ff9ac19bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.495 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 -- 172.21.15.33:0/2786240103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a80095f0 con 0x7ff9ac101c00 2024-05-08T20:04:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b1d80700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac1979d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8000c00 tx=0x7ff9a800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9a37fe700 1 -- 172.21.15.33:0/2786240103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a801d070 con 0x7ff9ac101c00 2024-05-08T20:04:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9a37fe700 1 -- 172.21.15.33:0/2786240103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff9a8003680 con 0x7ff9ac101c00 2024-05-08T20:04:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac19c940 con 0x7ff9ac101c00 2024-05-08T20:04:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.501+0000 7ff9a37fe700 1 -- 172.21.15.33:0/2786240103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a80173f0 con 0x7ff9ac101c00 2024-05-08T20:04:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.502+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac1a4200 con 0x7ff9ac101c00 2024-05-08T20:04:08.496 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.502+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac1095d0 con 0x7ff9ac101c00 2024-05-08T20:04:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.504+0000 7ff9a37fe700 1 -- 172.21.15.33:0/2786240103 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff9a8022600 con 0x7ff9ac101c00 2024-05-08T20:04:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.504+0000 7ff9a37fe700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff9980a1230 0x7ff9980a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.505+0000 7ff9a37fe700 1 -- 172.21.15.33:0/2786240103 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff9a80cdba0 con 0x7ff9ac101c00 2024-05-08T20:04:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.505+0000 7ff9b2581700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff9980a1230 0x7ff9980a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.505+0000 7ff9b2581700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff9980a1230 0x7ff9980a36f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff99c005950 tx=0x7ff99c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:08.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.508+0000 7ff9a37fe700 1 -- 172.21.15.33:0/2786240103 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff9a8097530 con 0x7ff9ac101c00 2024-05-08T20:04:08.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:08 smithi033 ceph-mon[42490]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T20:04:08.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:08 smithi082 ceph-mon[46774]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T20:04:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:08 smithi132 ceph-mon[47484]: pgmap v240: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-05-08T20:04:08.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.714+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9ac1987a0 con 0x7ff9980a1230 2024-05-08T20:04:08.714 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.725+0000 7ff9a37fe700 1 -- 172.21.15.33:0/2786240103 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340917 (secure 0 0 0) 0x7ff9ac1987a0 con 0x7ff9980a1230 2024-05-08T20:04:08.721 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:08.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff9980a1230 msgr2=0x7ff9980a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:08.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff9980a1230 0x7ff9980a36f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff99c005950 tx=0x7ff99c00a300 comp rx=0 tx=0).stop 2024-05-08T20:04:08.724 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 msgr2=0x7ff9ac1979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac1979d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8000c00 tx=0x7ff9a800f710 comp rx=0 tx=0).stop 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 shutdown_connections 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9ac1062b0 0x7ff9ac19bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff9980a1230 0x7ff9980a36f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9ac101250 0x7ff9ac197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 --2- 172.21.15.33:0/2786240103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ac101c00 0x7ff9ac1979d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 >> 172.21.15.33:0/2786240103 conn(0x7ff9ac078100 msgr2=0x7ff9ac100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 shutdown_connections 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:08.729+0000 7ff9b47e5700 1 -- 172.21.15.33:0/2786240103 wait complete. 2024-05-08T20:04:08.725 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T20:04:09.094 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-05-08T20:04:07.122639+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651577,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":341,"num_read_kb":286,"num_write":332,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355344,"kb_used_data":10668,"kb_used_omap":18,"kb_used_meta":344557,"kb_avail":1124586480,"statfs":{"total":1151940427776,"available":1151576555520,"internally_reserved":0,"allocated":10924032,"data_stored":6943722,"data_compressed":112686,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19130,"internal_metadata":352826694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":26,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003411"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183880+0000","last_change":"2024-05-08T20:03:29.696040+0000","last_active":"2024-05-08T20:03:32.183880+0000","last_peered":"2024-05-08T20:03:32.183880+0000","last_clean":"2024-05-08T20:03:32.183880+0000","last_became_active":"2024-05-08T20:03:29.695312+0000","last_became_peered":"2024-05-08T20:03:29.695312+0000","last_unstale":"2024-05-08T20:03:32.183880+0000","last_undegraded":"2024-05-08T20:03:32.183880+0000","last_fullsized":"2024-05-08T20:03:32.183880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:05.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790102+0000","last_change":"2024-05-08T20:03:29.681157+0000","last_active":"2024-05-08T20:03:31.790102+0000","last_peered":"2024-05-08T20:03:31.790102+0000","last_clean":"2024-05-08T20:03:31.790102+0000","last_became_active":"2024-05-08T20:03:29.680796+0000","last_became_peered":"2024-05-08T20:03:29.680796+0000","last_unstale":"2024-05-08T20:03:31.790102+0000","last_undegraded":"2024-05-08T20:03:31.790102+0000","last_fullsized":"2024-05-08T20:03:31.790102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:49.112158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790228+0000","last_change":"2024-05-08T20:03:29.686199+0000","last_active":"2024-05-08T20:03:31.790228+0000","last_peered":"2024-05-08T20:03:31.790228+0000","last_clean":"2024-05-08T20:03:31.790228+0000","last_became_active":"2024-05-08T20:03:29.685871+0000","last_became_peered":"2024-05-08T20:03:29.685871+0000","last_unstale":"2024-05-08T20:03:31.790228+0000","last_undegraded":"2024-05-08T20:03:31.790228+0000","last_fullsized":"2024-05-08T20:03:31.790228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:45.835061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671020+0000","last_change":"2024-05-08T20:03:29.690931+0000","last_active":"2024-05-08T20:03:30.671020+0000","last_peered":"2024-05-08T20:03:30.671020+0000","last_clean":"2024-05-08T20:03:30.671020+0000","last_became_active":"2024-05-08T20:03:29.690165+0000","last_became_peered":"2024-05-08T20:03:29.690165+0000","last_unstale":"2024-05-08T20:03:30.671020+0000","last_undegraded":"2024-05-08T20:03:30.671020+0000","last_fullsized":"2024-05-08T20:03:30.671020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:25.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790306+0000","last_change":"2024-05-08T20:03:29.675018+0000","last_active":"2024-05-08T20:03:31.790306+0000","last_peered":"2024-05-08T20:03:31.790306+0000","last_clean":"2024-05-08T20:03:31.790306+0000","last_became_active":"2024-05-08T20:03:29.674714+0000","last_became_peered":"2024-05-08T20:03:29.674714+0000","last_unstale":"2024-05-08T20:03:31.790306+0000","last_undegraded":"2024-05-08T20:03:31.790306+0000","last_fullsized":"2024-05-08T20:03:31.790306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:10.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791669+0000","last_change":"2024-05-08T20:03:29.679134+0000","last_active":"2024-05-08T20:03:31.791669+0000","last_peered":"2024-05-08T20:03:31.791669+0000","last_clean":"2024-05-08T20:03:31.791669+0000","last_became_active":"2024-05-08T20:03:29.678853+0000","last_became_peered":"2024-05-08T20:03:29.678853+0000","last_unstale":"2024-05-08T20:03:31.791669+0000","last_undegraded":"2024-05-08T20:03:31.791669+0000","last_fullsized":"2024-05-08T20:03:31.791669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:48.104195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346770+0000","last_change":"2024-05-08T20:03:29.679907+0000","last_active":"2024-05-08T20:03:30.346770+0000","last_peered":"2024-05-08T20:03:30.346770+0000","last_clean":"2024-05-08T20:03:30.346770+0000","last_became_active":"2024-05-08T20:03:29.679565+0000","last_became_peered":"2024-05-08T20:03:29.679565+0000","last_unstale":"2024-05-08T20:03:30.346770+0000","last_undegraded":"2024-05-08T20:03:30.346770+0000","last_fullsized":"2024-05-08T20:03:30.346770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:37.570557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878114+0000","last_change":"2024-05-08T20:03:29.677113+0000","last_active":"2024-05-08T20:03:29.878114+0000","last_peered":"2024-05-08T20:03:29.878114+0000","last_clean":"2024-05-08T20:03:29.878114+0000","last_became_active":"2024-05-08T20:03:29.676762+0000","last_became_peered":"2024-05-08T20:03:29.676762+0000","last_unstale":"2024-05-08T20:03:29.878114+0000","last_undegraded":"2024-05-08T20:03:29.878114+0000","last_fullsized":"2024-05-08T20:03:29.878114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:38.051229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301745+0000","last_change":"2024-05-08T20:03:29.687614+0000","last_active":"2024-05-08T20:03:30.301745+0000","last_peered":"2024-05-08T20:03:30.301745+0000","last_clean":"2024-05-08T20:03:30.301745+0000","last_became_active":"2024-05-08T20:03:29.687288+0000","last_became_peered":"2024-05-08T20:03:29.687288+0000","last_unstale":"2024-05-08T20:03:30.301745+0000","last_undegraded":"2024-05-08T20:03:30.301745+0000","last_fullsized":"2024-05-08T20:03:30.301745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:33.785307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790877+0000","last_change":"2024-05-08T20:03:29.685462+0000","last_active":"2024-05-08T20:03:31.790877+0000","last_peered":"2024-05-08T20:03:31.790877+0000","last_clean":"2024-05-08T20:03:31.790877+0000","last_became_active":"2024-05-08T20:03:29.685133+0000","last_became_peered":"2024-05-08T20:03:29.685133+0000","last_unstale":"2024-05-08T20:03:31.790877+0000","last_undegraded":"2024-05-08T20:03:31.790877+0000","last_fullsized":"2024-05-08T20:03:31.790877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:56.104253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346843+0000","last_change":"2024-05-08T20:03:29.690183+0000","last_active":"2024-05-08T20:03:30.346843+0000","last_peered":"2024-05-08T20:03:30.346843+0000","last_clean":"2024-05-08T20:03:30.346843+0000","last_became_active":"2024-05-08T20:03:29.689740+0000","last_became_peered":"2024-05-08T20:03:29.689740+0000","last_unstale":"2024-05-08T20:03:30.346843+0000","last_undegraded":"2024-05-08T20:03:30.346843+0000","last_fullsized":"2024-05-08T20:03:30.346843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:02.975916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671000+0000","last_change":"2024-05-08T20:03:29.690717+0000","last_active":"2024-05-08T20:03:30.671000+0000","last_peered":"2024-05-08T20:03:30.671000+0000","last_clean":"2024-05-08T20:03:30.671000+0000","last_became_active":"2024-05-08T20:03:29.689845+0000","last_became_peered":"2024-05-08T20:03:29.689845+0000","last_unstale":"2024-05-08T20:03:30.671000+0000","last_undegraded":"2024-05-08T20:03:30.671000+0000","last_fullsized":"2024-05-08T20:03:30.671000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:58.105656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.679134+0000","last_change":"2024-05-08T20:03:29.678031+0000","last_active":"2024-05-08T20:03:29.679134+0000","last_peered":"2024-05-08T20:03:29.679134+0000","last_clean":"2024-05-08T20:03:29.679134+0000","last_became_active":"2024-05-08T20:03:29.677711+0000","last_became_peered":"2024-05-08T20:03:29.677711+0000","last_unstale":"2024-05-08T20:03:29.679134+0000","last_undegraded":"2024-05-08T20:03:29.679134+0000","last_fullsized":"2024-05-08T20:03:29.679134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:44.432527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789896+0000","last_change":"2024-05-08T20:03:29.681551+0000","last_active":"2024-05-08T20:03:31.789896+0000","last_peered":"2024-05-08T20:03:31.789896+0000","last_clean":"2024-05-08T20:03:31.789896+0000","last_became_active":"2024-05-08T20:03:29.680558+0000","last_became_peered":"2024-05-08T20:03:29.680558+0000","last_unstale":"2024-05-08T20:03:31.789896+0000","last_undegraded":"2024-05-08T20:03:31.789896+0000","last_fullsized":"2024-05-08T20:03:31.789896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:40.976066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789942+0000","last_change":"2024-05-08T20:03:29.682503+0000","last_active":"2024-05-08T20:03:31.789942+0000","last_peered":"2024-05-08T20:03:31.789942+0000","last_clean":"2024-05-08T20:03:31.789942+0000","last_became_active":"2024-05-08T20:03:29.675083+0000","last_became_peered":"2024-05-08T20:03:29.675083+0000","last_unstale":"2024-05-08T20:03:31.789942+0000","last_undegraded":"2024-05-08T20:03:31.789942+0000","last_fullsized":"2024-05-08T20:03:31.789942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:19.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301652+0000","last_change":"2024-05-08T20:03:29.693087+0000","last_active":"2024-05-08T20:03:30.301652+0000","last_peered":"2024-05-08T20:03:30.301652+0000","last_clean":"2024-05-08T20:03:30.301652+0000","last_became_active":"2024-05-08T20:03:29.692824+0000","last_became_peered":"2024-05-08T20:03:29.692824+0000","last_unstale":"2024-05-08T20:03:30.301652+0000","last_undegraded":"2024-05-08T20:03:30.301652+0000","last_fullsized":"2024-05-08T20:03:30.301652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:58.653115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183892+0000","last_change":"2024-05-08T20:03:29.696363+0000","last_active":"2024-05-08T20:03:32.183892+0000","last_peered":"2024-05-08T20:03:32.183892+0000","last_clean":"2024-05-08T20:03:32.183892+0000","last_became_active":"2024-05-08T20:03:29.695742+0000","last_became_peered":"2024-05-08T20:03:29.695742+0000","last_unstale":"2024-05-08T20:03:32.183892+0000","last_undegraded":"2024-05-08T20:03:32.183892+0000","last_fullsized":"2024-05-08T20:03:32.183892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:34.085822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857275+0000","last_change":"2024-05-08T20:03:29.680245+0000","last_active":"2024-05-08T20:03:30.857275+0000","last_peered":"2024-05-08T20:03:30.857275+0000","last_clean":"2024-05-08T20:03:30.857275+0000","last_became_active":"2024-05-08T20:03:29.679921+0000","last_became_peered":"2024-05-08T20:03:29.679921+0000","last_unstale":"2024-05-08T20:03:30.857275+0000","last_undegraded":"2024-05-08T20:03:30.857275+0000","last_fullsized":"2024-05-08T20:03:30.857275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:31.013564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466500+0000","last_change":"2024-05-08T20:03:29.680303+0000","last_active":"2024-05-08T20:03:31.466500+0000","last_peered":"2024-05-08T20:03:31.466500+0000","last_clean":"2024-05-08T20:03:31.466500+0000","last_became_active":"2024-05-08T20:03:29.679406+0000","last_became_peered":"2024-05-08T20:03:29.679406+0000","last_unstale":"2024-05-08T20:03:31.466500+0000","last_undegraded":"2024-05-08T20:03:31.466500+0000","last_fullsized":"2024-05-08T20:03:31.466500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:44.353488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018724+0000","last_change":"2024-05-08T20:03:29.159444+0000","last_active":"2024-05-08T20:03:34.018724+0000","last_peered":"2024-05-08T20:03:34.018724+0000","last_clean":"2024-05-08T20:03:34.018724+0000","last_became_active":"2024-05-08T20:03:29.159024+0000","last_became_peered":"2024-05-08T20:03:29.159024+0000","last_unstale":"2024-05-08T20:03:34.018724+0000","last_undegraded":"2024-05-08T20:03:34.018724+0000","last_fullsized":"2024-05-08T20:03:34.018724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:49.855043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878188+0000","last_change":"2024-05-08T20:03:29.679721+0000","last_active":"2024-05-08T20:03:29.878188+0000","last_peered":"2024-05-08T20:03:29.878188+0000","last_clean":"2024-05-08T20:03:29.878188+0000","last_became_active":"2024-05-08T20:03:29.679424+0000","last_became_peered":"2024-05-08T20:03:29.679424+0000","last_unstale":"2024-05-08T20:03:29.878188+0000","last_undegraded":"2024-05-08T20:03:29.878188+0000","last_fullsized":"2024-05-08T20:03:29.878188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:21.133074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790826+0000","last_change":"2024-05-08T20:03:29.169000+0000","last_active":"2024-05-08T20:03:31.790826+0000","last_peered":"2024-05-08T20:03:31.790826+0000","last_clean":"2024-05-08T20:03:31.790826+0000","last_became_active":"2024-05-08T20:03:29.164576+0000","last_became_peered":"2024-05-08T20:03:29.164576+0000","last_unstale":"2024-05-08T20:03:31.790826+0000","last_undegraded":"2024-05-08T20:03:31.790826+0000","last_fullsized":"2024-05-08T20:03:31.790826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:19.961768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790561+0000","last_change":"2024-05-08T20:03:29.686350+0000","last_active":"2024-05-08T20:03:31.790561+0000","last_peered":"2024-05-08T20:03:31.790561+0000","last_clean":"2024-05-08T20:03:31.790561+0000","last_became_active":"2024-05-08T20:03:29.686016+0000","last_became_peered":"2024-05-08T20:03:29.686016+0000","last_unstale":"2024-05-08T20:03:31.790561+0000","last_undegraded":"2024-05-08T20:03:31.790561+0000","last_fullsized":"2024-05-08T20:03:31.790561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:18.727685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.019031+0000","last_change":"2024-05-08T20:03:29.161691+0000","last_active":"2024-05-08T20:03:34.019031+0000","last_peered":"2024-05-08T20:03:34.019031+0000","last_clean":"2024-05-08T20:03:34.019031+0000","last_became_active":"2024-05-08T20:03:29.161328+0000","last_became_peered":"2024-05-08T20:03:29.161328+0000","last_unstale":"2024-05-08T20:03:34.019031+0000","last_undegraded":"2024-05-08T20:03:34.019031+0000","last_fullsized":"2024-05-08T20:03:34.019031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:08.183440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301699+0000","last_change":"2024-05-08T20:03:29.688528+0000","last_active":"2024-05-08T20:03:30.301699+0000","last_peered":"2024-05-08T20:03:30.301699+0000","last_clean":"2024-05-08T20:03:30.301699+0000","last_became_active":"2024-05-08T20:03:29.688211+0000","last_became_peered":"2024-05-08T20:03:29.688211+0000","last_unstale":"2024-05-08T20:03:30.301699+0000","last_undegraded":"2024-05-08T20:03:30.301699+0000","last_fullsized":"2024-05-08T20:03:30.301699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:01.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694883+0000","last_change":"2024-05-08T20:03:29.158484+0000","last_active":"2024-05-08T20:03:29.694883+0000","last_peered":"2024-05-08T20:03:29.694883+0000","last_clean":"2024-05-08T20:03:29.694883+0000","last_became_active":"2024-05-08T20:03:29.158116+0000","last_became_peered":"2024-05-08T20:03:29.158116+0000","last_unstale":"2024-05-08T20:03:29.694883+0000","last_undegraded":"2024-05-08T20:03:29.694883+0000","last_fullsized":"2024-05-08T20:03:29.694883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:13.955725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670971+0000","last_change":"2024-05-08T20:03:29.688895+0000","last_active":"2024-05-08T20:03:30.670971+0000","last_peered":"2024-05-08T20:03:30.670971+0000","last_clean":"2024-05-08T20:03:30.670971+0000","last_became_active":"2024-05-08T20:03:29.688571+0000","last_became_peered":"2024-05-08T20:03:29.688571+0000","last_unstale":"2024-05-08T20:03:30.670971+0000","last_undegraded":"2024-05-08T20:03:30.670971+0000","last_fullsized":"2024-05-08T20:03:30.670971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:19.722428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":49,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:02.047649+0000","last_change":"2024-05-08T20:03:29.159927+0000","last_active":"2024-05-08T20:04:02.047649+0000","last_peered":"2024-05-08T20:04:02.047649+0000","last_clean":"2024-05-08T20:04:02.047649+0000","last_became_active":"2024-05-08T20:03:29.159608+0000","last_became_peered":"2024-05-08T20:03:29.159608+0000","last_unstale":"2024-05-08T20:04:02.047649+0000","last_undegraded":"2024-05-08T20:04:02.047649+0000","last_fullsized":"2024-05-08T20:04:02.047649+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:17.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790183+0000","last_change":"2024-05-08T20:03:29.676181+0000","last_active":"2024-05-08T20:03:31.790183+0000","last_peered":"2024-05-08T20:03:31.790183+0000","last_clean":"2024-05-08T20:03:31.790183+0000","last_became_active":"2024-05-08T20:03:29.675823+0000","last_became_peered":"2024-05-08T20:03:29.675823+0000","last_unstale":"2024-05-08T20:03:31.790183+0000","last_undegraded":"2024-05-08T20:03:31.790183+0000","last_fullsized":"2024-05-08T20:03:31.790183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:42.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018299+0000","last_change":"2024-05-08T20:03:29.156803+0000","last_active":"2024-05-08T20:03:34.018299+0000","last_peered":"2024-05-08T20:03:34.018299+0000","last_clean":"2024-05-08T20:03:34.018299+0000","last_became_active":"2024-05-08T20:03:29.156114+0000","last_became_peered":"2024-05-08T20:03:29.156114+0000","last_unstale":"2024-05-08T20:03:34.018299+0000","last_undegraded":"2024-05-08T20:03:34.018299+0000","last_fullsized":"2024-05-08T20:03:34.018299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:11.964529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670789+0000","last_change":"2024-05-08T20:03:29.677259+0000","last_active":"2024-05-08T20:03:30.670789+0000","last_peered":"2024-05-08T20:03:30.670789+0000","last_clean":"2024-05-08T20:03:30.670789+0000","last_became_active":"2024-05-08T20:03:29.676885+0000","last_became_peered":"2024-05-08T20:03:29.676885+0000","last_unstale":"2024-05-08T20:03:30.670789+0000","last_undegraded":"2024-05-08T20:03:30.670789+0000","last_fullsized":"2024-05-08T20:03:30.670789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:18.152813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018316+0000","last_change":"2024-05-08T20:03:29.162317+0000","last_active":"2024-05-08T20:03:34.018316+0000","last_peered":"2024-05-08T20:03:34.018316+0000","last_clean":"2024-05-08T20:03:34.018316+0000","last_became_active":"2024-05-08T20:03:29.161961+0000","last_became_peered":"2024-05-08T20:03:29.161961+0000","last_unstale":"2024-05-08T20:03:34.018316+0000","last_undegraded":"2024-05-08T20:03:34.018316+0000","last_fullsized":"2024-05-08T20:03:34.018316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:36.379021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878091+0000","last_change":"2024-05-08T20:03:29.672527+0000","last_active":"2024-05-08T20:03:29.878091+0000","last_peered":"2024-05-08T20:03:29.878091+0000","last_clean":"2024-05-08T20:03:29.878091+0000","last_became_active":"2024-05-08T20:03:29.672199+0000","last_became_peered":"2024-05-08T20:03:29.672199+0000","last_unstale":"2024-05-08T20:03:29.878091+0000","last_undegraded":"2024-05-08T20:03:29.878091+0000","last_fullsized":"2024-05-08T20:03:29.878091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:47.833015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670738+0000","last_change":"2024-05-08T20:03:29.160639+0000","last_active":"2024-05-08T20:03:30.670738+0000","last_peered":"2024-05-08T20:03:30.670738+0000","last_clean":"2024-05-08T20:03:30.670738+0000","last_became_active":"2024-05-08T20:03:29.160291+0000","last_became_peered":"2024-05-08T20:03:29.160291+0000","last_unstale":"2024-05-08T20:03:30.670738+0000","last_undegraded":"2024-05-08T20:03:30.670738+0000","last_fullsized":"2024-05-08T20:03:30.670738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:56.126764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857096+0000","last_change":"2024-05-08T20:03:29.677339+0000","last_active":"2024-05-08T20:03:30.857096+0000","last_peered":"2024-05-08T20:03:30.857096+0000","last_clean":"2024-05-08T20:03:30.857096+0000","last_became_active":"2024-05-08T20:03:29.676954+0000","last_became_peered":"2024-05-08T20:03:29.676954+0000","last_unstale":"2024-05-08T20:03:30.857096+0000","last_undegraded":"2024-05-08T20:03:30.857096+0000","last_fullsized":"2024-05-08T20:03:30.857096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":45,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:02.047126+0000","last_change":"2024-05-08T20:03:29.156873+0000","last_active":"2024-05-08T20:04:02.047126+0000","last_peered":"2024-05-08T20:04:02.047126+0000","last_clean":"2024-05-08T20:04:02.047126+0000","last_became_active":"2024-05-08T20:03:29.156130+0000","last_became_peered":"2024-05-08T20:03:29.156130+0000","last_unstale":"2024-05-08T20:04:02.047126+0000","last_undegraded":"2024-05-08T20:04:02.047126+0000","last_fullsized":"2024-05-08T20:04:02.047126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:31.410319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301731+0000","last_change":"2024-05-08T20:03:29.680591+0000","last_active":"2024-05-08T20:03:30.301731+0000","last_peered":"2024-05-08T20:03:30.301731+0000","last_clean":"2024-05-08T20:03:30.301731+0000","last_became_active":"2024-05-08T20:03:29.680311+0000","last_became_peered":"2024-05-08T20:03:29.680311+0000","last_unstale":"2024-05-08T20:03:30.301731+0000","last_undegraded":"2024-05-08T20:03:30.301731+0000","last_fullsized":"2024-05-08T20:03:30.301731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:51.343586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049047+0000","last_change":"2024-05-08T20:03:29.165504+0000","last_active":"2024-05-08T20:03:33.049047+0000","last_peered":"2024-05-08T20:03:33.049047+0000","last_clean":"2024-05-08T20:03:33.049047+0000","last_became_active":"2024-05-08T20:03:29.164251+0000","last_became_peered":"2024-05-08T20:03:29.164251+0000","last_unstale":"2024-05-08T20:03:33.049047+0000","last_undegraded":"2024-05-08T20:03:33.049047+0000","last_fullsized":"2024-05-08T20:03:33.049047+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:51.771014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790469+0000","last_change":"2024-05-08T20:03:29.684880+0000","last_active":"2024-05-08T20:03:31.790469+0000","last_peered":"2024-05-08T20:03:31.790469+0000","last_clean":"2024-05-08T20:03:31.790469+0000","last_became_active":"2024-05-08T20:03:29.683216+0000","last_became_peered":"2024-05-08T20:03:29.683216+0000","last_unstale":"2024-05-08T20:03:31.790469+0000","last_undegraded":"2024-05-08T20:03:31.790469+0000","last_fullsized":"2024-05-08T20:03:31.790469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:12.695393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049436+0000","last_change":"2024-05-08T20:03:29.157211+0000","last_active":"2024-05-08T20:03:33.049436+0000","last_peered":"2024-05-08T20:03:33.049436+0000","last_clean":"2024-05-08T20:03:33.049436+0000","last_became_active":"2024-05-08T20:03:29.156761+0000","last_became_peered":"2024-05-08T20:03:29.156761+0000","last_unstale":"2024-05-08T20:03:33.049436+0000","last_undegraded":"2024-05-08T20:03:33.049436+0000","last_fullsized":"2024-05-08T20:03:33.049436+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:27.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301709+0000","last_change":"2024-05-08T20:03:29.686949+0000","last_active":"2024-05-08T20:03:30.301709+0000","last_peered":"2024-05-08T20:03:30.301709+0000","last_clean":"2024-05-08T20:03:30.301709+0000","last_became_active":"2024-05-08T20:03:29.686634+0000","last_became_peered":"2024-05-08T20:03:29.686634+0000","last_unstale":"2024-05-08T20:03:30.301709+0000","last_undegraded":"2024-05-08T20:03:30.301709+0000","last_fullsized":"2024-05-08T20:03:30.301709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:27.560636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'27","reported_seq":106,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:03.048179+0000","last_change":"2024-05-08T20:03:29.156991+0000","last_active":"2024-05-08T20:04:03.048179+0000","last_peered":"2024-05-08T20:04:03.048179+0000","last_clean":"2024-05-08T20:04:03.048179+0000","last_became_active":"2024-05-08T20:03:29.156570+0000","last_became_peered":"2024-05-08T20:03:29.156570+0000","last_unstale":"2024-05-08T20:04:03.048179+0000","last_undegraded":"2024-05-08T20:04:03.048179+0000","last_fullsized":"2024-05-08T20:04:03.048179+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:05.001469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57068,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":88,"num_write":28,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790529+0000","last_change":"2024-05-08T20:03:29.684822+0000","last_active":"2024-05-08T20:03:31.790529+0000","last_peered":"2024-05-08T20:03:31.790529+0000","last_clean":"2024-05-08T20:03:31.790529+0000","last_became_active":"2024-05-08T20:03:29.684455+0000","last_became_peered":"2024-05-08T20:03:29.684455+0000","last_unstale":"2024-05-08T20:03:31.790529+0000","last_undegraded":"2024-05-08T20:03:31.790529+0000","last_fullsized":"2024-05-08T20:03:31.790529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:28.982158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.017697+0000","last_change":"2024-05-08T20:03:29.165831+0000","last_active":"2024-05-08T20:03:34.017697+0000","last_peered":"2024-05-08T20:03:34.017697+0000","last_clean":"2024-05-08T20:03:34.017697+0000","last_became_active":"2024-05-08T20:03:29.165493+0000","last_became_peered":"2024-05-08T20:03:29.165493+0000","last_unstale":"2024-05-08T20:03:34.017697+0000","last_undegraded":"2024-05-08T20:03:34.017697+0000","last_fullsized":"2024-05-08T20:03:34.017697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:56.507752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678998+0000","last_change":"2024-05-08T20:03:29.675564+0000","last_active":"2024-05-08T20:03:29.678998+0000","last_peered":"2024-05-08T20:03:29.678998+0000","last_clean":"2024-05-08T20:03:29.678998+0000","last_became_active":"2024-05-08T20:03:29.675228+0000","last_became_peered":"2024-05-08T20:03:29.675228+0000","last_unstale":"2024-05-08T20:03:29.678998+0000","last_undegraded":"2024-05-08T20:03:29.678998+0000","last_fullsized":"2024-05-08T20:03:29.678998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:16.646254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049236+0000","last_change":"2024-05-08T20:03:29.161586+0000","last_active":"2024-05-08T20:03:33.049236+0000","last_peered":"2024-05-08T20:03:33.049236+0000","last_clean":"2024-05-08T20:03:33.049236+0000","last_became_active":"2024-05-08T20:03:29.161158+0000","last_became_peered":"2024-05-08T20:03:29.161158+0000","last_unstale":"2024-05-08T20:03:33.049236+0000","last_undegraded":"2024-05-08T20:03:33.049236+0000","last_fullsized":"2024-05-08T20:03:33.049236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:35.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346806+0000","last_change":"2024-05-08T20:03:29.680216+0000","last_active":"2024-05-08T20:03:30.346806+0000","last_peered":"2024-05-08T20:03:30.346806+0000","last_clean":"2024-05-08T20:03:30.346806+0000","last_became_active":"2024-05-08T20:03:29.679855+0000","last_became_peered":"2024-05-08T20:03:29.679855+0000","last_unstale":"2024-05-08T20:03:30.346806+0000","last_undegraded":"2024-05-08T20:03:30.346806+0000","last_fullsized":"2024-05-08T20:03:30.346806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:14.995587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":48,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:02.060932+0000","last_change":"2024-05-08T20:03:29.160134+0000","last_active":"2024-05-08T20:04:02.060932+0000","last_peered":"2024-05-08T20:04:02.060932+0000","last_clean":"2024-05-08T20:04:02.060932+0000","last_became_active":"2024-05-08T20:03:29.159782+0000","last_became_peered":"2024-05-08T20:03:29.159782+0000","last_unstale":"2024-05-08T20:04:02.060932+0000","last_undegraded":"2024-05-08T20:04:02.060932+0000","last_fullsized":"2024-05-08T20:04:02.060932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:10.580761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346697+0000","last_change":"2024-05-08T20:03:29.677050+0000","last_active":"2024-05-08T20:03:30.346697+0000","last_peered":"2024-05-08T20:03:30.346697+0000","last_clean":"2024-05-08T20:03:30.346697+0000","last_became_active":"2024-05-08T20:03:29.676685+0000","last_became_peered":"2024-05-08T20:03:29.676685+0000","last_unstale":"2024-05-08T20:03:30.346697+0000","last_undegraded":"2024-05-08T20:03:30.346697+0000","last_fullsized":"2024-05-08T20:03:30.346697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:39.115370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.019528+0000","last_change":"2024-05-08T20:03:29.165983+0000","last_active":"2024-05-08T20:03:34.019528+0000","last_peered":"2024-05-08T20:03:34.019528+0000","last_clean":"2024-05-08T20:03:34.019528+0000","last_became_active":"2024-05-08T20:03:29.165645+0000","last_became_peered":"2024-05-08T20:03:29.165645+0000","last_unstale":"2024-05-08T20:03:34.019528+0000","last_undegraded":"2024-05-08T20:03:34.019528+0000","last_fullsized":"2024-05-08T20:03:34.019528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:50.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670619+0000","last_change":"2024-05-08T20:03:29.688949+0000","last_active":"2024-05-08T20:03:30.670619+0000","last_peered":"2024-05-08T20:03:30.670619+0000","last_clean":"2024-05-08T20:03:30.670619+0000","last_became_active":"2024-05-08T20:03:29.687174+0000","last_became_peered":"2024-05-08T20:03:29.687174+0000","last_unstale":"2024-05-08T20:03:30.670619+0000","last_undegraded":"2024-05-08T20:03:30.670619+0000","last_fullsized":"2024-05-08T20:03:30.670619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:27.751738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.006283+0000","last_change":"2024-05-08T20:03:29.162951+0000","last_active":"2024-05-08T20:03:34.006283+0000","last_peered":"2024-05-08T20:03:34.006283+0000","last_clean":"2024-05-08T20:03:34.006283+0000","last_became_active":"2024-05-08T20:03:29.162589+0000","last_became_peered":"2024-05-08T20:03:29.162589+0000","last_unstale":"2024-05-08T20:03:34.006283+0000","last_undegraded":"2024-05-08T20:03:34.006283+0000","last_fullsized":"2024-05-08T20:03:34.006283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.185986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183868+0000","last_change":"2024-05-08T20:03:29.692187+0000","last_active":"2024-05-08T20:03:32.183868+0000","last_peered":"2024-05-08T20:03:32.183868+0000","last_clean":"2024-05-08T20:03:32.183868+0000","last_became_active":"2024-05-08T20:03:29.691853+0000","last_became_peered":"2024-05-08T20:03:29.691853+0000","last_unstale":"2024-05-08T20:03:32.183868+0000","last_undegraded":"2024-05-08T20:03:32.183868+0000","last_fullsized":"2024-05-08T20:03:32.183868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:24.907475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857193+0000","last_change":"2024-05-08T20:03:29.159695+0000","last_active":"2024-05-08T20:03:30.857193+0000","last_peered":"2024-05-08T20:03:30.857193+0000","last_clean":"2024-05-08T20:03:30.857193+0000","last_became_active":"2024-05-08T20:03:29.159358+0000","last_became_peered":"2024-05-08T20:03:29.159358+0000","last_unstale":"2024-05-08T20:03:30.857193+0000","last_undegraded":"2024-05-08T20:03:30.857193+0000","last_fullsized":"2024-05-08T20:03:30.857193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:04.211835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.414340+0000","last_change":"2024-05-08T20:03:29.685490+0000","last_active":"2024-05-08T20:03:33.414340+0000","last_peered":"2024-05-08T20:03:33.414340+0000","last_clean":"2024-05-08T20:03:33.414340+0000","last_became_active":"2024-05-08T20:03:29.685153+0000","last_became_peered":"2024-05-08T20:03:29.685153+0000","last_unstale":"2024-05-08T20:03:33.414340+0000","last_undegraded":"2024-05-08T20:03:33.414340+0000","last_fullsized":"2024-05-08T20:03:33.414340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:32.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790920+0000","last_change":"2024-05-08T20:03:29.168932+0000","last_active":"2024-05-08T20:03:31.790920+0000","last_peered":"2024-05-08T20:03:31.790920+0000","last_clean":"2024-05-08T20:03:31.790920+0000","last_became_active":"2024-05-08T20:03:29.168625+0000","last_became_peered":"2024-05-08T20:03:29.168625+0000","last_unstale":"2024-05-08T20:03:31.790920+0000","last_undegraded":"2024-05-08T20:03:31.790920+0000","last_fullsized":"2024-05-08T20:03:31.790920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:06.360590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790862+0000","last_change":"2024-05-08T20:03:29.679318+0000","last_active":"2024-05-08T20:03:31.790862+0000","last_peered":"2024-05-08T20:03:31.790862+0000","last_clean":"2024-05-08T20:03:31.790862+0000","last_became_active":"2024-05-08T20:03:29.678986+0000","last_became_peered":"2024-05-08T20:03:29.678986+0000","last_unstale":"2024-05-08T20:03:31.790862+0000","last_undegraded":"2024-05-08T20:03:31.790862+0000","last_fullsized":"2024-05-08T20:03:31.790862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:01.320483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670997+0000","last_change":"2024-05-08T20:03:29.685281+0000","last_active":"2024-05-08T20:03:30.670997+0000","last_peered":"2024-05-08T20:03:30.670997+0000","last_clean":"2024-05-08T20:03:30.670997+0000","last_became_active":"2024-05-08T20:03:29.684501+0000","last_became_peered":"2024-05-08T20:03:29.684501+0000","last_unstale":"2024-05-08T20:03:30.670997+0000","last_undegraded":"2024-05-08T20:03:30.670997+0000","last_fullsized":"2024-05-08T20:03:30.670997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:39.638911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":46,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:03.061729+0000","last_change":"2024-05-08T20:03:29.165278+0000","last_active":"2024-05-08T20:04:03.061729+0000","last_peered":"2024-05-08T20:04:03.061729+0000","last_clean":"2024-05-08T20:04:03.061729+0000","last_became_active":"2024-05-08T20:03:29.164901+0000","last_became_peered":"2024-05-08T20:03:29.164901+0000","last_unstale":"2024-05-08T20:04:03.061729+0000","last_undegraded":"2024-05-08T20:04:03.061729+0000","last_fullsized":"2024-05-08T20:04:03.061729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:43.034192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878165+0000","last_change":"2024-05-08T20:03:29.685296+0000","last_active":"2024-05-08T20:03:29.878165+0000","last_peered":"2024-05-08T20:03:29.878165+0000","last_clean":"2024-05-08T20:03:29.878165+0000","last_became_active":"2024-05-08T20:03:29.684909+0000","last_became_peered":"2024-05-08T20:03:29.684909+0000","last_unstale":"2024-05-08T20:03:29.878165+0000","last_undegraded":"2024-05-08T20:03:29.878165+0000","last_fullsized":"2024-05-08T20:03:29.878165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.092769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.016464+0000","last_change":"2024-05-08T20:03:29.158016+0000","last_active":"2024-05-08T20:03:34.016464+0000","last_peered":"2024-05-08T20:03:34.016464+0000","last_clean":"2024-05-08T20:03:34.016464+0000","last_became_active":"2024-05-08T20:03:29.157635+0000","last_became_peered":"2024-05-08T20:03:29.157635+0000","last_unstale":"2024-05-08T20:03:34.016464+0000","last_undegraded":"2024-05-08T20:03:34.016464+0000","last_fullsized":"2024-05-08T20:03:34.016464+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:55.355837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":331,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791247+0000","last_change":"2024-05-08T20:02:41.684821+0000","last_active":"2024-05-08T20:03:31.791247+0000","last_peered":"2024-05-08T20:03:31.791247+0000","last_clean":"2024-05-08T20:03:31.791247+0000","last_became_active":"2024-05-08T20:02:41.684413+0000","last_became_peered":"2024-05-08T20:02:41.684413+0000","last_unstale":"2024-05-08T20:03:31.791247+0000","last_undegraded":"2024-05-08T20:03:31.791247+0000","last_fullsized":"2024-05-08T20:03:31.791247+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_clean_scrub_stamp":"2024-05-08T20:00:17.645281+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:03.139734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678805+0000","last_change":"2024-05-08T20:03:29.674487+0000","last_active":"2024-05-08T20:03:29.678805+0000","last_peered":"2024-05-08T20:03:29.678805+0000","last_clean":"2024-05-08T20:03:29.678805+0000","last_became_active":"2024-05-08T20:03:29.674122+0000","last_became_peered":"2024-05-08T20:03:29.674122+0000","last_unstale":"2024-05-08T20:03:29.678805+0000","last_undegraded":"2024-05-08T20:03:29.678805+0000","last_fullsized":"2024-05-08T20:03:29.678805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:38.401296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018435+0000","last_change":"2024-05-08T20:03:29.165420+0000","last_active":"2024-05-08T20:03:34.018435+0000","last_peered":"2024-05-08T20:03:34.018435+0000","last_clean":"2024-05-08T20:03:34.018435+0000","last_became_active":"2024-05-08T20:03:29.165075+0000","last_became_peered":"2024-05-08T20:03:29.165075+0000","last_unstale":"2024-05-08T20:03:34.018435+0000","last_undegraded":"2024-05-08T20:03:34.018435+0000","last_fullsized":"2024-05-08T20:03:34.018435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:28.980327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.047685+0000","last_change":"2024-05-08T20:03:29.165940+0000","last_active":"2024-05-08T20:03:33.047685+0000","last_peered":"2024-05-08T20:03:33.047685+0000","last_clean":"2024-05-08T20:03:33.047685+0000","last_became_active":"2024-05-08T20:03:29.165615+0000","last_became_peered":"2024-05-08T20:03:29.165615+0000","last_unstale":"2024-05-08T20:03:33.047685+0000","last_undegraded":"2024-05-08T20:03:33.047685+0000","last_fullsized":"2024-05-08T20:03:33.047685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:28.066975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.675324+0000","last_change":"2024-05-08T20:03:29.674172+0000","last_active":"2024-05-08T20:03:29.675324+0000","last_peered":"2024-05-08T20:03:29.675324+0000","last_clean":"2024-05-08T20:03:29.675324+0000","last_became_active":"2024-05-08T20:03:29.673771+0000","last_became_peered":"2024-05-08T20:03:29.673771+0000","last_unstale":"2024-05-08T20:03:29.675324+0000","last_undegraded":"2024-05-08T20:03:29.675324+0000","last_fullsized":"2024-05-08T20:03:29.675324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:50.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:38.196500+0000","last_change":"2024-05-08T20:03:29.166068+0000","last_active":"2024-05-08T20:03:38.196500+0000","last_peered":"2024-05-08T20:03:38.196500+0000","last_clean":"2024-05-08T20:03:38.196500+0000","last_became_active":"2024-05-08T20:03:29.165654+0000","last_became_peered":"2024-05-08T20:03:29.165654+0000","last_unstale":"2024-05-08T20:03:38.196500+0000","last_undegraded":"2024-05-08T20:03:38.196500+0000","last_fullsized":"2024-05-08T20:03:38.196500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:13.951907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878229+0000","last_change":"2024-05-08T20:03:29.680738+0000","last_active":"2024-05-08T20:03:29.878229+0000","last_peered":"2024-05-08T20:03:29.878229+0000","last_clean":"2024-05-08T20:03:29.878229+0000","last_became_active":"2024-05-08T20:03:29.680419+0000","last_became_peered":"2024-05-08T20:03:29.680419+0000","last_unstale":"2024-05-08T20:03:29.878229+0000","last_undegraded":"2024-05-08T20:03:29.878229+0000","last_fullsized":"2024-05-08T20:03:29.878229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:33.006404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048865+0000","last_change":"2024-05-08T20:03:29.163340+0000","last_active":"2024-05-08T20:03:33.048865+0000","last_peered":"2024-05-08T20:03:33.048865+0000","last_clean":"2024-05-08T20:03:33.048865+0000","last_became_active":"2024-05-08T20:03:29.162995+0000","last_became_peered":"2024-05-08T20:03:29.162995+0000","last_unstale":"2024-05-08T20:03:33.048865+0000","last_undegraded":"2024-05-08T20:03:33.048865+0000","last_fullsized":"2024-05-08T20:03:33.048865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:18.097991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790227+0000","last_change":"2024-05-08T20:03:29.683013+0000","last_active":"2024-05-08T20:03:31.790227+0000","last_peered":"2024-05-08T20:03:31.790227+0000","last_clean":"2024-05-08T20:03:31.790227+0000","last_became_active":"2024-05-08T20:03:29.682648+0000","last_became_peered":"2024-05-08T20:03:29.682648+0000","last_unstale":"2024-05-08T20:03:31.790227+0000","last_undegraded":"2024-05-08T20:03:31.790227+0000","last_fullsized":"2024-05-08T20:03:31.790227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:11.950896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048514+0000","last_change":"2024-05-08T20:03:29.163521+0000","last_active":"2024-05-08T20:03:33.048514+0000","last_peered":"2024-05-08T20:03:33.048514+0000","last_clean":"2024-05-08T20:03:33.048514+0000","last_became_active":"2024-05-08T20:03:29.163181+0000","last_became_peered":"2024-05-08T20:03:29.163181+0000","last_unstale":"2024-05-08T20:03:33.048514+0000","last_undegraded":"2024-05-08T20:03:33.048514+0000","last_fullsized":"2024-05-08T20:03:33.048514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:46.167984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790172+0000","last_change":"2024-05-08T20:03:29.678246+0000","last_active":"2024-05-08T20:03:31.790172+0000","last_peered":"2024-05-08T20:03:31.790172+0000","last_clean":"2024-05-08T20:03:31.790172+0000","last_became_active":"2024-05-08T20:03:29.677868+0000","last_became_peered":"2024-05-08T20:03:29.677868+0000","last_unstale":"2024-05-08T20:03:31.790172+0000","last_undegraded":"2024-05-08T20:03:31.790172+0000","last_fullsized":"2024-05-08T20:03:31.790172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:34.232071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049862+0000","last_change":"2024-05-08T20:03:29.170314+0000","last_active":"2024-05-08T20:03:33.049862+0000","last_peered":"2024-05-08T20:03:33.049862+0000","last_clean":"2024-05-08T20:03:33.049862+0000","last_became_active":"2024-05-08T20:03:29.169952+0000","last_became_peered":"2024-05-08T20:03:29.169952+0000","last_unstale":"2024-05-08T20:03:33.049862+0000","last_undegraded":"2024-05-08T20:03:33.049862+0000","last_fullsized":"2024-05-08T20:03:33.049862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.399603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183806+0000","last_change":"2024-05-08T20:03:29.691046+0000","last_active":"2024-05-08T20:03:32.183806+0000","last_peered":"2024-05-08T20:03:32.183806+0000","last_clean":"2024-05-08T20:03:32.183806+0000","last_became_active":"2024-05-08T20:03:29.690681+0000","last_became_peered":"2024-05-08T20:03:29.690681+0000","last_unstale":"2024-05-08T20:03:32.183806+0000","last_undegraded":"2024-05-08T20:03:32.183806+0000","last_fullsized":"2024-05-08T20:03:32.183806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:01.340274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.356235+0000","last_change":"2024-05-08T20:03:29.170122+0000","last_active":"2024-05-08T20:03:32.356235+0000","last_peered":"2024-05-08T20:03:32.356235+0000","last_clean":"2024-05-08T20:03:32.356235+0000","last_became_active":"2024-05-08T20:03:29.169766+0000","last_became_peered":"2024-05-08T20:03:29.169766+0000","last_unstale":"2024-05-08T20:03:32.356235+0000","last_undegraded":"2024-05-08T20:03:32.356235+0000","last_fullsized":"2024-05-08T20:03:32.356235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.969796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878178+0000","last_change":"2024-05-08T20:03:29.678943+0000","last_active":"2024-05-08T20:03:29.878178+0000","last_peered":"2024-05-08T20:03:29.878178+0000","last_clean":"2024-05-08T20:03:29.878178+0000","last_became_active":"2024-05-08T20:03:29.678616+0000","last_became_peered":"2024-05-08T20:03:29.678616+0000","last_unstale":"2024-05-08T20:03:29.878178+0000","last_undegraded":"2024-05-08T20:03:29.878178+0000","last_fullsized":"2024-05-08T20:03:29.878178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:28.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049422+0000","last_change":"2024-05-08T20:03:29.161096+0000","last_active":"2024-05-08T20:03:33.049422+0000","last_peered":"2024-05-08T20:03:33.049422+0000","last_clean":"2024-05-08T20:03:33.049422+0000","last_became_active":"2024-05-08T20:03:29.160768+0000","last_became_peered":"2024-05-08T20:03:29.160768+0000","last_unstale":"2024-05-08T20:03:33.049422+0000","last_undegraded":"2024-05-08T20:03:33.049422+0000","last_fullsized":"2024-05-08T20:03:33.049422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:38.830599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346794+0000","last_change":"2024-05-08T20:03:29.690624+0000","last_active":"2024-05-08T20:03:30.346794+0000","last_peered":"2024-05-08T20:03:30.346794+0000","last_clean":"2024-05-08T20:03:30.346794+0000","last_became_active":"2024-05-08T20:03:29.689889+0000","last_became_peered":"2024-05-08T20:03:29.689889+0000","last_unstale":"2024-05-08T20:03:30.346794+0000","last_undegraded":"2024-05-08T20:03:30.346794+0000","last_fullsized":"2024-05-08T20:03:30.346794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:05.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018520+0000","last_change":"2024-05-08T20:03:29.164559+0000","last_active":"2024-05-08T20:03:34.018520+0000","last_peered":"2024-05-08T20:03:34.018520+0000","last_clean":"2024-05-08T20:03:34.018520+0000","last_became_active":"2024-05-08T20:03:29.164201+0000","last_became_peered":"2024-05-08T20:03:29.164201+0000","last_unstale":"2024-05-08T20:03:34.018520+0000","last_undegraded":"2024-05-08T20:03:34.018520+0000","last_fullsized":"2024-05-08T20:03:34.018520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:12.678098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346856+0000","last_change":"2024-05-08T20:03:29.690256+0000","last_active":"2024-05-08T20:03:30.346856+0000","last_peered":"2024-05-08T20:03:30.346856+0000","last_clean":"2024-05-08T20:03:30.346856+0000","last_became_active":"2024-05-08T20:03:29.689310+0000","last_became_peered":"2024-05-08T20:03:29.689310+0000","last_unstale":"2024-05-08T20:03:30.346856+0000","last_undegraded":"2024-05-08T20:03:30.346856+0000","last_fullsized":"2024-05-08T20:03:30.346856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:49.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670818+0000","last_change":"2024-05-08T20:03:29.164733+0000","last_active":"2024-05-08T20:03:30.670818+0000","last_peered":"2024-05-08T20:03:30.670818+0000","last_clean":"2024-05-08T20:03:30.670818+0000","last_became_active":"2024-05-08T20:03:29.164395+0000","last_became_peered":"2024-05-08T20:03:29.164395+0000","last_unstale":"2024-05-08T20:03:30.670818+0000","last_undegraded":"2024-05-08T20:03:30.670818+0000","last_fullsized":"2024-05-08T20:03:30.670818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:48.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790860+0000","last_change":"2024-05-08T20:03:29.679616+0000","last_active":"2024-05-08T20:03:31.790860+0000","last_peered":"2024-05-08T20:03:31.790860+0000","last_clean":"2024-05-08T20:03:31.790860+0000","last_became_active":"2024-05-08T20:03:29.679235+0000","last_became_peered":"2024-05-08T20:03:29.679235+0000","last_unstale":"2024-05-08T20:03:31.790860+0000","last_undegraded":"2024-05-08T20:03:31.790860+0000","last_fullsized":"2024-05-08T20:03:31.790860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:20.825327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.687694+0000","last_change":"2024-05-08T20:03:29.165731+0000","last_active":"2024-05-08T20:03:29.687694+0000","last_peered":"2024-05-08T20:03:29.687694+0000","last_clean":"2024-05-08T20:03:29.687694+0000","last_became_active":"2024-05-08T20:03:29.165397+0000","last_became_peered":"2024-05-08T20:03:29.165397+0000","last_unstale":"2024-05-08T20:03:29.687694+0000","last_undegraded":"2024-05-08T20:03:29.687694+0000","last_fullsized":"2024-05-08T20:03:29.687694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:55.541984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346880+0000","last_change":"2024-05-08T20:03:29.682523+0000","last_active":"2024-05-08T20:03:30.346880+0000","last_peered":"2024-05-08T20:03:30.346880+0000","last_clean":"2024-05-08T20:03:30.346880+0000","last_became_active":"2024-05-08T20:03:29.682188+0000","last_became_peered":"2024-05-08T20:03:29.682188+0000","last_unstale":"2024-05-08T20:03:30.346880+0000","last_undegraded":"2024-05-08T20:03:30.346880+0000","last_fullsized":"2024-05-08T20:03:30.346880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:16.871494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183830+0000","last_change":"2024-05-08T20:03:29.692315+0000","last_active":"2024-05-08T20:03:32.183830+0000","last_peered":"2024-05-08T20:03:32.183830+0000","last_clean":"2024-05-08T20:03:32.183830+0000","last_became_active":"2024-05-08T20:03:29.691944+0000","last_became_peered":"2024-05-08T20:03:29.691944+0000","last_unstale":"2024-05-08T20:03:32.183830+0000","last_undegraded":"2024-05-08T20:03:32.183830+0000","last_fullsized":"2024-05-08T20:03:32.183830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:02.614054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466270+0000","last_change":"2024-05-08T20:03:29.677763+0000","last_active":"2024-05-08T20:03:31.466270+0000","last_peered":"2024-05-08T20:03:31.466270+0000","last_clean":"2024-05-08T20:03:31.466270+0000","last_became_active":"2024-05-08T20:03:29.677282+0000","last_became_peered":"2024-05-08T20:03:29.677282+0000","last_unstale":"2024-05-08T20:03:31.466270+0000","last_undegraded":"2024-05-08T20:03:31.466270+0000","last_fullsized":"2024-05-08T20:03:31.466270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:03.039093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466116+0000","last_change":"2024-05-08T20:03:29.680085+0000","last_active":"2024-05-08T20:03:31.466116+0000","last_peered":"2024-05-08T20:03:31.466116+0000","last_clean":"2024-05-08T20:03:31.466116+0000","last_became_active":"2024-05-08T20:03:29.679793+0000","last_became_peered":"2024-05-08T20:03:29.679793+0000","last_unstale":"2024-05-08T20:03:31.466116+0000","last_undegraded":"2024-05-08T20:03:31.466116+0000","last_fullsized":"2024-05-08T20:03:31.466116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:24.679742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790883+0000","last_change":"2024-05-08T20:03:29.679987+0000","last_active":"2024-05-08T20:03:31.790883+0000","last_peered":"2024-05-08T20:03:31.790883+0000","last_clean":"2024-05-08T20:03:31.790883+0000","last_became_active":"2024-05-08T20:03:29.679630+0000","last_became_peered":"2024-05-08T20:03:29.679630+0000","last_unstale":"2024-05-08T20:03:31.790883+0000","last_undegraded":"2024-05-08T20:03:31.790883+0000","last_fullsized":"2024-05-08T20:03:31.790883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:25.119165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.674002+0000","last_change":"2024-05-08T20:03:29.672906+0000","last_active":"2024-05-08T20:03:29.674002+0000","last_peered":"2024-05-08T20:03:29.674002+0000","last_clean":"2024-05-08T20:03:29.674002+0000","last_became_active":"2024-05-08T20:03:29.672522+0000","last_became_peered":"2024-05-08T20:03:29.672522+0000","last_unstale":"2024-05-08T20:03:29.674002+0000","last_undegraded":"2024-05-08T20:03:29.674002+0000","last_fullsized":"2024-05-08T20:03:29.674002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:09.803843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183855+0000","last_change":"2024-05-08T20:03:29.692439+0000","last_active":"2024-05-08T20:03:32.183855+0000","last_peered":"2024-05-08T20:03:32.183855+0000","last_clean":"2024-05-08T20:03:32.183855+0000","last_became_active":"2024-05-08T20:03:29.691768+0000","last_became_peered":"2024-05-08T20:03:29.691768+0000","last_unstale":"2024-05-08T20:03:32.183855+0000","last_undegraded":"2024-05-08T20:03:32.183855+0000","last_fullsized":"2024-05-08T20:03:32.183855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:36.412128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466556+0000","last_change":"2024-05-08T20:03:29.687551+0000","last_active":"2024-05-08T20:03:31.466556+0000","last_peered":"2024-05-08T20:03:31.466556+0000","last_clean":"2024-05-08T20:03:31.466556+0000","last_became_active":"2024-05-08T20:03:29.687188+0000","last_became_peered":"2024-05-08T20:03:29.687188+0000","last_unstale":"2024-05-08T20:03:31.466556+0000","last_undegraded":"2024-05-08T20:03:31.466556+0000","last_fullsized":"2024-05-08T20:03:31.466556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:36.167104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878210+0000","last_change":"2024-05-08T20:03:29.679077+0000","last_active":"2024-05-08T20:03:29.878210+0000","last_peered":"2024-05-08T20:03:29.878210+0000","last_clean":"2024-05-08T20:03:29.878210+0000","last_became_active":"2024-05-08T20:03:29.678712+0000","last_became_peered":"2024-05-08T20:03:29.678712+0000","last_unstale":"2024-05-08T20:03:29.878210+0000","last_undegraded":"2024-05-08T20:03:29.878210+0000","last_fullsized":"2024-05-08T20:03:29.878210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:25.023184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671086+0000","last_change":"2024-05-08T20:03:29.677428+0000","last_active":"2024-05-08T20:03:30.671086+0000","last_peered":"2024-05-08T20:03:30.671086+0000","last_clean":"2024-05-08T20:03:30.671086+0000","last_became_active":"2024-05-08T20:03:29.676210+0000","last_became_peered":"2024-05-08T20:03:29.676210+0000","last_unstale":"2024-05-08T20:03:30.671086+0000","last_undegraded":"2024-05-08T20:03:30.671086+0000","last_fullsized":"2024-05-08T20:03:30.671086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:44.508673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878127+0000","last_change":"2024-05-08T20:03:29.676957+0000","last_active":"2024-05-08T20:03:29.878127+0000","last_peered":"2024-05-08T20:03:29.878127+0000","last_clean":"2024-05-08T20:03:29.878127+0000","last_became_active":"2024-05-08T20:03:29.676580+0000","last_became_peered":"2024-05-08T20:03:29.676580+0000","last_unstale":"2024-05-08T20:03:29.878127+0000","last_undegraded":"2024-05-08T20:03:29.878127+0000","last_fullsized":"2024-05-08T20:03:29.878127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:32.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301687+0000","last_change":"2024-05-08T20:03:29.685336+0000","last_active":"2024-05-08T20:03:30.301687+0000","last_peered":"2024-05-08T20:03:30.301687+0000","last_clean":"2024-05-08T20:03:30.301687+0000","last_became_active":"2024-05-08T20:03:29.685025+0000","last_became_peered":"2024-05-08T20:03:29.685025+0000","last_unstale":"2024-05-08T20:03:30.301687+0000","last_undegraded":"2024-05-08T20:03:30.301687+0000","last_fullsized":"2024-05-08T20:03:30.301687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:24.170359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.682488+0000","last_change":"2024-05-08T20:03:29.681684+0000","last_active":"2024-05-08T20:03:29.682488+0000","last_peered":"2024-05-08T20:03:29.682488+0000","last_clean":"2024-05-08T20:03:29.682488+0000","last_became_active":"2024-05-08T20:03:29.681302+0000","last_became_peered":"2024-05-08T20:03:29.681302+0000","last_unstale":"2024-05-08T20:03:29.682488+0000","last_undegraded":"2024-05-08T20:03:29.682488+0000","last_fullsized":"2024-05-08T20:03:29.682488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:48.963279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183840+0000","last_change":"2024-05-08T20:03:29.689885+0000","last_active":"2024-05-08T20:03:32.183840+0000","last_peered":"2024-05-08T20:03:32.183840+0000","last_clean":"2024-05-08T20:03:32.183840+0000","last_became_active":"2024-05-08T20:03:29.689562+0000","last_became_peered":"2024-05-08T20:03:29.689562+0000","last_unstale":"2024-05-08T20:03:32.183840+0000","last_undegraded":"2024-05-08T20:03:32.183840+0000","last_fullsized":"2024-05-08T20:03:32.183840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:24.363101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246656,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60975,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":205,"num_read_kb":167,"num_write":149,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":182925,"data_compressed":5568,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":868352,"data_stored":416405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.66900000000000004}]},{"osd":2,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.69499999999999995}]},{"osd":5,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.504},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.41199999999999998}]},{"osd":6,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.61099999999999999}]},{"osd":7,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.628}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":9,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64700000000000002}]},{"osd":10,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.70799999999999996}]}]},{"osd":10,"up_from":67,"seq":287762808852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":1007616,"data_stored":1065018,"data_compressed":37562,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1598,"internal_metadata":31848898},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":1,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.56699999999999995}]},{"osd":3,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.372}]},{"osd":5,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.55200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.74299999999999999}]},{"osd":9,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67600000000000005}]},{"osd":11,"last update":"Wed May 8 20:03:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.71299999999999997}]}]},{"osd":9,"up_from":62,"seq":266287972376,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":416641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54100000000000004}]},{"osd":1,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60699999999999998}]},{"osd":2,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70399999999999996}]},{"osd":3,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.623}]},{"osd":6,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.46300000000000002}]},{"osd":7,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.753},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.69399999999999995}]},{"osd":8,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.78100000000000003}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.73999999999999999}]}]},{"osd":8,"up_from":55,"seq":236223201307,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":880640,"data_stored":416230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.46500000000000002}]},{"osd":1,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.501}]},{"osd":2,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.6439999999999999,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.38300000000000001}]},{"osd":3,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.60399999999999998}]},{"osd":5,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57499999999999996}]},{"osd":6,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.627}]},{"osd":7,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64100000000000001}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.73799999999999999}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.69599999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":7,"up_from":48,"seq":206158430239,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":1008397,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.39900000000000002},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.42899999999999999,"15min":0.41799999999999998},"min":{"1min":0.33000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.436},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79800000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51100000000000001}]},{"osd":4,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.317,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64500000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.627},"min":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68600000000000005}]},{"osd":8,"last update":"Wed May 8 20:04:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.91600000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.63800000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93400000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.64700000000000002}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.66300000000000003}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.623}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":6,"up_from":43,"seq":184683593763,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":416030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.434},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53400000000000003}]},{"osd":2,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.621},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.90700000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.504}]},{"osd":5,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.626,"15min":0.627},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84899999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed May 8 20:03:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.63,"5min":0.621,"15min":0.621},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63}]},{"osd":8,"last update":"Wed May 8 20:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70899999999999996}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48599999999999999}]},{"osd":10,"last update":"Wed May 8 20:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":472618,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.38900000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.46700000000000003},"min":{"1min":0.42099999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.52500000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.56799999999999995,"15min":0.54000000000000004},"min":{"1min":0.39800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.82299999999999995}]},{"osd":4,"last update":"Wed May 8 20:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.30499999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed May 8 20:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 8 20:03:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73899999999999999}]},{"osd":7,"last update":"Wed May 8 20:03:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.41799999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.79000000000000004}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.93200000000000005}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.84099999999999997}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.871},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.88200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":892928,"data_stored":417301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.379,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.52500000000000002,"15min":0.497},"min":{"1min":0.40600000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.54200000000000004}]},{"osd":2,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.57999999999999996,"15min":0.54600000000000004},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.435},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.47999999999999998}]},{"osd":3,"last update":"Wed May 8 20:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.41599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40400000000000003}]},{"osd":4,"last update":"Wed May 8 20:03:59 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":0.67300000000000004,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.621,"15min":0.59099999999999997},"min":{"1min":0.53000000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.66400000000000003}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.55800000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85599999999999998,"5min":1.014,"15min":1.014},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.377}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51000000000000001}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.52400000000000002}]},{"osd":10,"last update":"Wed May 8 20:03:41 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.621}]},{"osd":11,"last update":"Wed May 8 20:03:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":12.093999999999999,"5min":12.093999999999999,"15min":12.093999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411377,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":474193,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.45100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.46500000000000002},"min":{"1min":0.38600000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.46999999999999997},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46700000000000003}]},{"osd":3,"last update":"Wed May 8 20:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77300000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed May 8 20:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Wed May 8 20:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.504},{"interface":"front","average":{"1min":0.504,"5min":0.44800000000000001,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.56299999999999994}]},{"osd":6,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89000000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.623},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.64400000000000002}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69899999999999995}]},{"osd":10,"last update":"Wed May 8 20:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.66700000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":3,"up_from":24,"seq":103079215149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":416341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.309,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.66400000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54100000000000004,"15min":0.51800000000000002},"min":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54800000000000004},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":1.119,"15min":1.119},"last":0.63600000000000001}]},{"osd":2,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.47999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.439,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76400000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.65100000000000002}]},{"osd":4,"last update":"Wed May 8 20:04:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61499999999999999}]},{"osd":6,"last update":"Wed May 8 20:03:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.871,"5min":0.88,"15min":0.88},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.38200000000000001}]},{"osd":7,"last update":"Wed May 8 20:03:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.49099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71699999999999997,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.73199999999999998}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.77000000000000002}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.50800000000000001}]},{"osd":10,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":4,"up_from":31,"seq":133143986217,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":876544,"data_stored":416812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.39100000000000001,"15min":0.372},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36699999999999999},"min":{"1min":0.33200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.42299999999999999}]},{"osd":2,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55100000000000005,"15min":0.52100000000000002},"min":{"1min":0.45700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.55800000000000005}]},{"osd":5,"last update":"Wed May 8 20:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.623}]},{"osd":6,"last update":"Wed May 8 20:03:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95999999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed May 8 20:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.501},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51800000000000002}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.71699999999999997}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65500000000000003}]},{"osd":10,"last update":"Wed May 8 20:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":5,"up_from":36,"seq":154618822694,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":1007736,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.48099999999999998},"min":{"1min":0.313,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.435},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.751}]},{"osd":2,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.53500000000000003}]},{"osd":3,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.629},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed May 8 20:03:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.65100000000000002}]},{"osd":7,"last update":"Wed May 8 20:03:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.79800000000000004}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.71799999999999997}]},{"osd":9,"last update":"Wed May 8 20:03:25 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.73599999999999999}]},{"osd":10,"last update":"Wed May 8 20:03:41 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.872}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":57068,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":58370,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":58991,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:04:09.100 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T20:04:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 -- 172.21.15.33:0/2171773284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 msgr2=0x7f51a0104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 --2- 172.21.15.33:0/2171773284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a0104ae0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5190009990 tx=0x7f5190009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 -- 172.21.15.33:0/2171773284 shutdown_connections 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 --2- 172.21.15.33:0/2171773284 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a01051c0 0x7f51a010cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 --2- 172.21.15.33:0/2171773284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51a01000e0 0x7f51a01004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 --2- 172.21.15.33:0/2171773284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a0104ae0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 -- 172.21.15.33:0/2171773284 >> 172.21.15.33:0/2171773284 conn(0x7f51a0076f40 msgr2=0x7f51a0077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 -- 172.21.15.33:0/2171773284 shutdown_connections 2024-05-08T20:04:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.382+0000 7f51a838f700 1 -- 172.21.15.33:0/2171773284 wait complete. 2024-05-08T20:04:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 Processor -- start 2024-05-08T20:04:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 -- start start 2024-05-08T20:04:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a01000e0 0x7f51a0197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a01979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51a01051c0 0x7f51a019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a019c380 con 0x7f51a0100a90 2024-05-08T20:04:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a019c4f0 con 0x7f51a01000e0 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a838f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a019c6b0 con 0x7f51a01051c0 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a592a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a01979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a592a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a01979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38652/0 (socket says 172.21.15.33:38652) 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a592a700 1 -- 172.21.15.33:0/3082352388 learned_addr learned my addr 172.21.15.33:0/3082352388 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.383+0000 7f51a612b700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a01000e0 0x7f51a0197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a692c700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51a01051c0 0x7f51a019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a592a700 1 -- 172.21.15.33:0/3082352388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51a01051c0 msgr2=0x7f51a019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a592a700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51a01051c0 0x7f51a019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a592a700 1 -- 172.21.15.33:0/3082352388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a01000e0 msgr2=0x7f51a0197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a592a700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a01000e0 0x7f51a0197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a592a700 1 -- 172.21.15.33:0/3082352388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51900095f0 con 0x7f51a0100a90 2024-05-08T20:04:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a692c700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51a01051c0 0x7f51a019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a592a700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a01979c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5190000c00 tx=0x7f519000f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51977fe700 1 -- 172.21.15.33:0/3082352388 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519001d070 con 0x7f51a0100a90 2024-05-08T20:04:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51977fe700 1 -- 172.21.15.33:0/3082352388 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5190003680 con 0x7f51a0100a90 2024-05-08T20:04:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a019c930 con 0x7f51a0100a90 2024-05-08T20:04:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51977fe700 1 -- 172.21.15.33:0/3082352388 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51900173f0 con 0x7f51a0100a90 2024-05-08T20:04:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.384+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a01a41f0 con 0x7f51a0100a90 2024-05-08T20:04:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.385+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51a01084e0 con 0x7f51a0100a90 2024-05-08T20:04:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.386+0000 7f51977fe700 1 -- 172.21.15.33:0/3082352388 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5190022470 con 0x7f51a0100a90 2024-05-08T20:04:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.387+0000 7f51977fe700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f518c0a11b0 0x7f518c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.387+0000 7f51a612b700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f518c0a11b0 0x7f518c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.387+0000 7f51977fe700 1 -- 172.21.15.33:0/3082352388 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f51900cdbf0 con 0x7f51a0100a90 2024-05-08T20:04:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.388+0000 7f51a612b700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f518c0a11b0 0x7f518c0a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f519c005950 tx=0x7f519c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:10.380 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.391+0000 7f51977fe700 1 -- 172.21.15.33:0/3082352388 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5190097460 con 0x7f51a0100a90 2024-05-08T20:04:10.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:10 smithi033 ceph-mon[42490]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:04:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:10 smithi033 ceph-mon[42490]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T20:04:10.588 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.599+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51a0198790 con 0x7f518c0a11b0 2024-05-08T20:04:10.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.610+0000 7f51977fe700 1 -- 172.21.15.33:0/3082352388 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+341003 (secure 0 0 0) 0x7f51a0198790 con 0x7f518c0a11b0 2024-05-08T20:04:10.605 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:10.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f518c0a11b0 msgr2=0x7f518c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:10.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f518c0a11b0 0x7f518c0a3670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f519c005950 tx=0x7f519c00a300 comp rx=0 tx=0).stop 2024-05-08T20:04:10.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 msgr2=0x7f51a01979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:10.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a01979c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5190000c00 tx=0x7f519000f710 comp rx=0 tx=0).stop 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 shutdown_connections 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f518c0a11b0 0x7f518c0a3670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51a01051c0 0x7f51a019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51a01000e0 0x7f51a0197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 --2- 172.21.15.33:0/3082352388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51a0100a90 0x7f51a01979c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 >> 172.21.15.33:0/3082352388 conn(0x7f51a0076f40 msgr2=0x7f51a00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 shutdown_connections 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:10.613+0000 7f51a838f700 1 -- 172.21.15.33:0/3082352388 wait complete. 2024-05-08T20:04:10.609 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2024-05-08T20:04:10.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:10 smithi082 ceph-mon[46774]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:04:10.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:10 smithi082 ceph-mon[46774]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T20:04:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:10 smithi132 ceph-mon[47484]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:04:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:10 smithi132 ceph-mon[47484]: pgmap v241: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 6 op/s 2024-05-08T20:04:11.000 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2024-05-08T20:04:09.123219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651577,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":366,"num_read_kb":296,"num_write":332,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355344,"kb_used_data":10668,"kb_used_omap":18,"kb_used_meta":344557,"kb_avail":1124586480,"statfs":{"total":1151940427776,"available":1151576555520,"internally_reserved":0,"allocated":10924032,"data_stored":6943722,"data_compressed":112686,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":19130,"internal_metadata":352826694},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":36,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003464"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183880+0000","last_change":"2024-05-08T20:03:29.696040+0000","last_active":"2024-05-08T20:03:32.183880+0000","last_peered":"2024-05-08T20:03:32.183880+0000","last_clean":"2024-05-08T20:03:32.183880+0000","last_became_active":"2024-05-08T20:03:29.695312+0000","last_became_peered":"2024-05-08T20:03:29.695312+0000","last_unstale":"2024-05-08T20:03:32.183880+0000","last_undegraded":"2024-05-08T20:03:32.183880+0000","last_fullsized":"2024-05-08T20:03:32.183880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:31:05.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790102+0000","last_change":"2024-05-08T20:03:29.681157+0000","last_active":"2024-05-08T20:03:31.790102+0000","last_peered":"2024-05-08T20:03:31.790102+0000","last_clean":"2024-05-08T20:03:31.790102+0000","last_became_active":"2024-05-08T20:03:29.680796+0000","last_became_peered":"2024-05-08T20:03:29.680796+0000","last_unstale":"2024-05-08T20:03:31.790102+0000","last_undegraded":"2024-05-08T20:03:31.790102+0000","last_fullsized":"2024-05-08T20:03:31.790102+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:48:49.112158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790228+0000","last_change":"2024-05-08T20:03:29.686199+0000","last_active":"2024-05-08T20:03:31.790228+0000","last_peered":"2024-05-08T20:03:31.790228+0000","last_clean":"2024-05-08T20:03:31.790228+0000","last_became_active":"2024-05-08T20:03:29.685871+0000","last_became_peered":"2024-05-08T20:03:29.685871+0000","last_unstale":"2024-05-08T20:03:31.790228+0000","last_undegraded":"2024-05-08T20:03:31.790228+0000","last_fullsized":"2024-05-08T20:03:31.790228+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:59:45.835061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671020+0000","last_change":"2024-05-08T20:03:29.690931+0000","last_active":"2024-05-08T20:03:30.671020+0000","last_peered":"2024-05-08T20:03:30.671020+0000","last_clean":"2024-05-08T20:03:30.671020+0000","last_became_active":"2024-05-08T20:03:29.690165+0000","last_became_peered":"2024-05-08T20:03:29.690165+0000","last_unstale":"2024-05-08T20:03:30.671020+0000","last_undegraded":"2024-05-08T20:03:30.671020+0000","last_fullsized":"2024-05-08T20:03:30.671020+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:25.906201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790306+0000","last_change":"2024-05-08T20:03:29.675018+0000","last_active":"2024-05-08T20:03:31.790306+0000","last_peered":"2024-05-08T20:03:31.790306+0000","last_clean":"2024-05-08T20:03:31.790306+0000","last_became_active":"2024-05-08T20:03:29.674714+0000","last_became_peered":"2024-05-08T20:03:29.674714+0000","last_unstale":"2024-05-08T20:03:31.790306+0000","last_undegraded":"2024-05-08T20:03:31.790306+0000","last_fullsized":"2024-05-08T20:03:31.790306+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:21:10.784129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791669+0000","last_change":"2024-05-08T20:03:29.679134+0000","last_active":"2024-05-08T20:03:31.791669+0000","last_peered":"2024-05-08T20:03:31.791669+0000","last_clean":"2024-05-08T20:03:31.791669+0000","last_became_active":"2024-05-08T20:03:29.678853+0000","last_became_peered":"2024-05-08T20:03:29.678853+0000","last_unstale":"2024-05-08T20:03:31.791669+0000","last_undegraded":"2024-05-08T20:03:31.791669+0000","last_fullsized":"2024-05-08T20:03:31.791669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:35:48.104195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346770+0000","last_change":"2024-05-08T20:03:29.679907+0000","last_active":"2024-05-08T20:03:30.346770+0000","last_peered":"2024-05-08T20:03:30.346770+0000","last_clean":"2024-05-08T20:03:30.346770+0000","last_became_active":"2024-05-08T20:03:29.679565+0000","last_became_peered":"2024-05-08T20:03:29.679565+0000","last_unstale":"2024-05-08T20:03:30.346770+0000","last_undegraded":"2024-05-08T20:03:30.346770+0000","last_fullsized":"2024-05-08T20:03:30.346770+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:26:37.570557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878114+0000","last_change":"2024-05-08T20:03:29.677113+0000","last_active":"2024-05-08T20:03:29.878114+0000","last_peered":"2024-05-08T20:03:29.878114+0000","last_clean":"2024-05-08T20:03:29.878114+0000","last_became_active":"2024-05-08T20:03:29.676762+0000","last_became_peered":"2024-05-08T20:03:29.676762+0000","last_unstale":"2024-05-08T20:03:29.878114+0000","last_undegraded":"2024-05-08T20:03:29.878114+0000","last_fullsized":"2024-05-08T20:03:29.878114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:42:38.051229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301745+0000","last_change":"2024-05-08T20:03:29.687614+0000","last_active":"2024-05-08T20:03:30.301745+0000","last_peered":"2024-05-08T20:03:30.301745+0000","last_clean":"2024-05-08T20:03:30.301745+0000","last_became_active":"2024-05-08T20:03:29.687288+0000","last_became_peered":"2024-05-08T20:03:29.687288+0000","last_unstale":"2024-05-08T20:03:30.301745+0000","last_undegraded":"2024-05-08T20:03:30.301745+0000","last_fullsized":"2024-05-08T20:03:30.301745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:54:33.785307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790877+0000","last_change":"2024-05-08T20:03:29.685462+0000","last_active":"2024-05-08T20:03:31.790877+0000","last_peered":"2024-05-08T20:03:31.790877+0000","last_clean":"2024-05-08T20:03:31.790877+0000","last_became_active":"2024-05-08T20:03:29.685133+0000","last_became_peered":"2024-05-08T20:03:29.685133+0000","last_unstale":"2024-05-08T20:03:31.790877+0000","last_undegraded":"2024-05-08T20:03:31.790877+0000","last_fullsized":"2024-05-08T20:03:31.790877+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:07:56.104253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346843+0000","last_change":"2024-05-08T20:03:29.690183+0000","last_active":"2024-05-08T20:03:30.346843+0000","last_peered":"2024-05-08T20:03:30.346843+0000","last_clean":"2024-05-08T20:03:30.346843+0000","last_became_active":"2024-05-08T20:03:29.689740+0000","last_became_peered":"2024-05-08T20:03:29.689740+0000","last_unstale":"2024-05-08T20:03:30.346843+0000","last_undegraded":"2024-05-08T20:03:30.346843+0000","last_fullsized":"2024-05-08T20:03:30.346843+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:11:02.975916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671000+0000","last_change":"2024-05-08T20:03:29.690717+0000","last_active":"2024-05-08T20:03:30.671000+0000","last_peered":"2024-05-08T20:03:30.671000+0000","last_clean":"2024-05-08T20:03:30.671000+0000","last_became_active":"2024-05-08T20:03:29.689845+0000","last_became_peered":"2024-05-08T20:03:29.689845+0000","last_unstale":"2024-05-08T20:03:30.671000+0000","last_undegraded":"2024-05-08T20:03:30.671000+0000","last_fullsized":"2024-05-08T20:03:30.671000+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:35:58.105656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.679134+0000","last_change":"2024-05-08T20:03:29.678031+0000","last_active":"2024-05-08T20:03:29.679134+0000","last_peered":"2024-05-08T20:03:29.679134+0000","last_clean":"2024-05-08T20:03:29.679134+0000","last_became_active":"2024-05-08T20:03:29.677711+0000","last_became_peered":"2024-05-08T20:03:29.677711+0000","last_unstale":"2024-05-08T20:03:29.679134+0000","last_undegraded":"2024-05-08T20:03:29.679134+0000","last_fullsized":"2024-05-08T20:03:29.679134+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:35:44.432527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789896+0000","last_change":"2024-05-08T20:03:29.681551+0000","last_active":"2024-05-08T20:03:31.789896+0000","last_peered":"2024-05-08T20:03:31.789896+0000","last_clean":"2024-05-08T20:03:31.789896+0000","last_became_active":"2024-05-08T20:03:29.680558+0000","last_became_peered":"2024-05-08T20:03:29.680558+0000","last_unstale":"2024-05-08T20:03:31.789896+0000","last_undegraded":"2024-05-08T20:03:31.789896+0000","last_fullsized":"2024-05-08T20:03:31.789896+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:39:40.976066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.789942+0000","last_change":"2024-05-08T20:03:29.682503+0000","last_active":"2024-05-08T20:03:31.789942+0000","last_peered":"2024-05-08T20:03:31.789942+0000","last_clean":"2024-05-08T20:03:31.789942+0000","last_became_active":"2024-05-08T20:03:29.675083+0000","last_became_peered":"2024-05-08T20:03:29.675083+0000","last_unstale":"2024-05-08T20:03:31.789942+0000","last_undegraded":"2024-05-08T20:03:31.789942+0000","last_fullsized":"2024-05-08T20:03:31.789942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:29:19.030599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301652+0000","last_change":"2024-05-08T20:03:29.693087+0000","last_active":"2024-05-08T20:03:30.301652+0000","last_peered":"2024-05-08T20:03:30.301652+0000","last_clean":"2024-05-08T20:03:30.301652+0000","last_became_active":"2024-05-08T20:03:29.692824+0000","last_became_peered":"2024-05-08T20:03:29.692824+0000","last_unstale":"2024-05-08T20:03:30.301652+0000","last_undegraded":"2024-05-08T20:03:30.301652+0000","last_fullsized":"2024-05-08T20:03:30.301652+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:09:58.653115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183892+0000","last_change":"2024-05-08T20:03:29.696363+0000","last_active":"2024-05-08T20:03:32.183892+0000","last_peered":"2024-05-08T20:03:32.183892+0000","last_clean":"2024-05-08T20:03:32.183892+0000","last_became_active":"2024-05-08T20:03:29.695742+0000","last_became_peered":"2024-05-08T20:03:29.695742+0000","last_unstale":"2024-05-08T20:03:32.183892+0000","last_undegraded":"2024-05-08T20:03:32.183892+0000","last_fullsized":"2024-05-08T20:03:32.183892+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:09:34.085822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857275+0000","last_change":"2024-05-08T20:03:29.680245+0000","last_active":"2024-05-08T20:03:30.857275+0000","last_peered":"2024-05-08T20:03:30.857275+0000","last_clean":"2024-05-08T20:03:30.857275+0000","last_became_active":"2024-05-08T20:03:29.679921+0000","last_became_peered":"2024-05-08T20:03:29.679921+0000","last_unstale":"2024-05-08T20:03:30.857275+0000","last_undegraded":"2024-05-08T20:03:30.857275+0000","last_fullsized":"2024-05-08T20:03:30.857275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:54:31.013564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466500+0000","last_change":"2024-05-08T20:03:29.680303+0000","last_active":"2024-05-08T20:03:31.466500+0000","last_peered":"2024-05-08T20:03:31.466500+0000","last_clean":"2024-05-08T20:03:31.466500+0000","last_became_active":"2024-05-08T20:03:29.679406+0000","last_became_peered":"2024-05-08T20:03:29.679406+0000","last_unstale":"2024-05-08T20:03:31.466500+0000","last_undegraded":"2024-05-08T20:03:31.466500+0000","last_fullsized":"2024-05-08T20:03:31.466500+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:32:44.353488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'9","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018724+0000","last_change":"2024-05-08T20:03:29.159444+0000","last_active":"2024-05-08T20:03:34.018724+0000","last_peered":"2024-05-08T20:03:34.018724+0000","last_clean":"2024-05-08T20:03:34.018724+0000","last_became_active":"2024-05-08T20:03:29.159024+0000","last_became_peered":"2024-05-08T20:03:29.159024+0000","last_unstale":"2024-05-08T20:03:34.018724+0000","last_undegraded":"2024-05-08T20:03:34.018724+0000","last_fullsized":"2024-05-08T20:03:34.018724+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:38:49.855043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878188+0000","last_change":"2024-05-08T20:03:29.679721+0000","last_active":"2024-05-08T20:03:29.878188+0000","last_peered":"2024-05-08T20:03:29.878188+0000","last_clean":"2024-05-08T20:03:29.878188+0000","last_became_active":"2024-05-08T20:03:29.679424+0000","last_became_peered":"2024-05-08T20:03:29.679424+0000","last_unstale":"2024-05-08T20:03:29.878188+0000","last_undegraded":"2024-05-08T20:03:29.878188+0000","last_fullsized":"2024-05-08T20:03:29.878188+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:56:21.133074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790826+0000","last_change":"2024-05-08T20:03:29.169000+0000","last_active":"2024-05-08T20:03:31.790826+0000","last_peered":"2024-05-08T20:03:31.790826+0000","last_clean":"2024-05-08T20:03:31.790826+0000","last_became_active":"2024-05-08T20:03:29.164576+0000","last_became_peered":"2024-05-08T20:03:29.164576+0000","last_unstale":"2024-05-08T20:03:31.790826+0000","last_undegraded":"2024-05-08T20:03:31.790826+0000","last_fullsized":"2024-05-08T20:03:31.790826+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:21:19.961768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790561+0000","last_change":"2024-05-08T20:03:29.686350+0000","last_active":"2024-05-08T20:03:31.790561+0000","last_peered":"2024-05-08T20:03:31.790561+0000","last_clean":"2024-05-08T20:03:31.790561+0000","last_became_active":"2024-05-08T20:03:29.686016+0000","last_became_peered":"2024-05-08T20:03:29.686016+0000","last_unstale":"2024-05-08T20:03:31.790561+0000","last_undegraded":"2024-05-08T20:03:31.790561+0000","last_fullsized":"2024-05-08T20:03:31.790561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:18.727685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.019031+0000","last_change":"2024-05-08T20:03:29.161691+0000","last_active":"2024-05-08T20:03:34.019031+0000","last_peered":"2024-05-08T20:03:34.019031+0000","last_clean":"2024-05-08T20:03:34.019031+0000","last_became_active":"2024-05-08T20:03:29.161328+0000","last_became_peered":"2024-05-08T20:03:29.161328+0000","last_unstale":"2024-05-08T20:03:34.019031+0000","last_undegraded":"2024-05-08T20:03:34.019031+0000","last_fullsized":"2024-05-08T20:03:34.019031+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:38:08.183440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301699+0000","last_change":"2024-05-08T20:03:29.688528+0000","last_active":"2024-05-08T20:03:30.301699+0000","last_peered":"2024-05-08T20:03:30.301699+0000","last_clean":"2024-05-08T20:03:30.301699+0000","last_became_active":"2024-05-08T20:03:29.688211+0000","last_became_peered":"2024-05-08T20:03:29.688211+0000","last_unstale":"2024-05-08T20:03:30.301699+0000","last_undegraded":"2024-05-08T20:03:30.301699+0000","last_fullsized":"2024-05-08T20:03:30.301699+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:44:01.830009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.694883+0000","last_change":"2024-05-08T20:03:29.158484+0000","last_active":"2024-05-08T20:03:29.694883+0000","last_peered":"2024-05-08T20:03:29.694883+0000","last_clean":"2024-05-08T20:03:29.694883+0000","last_became_active":"2024-05-08T20:03:29.158116+0000","last_became_peered":"2024-05-08T20:03:29.158116+0000","last_unstale":"2024-05-08T20:03:29.694883+0000","last_undegraded":"2024-05-08T20:03:29.694883+0000","last_fullsized":"2024-05-08T20:03:29.694883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:20:13.955725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670971+0000","last_change":"2024-05-08T20:03:29.688895+0000","last_active":"2024-05-08T20:03:30.670971+0000","last_peered":"2024-05-08T20:03:30.670971+0000","last_clean":"2024-05-08T20:03:30.670971+0000","last_became_active":"2024-05-08T20:03:29.688571+0000","last_became_peered":"2024-05-08T20:03:29.688571+0000","last_unstale":"2024-05-08T20:03:30.670971+0000","last_undegraded":"2024-05-08T20:03:30.670971+0000","last_fullsized":"2024-05-08T20:03:30.670971+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:37:19.722428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:07.054441+0000","last_change":"2024-05-08T20:03:29.159927+0000","last_active":"2024-05-08T20:04:07.054441+0000","last_peered":"2024-05-08T20:04:07.054441+0000","last_clean":"2024-05-08T20:04:07.054441+0000","last_became_active":"2024-05-08T20:03:29.159608+0000","last_became_peered":"2024-05-08T20:03:29.159608+0000","last_unstale":"2024-05-08T20:04:07.054441+0000","last_undegraded":"2024-05-08T20:04:07.054441+0000","last_fullsized":"2024-05-08T20:04:07.054441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:39:17.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790183+0000","last_change":"2024-05-08T20:03:29.676181+0000","last_active":"2024-05-08T20:03:31.790183+0000","last_peered":"2024-05-08T20:03:31.790183+0000","last_clean":"2024-05-08T20:03:31.790183+0000","last_became_active":"2024-05-08T20:03:29.675823+0000","last_became_peered":"2024-05-08T20:03:29.675823+0000","last_unstale":"2024-05-08T20:03:31.790183+0000","last_undegraded":"2024-05-08T20:03:31.790183+0000","last_fullsized":"2024-05-08T20:03:31.790183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:28:42.858491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018299+0000","last_change":"2024-05-08T20:03:29.156803+0000","last_active":"2024-05-08T20:03:34.018299+0000","last_peered":"2024-05-08T20:03:34.018299+0000","last_clean":"2024-05-08T20:03:34.018299+0000","last_became_active":"2024-05-08T20:03:29.156114+0000","last_became_peered":"2024-05-08T20:03:29.156114+0000","last_unstale":"2024-05-08T20:03:34.018299+0000","last_undegraded":"2024-05-08T20:03:34.018299+0000","last_fullsized":"2024-05-08T20:03:34.018299+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:37:11.964529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670789+0000","last_change":"2024-05-08T20:03:29.677259+0000","last_active":"2024-05-08T20:03:30.670789+0000","last_peered":"2024-05-08T20:03:30.670789+0000","last_clean":"2024-05-08T20:03:30.670789+0000","last_became_active":"2024-05-08T20:03:29.676885+0000","last_became_peered":"2024-05-08T20:03:29.676885+0000","last_unstale":"2024-05-08T20:03:30.670789+0000","last_undegraded":"2024-05-08T20:03:30.670789+0000","last_fullsized":"2024-05-08T20:03:30.670789+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:13:18.152813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018316+0000","last_change":"2024-05-08T20:03:29.162317+0000","last_active":"2024-05-08T20:03:34.018316+0000","last_peered":"2024-05-08T20:03:34.018316+0000","last_clean":"2024-05-08T20:03:34.018316+0000","last_became_active":"2024-05-08T20:03:29.161961+0000","last_became_peered":"2024-05-08T20:03:29.161961+0000","last_unstale":"2024-05-08T20:03:34.018316+0000","last_undegraded":"2024-05-08T20:03:34.018316+0000","last_fullsized":"2024-05-08T20:03:34.018316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:22:36.379021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878091+0000","last_change":"2024-05-08T20:03:29.672527+0000","last_active":"2024-05-08T20:03:29.878091+0000","last_peered":"2024-05-08T20:03:29.878091+0000","last_clean":"2024-05-08T20:03:29.878091+0000","last_became_active":"2024-05-08T20:03:29.672199+0000","last_became_peered":"2024-05-08T20:03:29.672199+0000","last_unstale":"2024-05-08T20:03:29.878091+0000","last_undegraded":"2024-05-08T20:03:29.878091+0000","last_fullsized":"2024-05-08T20:03:29.878091+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:47.833015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670738+0000","last_change":"2024-05-08T20:03:29.160639+0000","last_active":"2024-05-08T20:03:30.670738+0000","last_peered":"2024-05-08T20:03:30.670738+0000","last_clean":"2024-05-08T20:03:30.670738+0000","last_became_active":"2024-05-08T20:03:29.160291+0000","last_became_peered":"2024-05-08T20:03:29.160291+0000","last_unstale":"2024-05-08T20:03:30.670738+0000","last_undegraded":"2024-05-08T20:03:30.670738+0000","last_fullsized":"2024-05-08T20:03:30.670738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:45:56.126764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857096+0000","last_change":"2024-05-08T20:03:29.677339+0000","last_active":"2024-05-08T20:03:30.857096+0000","last_peered":"2024-05-08T20:03:30.857096+0000","last_clean":"2024-05-08T20:03:30.857096+0000","last_became_active":"2024-05-08T20:03:29.676954+0000","last_became_peered":"2024-05-08T20:03:29.676954+0000","last_unstale":"2024-05-08T20:03:30.857096+0000","last_undegraded":"2024-05-08T20:03:30.857096+0000","last_fullsized":"2024-05-08T20:03:30.857096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:06:36.677107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'3","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:07.053666+0000","last_change":"2024-05-08T20:03:29.156873+0000","last_active":"2024-05-08T20:04:07.053666+0000","last_peered":"2024-05-08T20:04:07.053666+0000","last_clean":"2024-05-08T20:04:07.053666+0000","last_became_active":"2024-05-08T20:03:29.156130+0000","last_became_peered":"2024-05-08T20:03:29.156130+0000","last_unstale":"2024-05-08T20:04:07.053666+0000","last_undegraded":"2024-05-08T20:04:07.053666+0000","last_fullsized":"2024-05-08T20:04:07.053666+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:57:31.410319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301731+0000","last_change":"2024-05-08T20:03:29.680591+0000","last_active":"2024-05-08T20:03:30.301731+0000","last_peered":"2024-05-08T20:03:30.301731+0000","last_clean":"2024-05-08T20:03:30.301731+0000","last_became_active":"2024-05-08T20:03:29.680311+0000","last_became_peered":"2024-05-08T20:03:29.680311+0000","last_unstale":"2024-05-08T20:03:30.301731+0000","last_undegraded":"2024-05-08T20:03:30.301731+0000","last_fullsized":"2024-05-08T20:03:30.301731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:58:51.343586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049047+0000","last_change":"2024-05-08T20:03:29.165504+0000","last_active":"2024-05-08T20:03:33.049047+0000","last_peered":"2024-05-08T20:03:33.049047+0000","last_clean":"2024-05-08T20:03:33.049047+0000","last_became_active":"2024-05-08T20:03:29.164251+0000","last_became_peered":"2024-05-08T20:03:29.164251+0000","last_unstale":"2024-05-08T20:03:33.049047+0000","last_undegraded":"2024-05-08T20:03:33.049047+0000","last_fullsized":"2024-05-08T20:03:33.049047+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:15:51.771014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790469+0000","last_change":"2024-05-08T20:03:29.684880+0000","last_active":"2024-05-08T20:03:31.790469+0000","last_peered":"2024-05-08T20:03:31.790469+0000","last_clean":"2024-05-08T20:03:31.790469+0000","last_became_active":"2024-05-08T20:03:29.683216+0000","last_became_peered":"2024-05-08T20:03:29.683216+0000","last_unstale":"2024-05-08T20:03:31.790469+0000","last_undegraded":"2024-05-08T20:03:31.790469+0000","last_fullsized":"2024-05-08T20:03:31.790469+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:17:12.695393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049436+0000","last_change":"2024-05-08T20:03:29.157211+0000","last_active":"2024-05-08T20:03:33.049436+0000","last_peered":"2024-05-08T20:03:33.049436+0000","last_clean":"2024-05-08T20:03:33.049436+0000","last_became_active":"2024-05-08T20:03:29.156761+0000","last_became_peered":"2024-05-08T20:03:29.156761+0000","last_unstale":"2024-05-08T20:03:33.049436+0000","last_undegraded":"2024-05-08T20:03:33.049436+0000","last_fullsized":"2024-05-08T20:03:33.049436+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:45:27.261915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301709+0000","last_change":"2024-05-08T20:03:29.686949+0000","last_active":"2024-05-08T20:03:30.301709+0000","last_peered":"2024-05-08T20:03:30.301709+0000","last_clean":"2024-05-08T20:03:30.301709+0000","last_became_active":"2024-05-08T20:03:29.686634+0000","last_became_peered":"2024-05-08T20:03:29.686634+0000","last_unstale":"2024-05-08T20:03:30.301709+0000","last_undegraded":"2024-05-08T20:03:30.301709+0000","last_fullsized":"2024-05-08T20:03:30.301709+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:03:27.560636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'27","reported_seq":116,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:08.054786+0000","last_change":"2024-05-08T20:03:29.156991+0000","last_active":"2024-05-08T20:04:08.054786+0000","last_peered":"2024-05-08T20:04:08.054786+0000","last_clean":"2024-05-08T20:04:08.054786+0000","last_became_active":"2024-05-08T20:03:29.156570+0000","last_became_peered":"2024-05-08T20:03:29.156570+0000","last_unstale":"2024-05-08T20:04:08.054786+0000","last_undegraded":"2024-05-08T20:04:08.054786+0000","last_fullsized":"2024-05-08T20:04:08.054786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:47:05.001469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57068,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":77,"num_read_kb":93,"num_write":28,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790529+0000","last_change":"2024-05-08T20:03:29.684822+0000","last_active":"2024-05-08T20:03:31.790529+0000","last_peered":"2024-05-08T20:03:31.790529+0000","last_clean":"2024-05-08T20:03:31.790529+0000","last_became_active":"2024-05-08T20:03:29.684455+0000","last_became_peered":"2024-05-08T20:03:29.684455+0000","last_unstale":"2024-05-08T20:03:31.790529+0000","last_undegraded":"2024-05-08T20:03:31.790529+0000","last_fullsized":"2024-05-08T20:03:31.790529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:44:28.982158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'6","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.017697+0000","last_change":"2024-05-08T20:03:29.165831+0000","last_active":"2024-05-08T20:03:34.017697+0000","last_peered":"2024-05-08T20:03:34.017697+0000","last_clean":"2024-05-08T20:03:34.017697+0000","last_became_active":"2024-05-08T20:03:29.165493+0000","last_became_peered":"2024-05-08T20:03:29.165493+0000","last_unstale":"2024-05-08T20:03:34.017697+0000","last_undegraded":"2024-05-08T20:03:34.017697+0000","last_fullsized":"2024-05-08T20:03:34.017697+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:06:56.507752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678998+0000","last_change":"2024-05-08T20:03:29.675564+0000","last_active":"2024-05-08T20:03:29.678998+0000","last_peered":"2024-05-08T20:03:29.678998+0000","last_clean":"2024-05-08T20:03:29.678998+0000","last_became_active":"2024-05-08T20:03:29.675228+0000","last_became_peered":"2024-05-08T20:03:29.675228+0000","last_unstale":"2024-05-08T20:03:29.678998+0000","last_undegraded":"2024-05-08T20:03:29.678998+0000","last_fullsized":"2024-05-08T20:03:29.678998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:09:16.646254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049236+0000","last_change":"2024-05-08T20:03:29.161586+0000","last_active":"2024-05-08T20:03:33.049236+0000","last_peered":"2024-05-08T20:03:33.049236+0000","last_clean":"2024-05-08T20:03:33.049236+0000","last_became_active":"2024-05-08T20:03:29.161158+0000","last_became_peered":"2024-05-08T20:03:29.161158+0000","last_unstale":"2024-05-08T20:03:33.049236+0000","last_undegraded":"2024-05-08T20:03:33.049236+0000","last_fullsized":"2024-05-08T20:03:33.049236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:06:35.670740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346806+0000","last_change":"2024-05-08T20:03:29.680216+0000","last_active":"2024-05-08T20:03:30.346806+0000","last_peered":"2024-05-08T20:03:30.346806+0000","last_clean":"2024-05-08T20:03:30.346806+0000","last_became_active":"2024-05-08T20:03:29.679855+0000","last_became_peered":"2024-05-08T20:03:29.679855+0000","last_unstale":"2024-05-08T20:03:30.346806+0000","last_undegraded":"2024-05-08T20:03:30.346806+0000","last_fullsized":"2024-05-08T20:03:30.346806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:06:14.995587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'4","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:07.068301+0000","last_change":"2024-05-08T20:03:29.160134+0000","last_active":"2024-05-08T20:04:07.068301+0000","last_peered":"2024-05-08T20:04:07.068301+0000","last_clean":"2024-05-08T20:04:07.068301+0000","last_became_active":"2024-05-08T20:03:29.159782+0000","last_became_peered":"2024-05-08T20:03:29.159782+0000","last_unstale":"2024-05-08T20:04:07.068301+0000","last_undegraded":"2024-05-08T20:04:07.068301+0000","last_fullsized":"2024-05-08T20:04:07.068301+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:51:10.580761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346697+0000","last_change":"2024-05-08T20:03:29.677050+0000","last_active":"2024-05-08T20:03:30.346697+0000","last_peered":"2024-05-08T20:03:30.346697+0000","last_clean":"2024-05-08T20:03:30.346697+0000","last_became_active":"2024-05-08T20:03:29.676685+0000","last_became_peered":"2024-05-08T20:03:29.676685+0000","last_unstale":"2024-05-08T20:03:30.346697+0000","last_undegraded":"2024-05-08T20:03:30.346697+0000","last_fullsized":"2024-05-08T20:03:30.346697+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:26:39.115370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'15","reported_seq":28,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.019528+0000","last_change":"2024-05-08T20:03:29.165983+0000","last_active":"2024-05-08T20:03:34.019528+0000","last_peered":"2024-05-08T20:03:34.019528+0000","last_clean":"2024-05-08T20:03:34.019528+0000","last_became_active":"2024-05-08T20:03:29.165645+0000","last_became_peered":"2024-05-08T20:03:29.165645+0000","last_unstale":"2024-05-08T20:03:34.019528+0000","last_undegraded":"2024-05-08T20:03:34.019528+0000","last_fullsized":"2024-05-08T20:03:34.019528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:37:50.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670619+0000","last_change":"2024-05-08T20:03:29.688949+0000","last_active":"2024-05-08T20:03:30.670619+0000","last_peered":"2024-05-08T20:03:30.670619+0000","last_clean":"2024-05-08T20:03:30.670619+0000","last_became_active":"2024-05-08T20:03:29.687174+0000","last_became_peered":"2024-05-08T20:03:29.687174+0000","last_unstale":"2024-05-08T20:03:30.670619+0000","last_undegraded":"2024-05-08T20:03:30.670619+0000","last_fullsized":"2024-05-08T20:03:30.670619+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:29:27.751738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.006283+0000","last_change":"2024-05-08T20:03:29.162951+0000","last_active":"2024-05-08T20:03:34.006283+0000","last_peered":"2024-05-08T20:03:34.006283+0000","last_clean":"2024-05-08T20:03:34.006283+0000","last_became_active":"2024-05-08T20:03:29.162589+0000","last_became_peered":"2024-05-08T20:03:29.162589+0000","last_unstale":"2024-05-08T20:03:34.006283+0000","last_undegraded":"2024-05-08T20:03:34.006283+0000","last_fullsized":"2024-05-08T20:03:34.006283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:13:13.185986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183868+0000","last_change":"2024-05-08T20:03:29.692187+0000","last_active":"2024-05-08T20:03:32.183868+0000","last_peered":"2024-05-08T20:03:32.183868+0000","last_clean":"2024-05-08T20:03:32.183868+0000","last_became_active":"2024-05-08T20:03:29.691853+0000","last_became_peered":"2024-05-08T20:03:29.691853+0000","last_unstale":"2024-05-08T20:03:32.183868+0000","last_undegraded":"2024-05-08T20:03:32.183868+0000","last_fullsized":"2024-05-08T20:03:32.183868+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:02:24.907475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.857193+0000","last_change":"2024-05-08T20:03:29.159695+0000","last_active":"2024-05-08T20:03:30.857193+0000","last_peered":"2024-05-08T20:03:30.857193+0000","last_clean":"2024-05-08T20:03:30.857193+0000","last_became_active":"2024-05-08T20:03:29.159358+0000","last_became_peered":"2024-05-08T20:03:29.159358+0000","last_unstale":"2024-05-08T20:03:30.857193+0000","last_undegraded":"2024-05-08T20:03:30.857193+0000","last_fullsized":"2024-05-08T20:03:30.857193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:30:04.211835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.414340+0000","last_change":"2024-05-08T20:03:29.685490+0000","last_active":"2024-05-08T20:03:33.414340+0000","last_peered":"2024-05-08T20:03:33.414340+0000","last_clean":"2024-05-08T20:03:33.414340+0000","last_became_active":"2024-05-08T20:03:29.685153+0000","last_became_peered":"2024-05-08T20:03:29.685153+0000","last_unstale":"2024-05-08T20:03:33.414340+0000","last_undegraded":"2024-05-08T20:03:33.414340+0000","last_fullsized":"2024-05-08T20:03:33.414340+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:06:32.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790920+0000","last_change":"2024-05-08T20:03:29.168932+0000","last_active":"2024-05-08T20:03:31.790920+0000","last_peered":"2024-05-08T20:03:31.790920+0000","last_clean":"2024-05-08T20:03:31.790920+0000","last_became_active":"2024-05-08T20:03:29.168625+0000","last_became_peered":"2024-05-08T20:03:29.168625+0000","last_unstale":"2024-05-08T20:03:31.790920+0000","last_undegraded":"2024-05-08T20:03:31.790920+0000","last_fullsized":"2024-05-08T20:03:31.790920+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:16:06.360590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790862+0000","last_change":"2024-05-08T20:03:29.679318+0000","last_active":"2024-05-08T20:03:31.790862+0000","last_peered":"2024-05-08T20:03:31.790862+0000","last_clean":"2024-05-08T20:03:31.790862+0000","last_became_active":"2024-05-08T20:03:29.678986+0000","last_became_peered":"2024-05-08T20:03:29.678986+0000","last_unstale":"2024-05-08T20:03:31.790862+0000","last_undegraded":"2024-05-08T20:03:31.790862+0000","last_fullsized":"2024-05-08T20:03:31.790862+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:27:01.320483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670997+0000","last_change":"2024-05-08T20:03:29.685281+0000","last_active":"2024-05-08T20:03:30.670997+0000","last_peered":"2024-05-08T20:03:30.670997+0000","last_clean":"2024-05-08T20:03:30.670997+0000","last_became_active":"2024-05-08T20:03:29.684501+0000","last_became_peered":"2024-05-08T20:03:29.684501+0000","last_unstale":"2024-05-08T20:03:30.670997+0000","last_undegraded":"2024-05-08T20:03:30.670997+0000","last_fullsized":"2024-05-08T20:03:30.670997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:14:39.638911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'4","reported_seq":46,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:04:03.061729+0000","last_change":"2024-05-08T20:03:29.165278+0000","last_active":"2024-05-08T20:04:03.061729+0000","last_peered":"2024-05-08T20:04:03.061729+0000","last_clean":"2024-05-08T20:04:03.061729+0000","last_became_active":"2024-05-08T20:03:29.164901+0000","last_became_peered":"2024-05-08T20:03:29.164901+0000","last_unstale":"2024-05-08T20:04:03.061729+0000","last_undegraded":"2024-05-08T20:04:03.061729+0000","last_fullsized":"2024-05-08T20:04:03.061729+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:02:43.034192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878165+0000","last_change":"2024-05-08T20:03:29.685296+0000","last_active":"2024-05-08T20:03:29.878165+0000","last_peered":"2024-05-08T20:03:29.878165+0000","last_clean":"2024-05-08T20:03:29.878165+0000","last_became_active":"2024-05-08T20:03:29.684909+0000","last_became_peered":"2024-05-08T20:03:29.684909+0000","last_unstale":"2024-05-08T20:03:29.878165+0000","last_undegraded":"2024-05-08T20:03:29.878165+0000","last_fullsized":"2024-05-08T20:03:29.878165+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:40.092769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.016464+0000","last_change":"2024-05-08T20:03:29.158016+0000","last_active":"2024-05-08T20:03:34.016464+0000","last_peered":"2024-05-08T20:03:34.016464+0000","last_clean":"2024-05-08T20:03:34.016464+0000","last_became_active":"2024-05-08T20:03:29.157635+0000","last_became_peered":"2024-05-08T20:03:29.157635+0000","last_unstale":"2024-05-08T20:03:34.016464+0000","last_undegraded":"2024-05-08T20:03:34.016464+0000","last_fullsized":"2024-05-08T20:03:34.016464+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:07:55.355837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":331,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.791247+0000","last_change":"2024-05-08T20:02:41.684821+0000","last_active":"2024-05-08T20:03:31.791247+0000","last_peered":"2024-05-08T20:03:31.791247+0000","last_clean":"2024-05-08T20:03:31.791247+0000","last_became_active":"2024-05-08T20:02:41.684413+0000","last_became_peered":"2024-05-08T20:02:41.684413+0000","last_unstale":"2024-05-08T20:03:31.791247+0000","last_undegraded":"2024-05-08T20:03:31.791247+0000","last_fullsized":"2024-05-08T20:03:31.791247+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:00:17.645281+0000","last_clean_scrub_stamp":"2024-05-08T20:00:17.645281+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:33:03.139734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.678805+0000","last_change":"2024-05-08T20:03:29.674487+0000","last_active":"2024-05-08T20:03:29.678805+0000","last_peered":"2024-05-08T20:03:29.678805+0000","last_clean":"2024-05-08T20:03:29.678805+0000","last_became_active":"2024-05-08T20:03:29.674122+0000","last_became_peered":"2024-05-08T20:03:29.674122+0000","last_unstale":"2024-05-08T20:03:29.678805+0000","last_undegraded":"2024-05-08T20:03:29.678805+0000","last_fullsized":"2024-05-08T20:03:29.678805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:47:38.401296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018435+0000","last_change":"2024-05-08T20:03:29.165420+0000","last_active":"2024-05-08T20:03:34.018435+0000","last_peered":"2024-05-08T20:03:34.018435+0000","last_clean":"2024-05-08T20:03:34.018435+0000","last_became_active":"2024-05-08T20:03:29.165075+0000","last_became_peered":"2024-05-08T20:03:29.165075+0000","last_unstale":"2024-05-08T20:03:34.018435+0000","last_undegraded":"2024-05-08T20:03:34.018435+0000","last_fullsized":"2024-05-08T20:03:34.018435+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:28:28.980327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.047685+0000","last_change":"2024-05-08T20:03:29.165940+0000","last_active":"2024-05-08T20:03:33.047685+0000","last_peered":"2024-05-08T20:03:33.047685+0000","last_clean":"2024-05-08T20:03:33.047685+0000","last_became_active":"2024-05-08T20:03:29.165615+0000","last_became_peered":"2024-05-08T20:03:29.165615+0000","last_unstale":"2024-05-08T20:03:33.047685+0000","last_undegraded":"2024-05-08T20:03:33.047685+0000","last_fullsized":"2024-05-08T20:03:33.047685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:51:28.066975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.675324+0000","last_change":"2024-05-08T20:03:29.674172+0000","last_active":"2024-05-08T20:03:29.675324+0000","last_peered":"2024-05-08T20:03:29.675324+0000","last_clean":"2024-05-08T20:03:29.675324+0000","last_became_active":"2024-05-08T20:03:29.673771+0000","last_became_peered":"2024-05-08T20:03:29.673771+0000","last_unstale":"2024-05-08T20:03:29.675324+0000","last_undegraded":"2024-05-08T20:03:29.675324+0000","last_fullsized":"2024-05-08T20:03:29.675324+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:55:50.442278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'5","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:38.196500+0000","last_change":"2024-05-08T20:03:29.166068+0000","last_active":"2024-05-08T20:03:38.196500+0000","last_peered":"2024-05-08T20:03:38.196500+0000","last_clean":"2024-05-08T20:03:38.196500+0000","last_became_active":"2024-05-08T20:03:29.165654+0000","last_became_peered":"2024-05-08T20:03:29.165654+0000","last_unstale":"2024-05-08T20:03:38.196500+0000","last_undegraded":"2024-05-08T20:03:38.196500+0000","last_fullsized":"2024-05-08T20:03:38.196500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:11:13.951907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878229+0000","last_change":"2024-05-08T20:03:29.680738+0000","last_active":"2024-05-08T20:03:29.878229+0000","last_peered":"2024-05-08T20:03:29.878229+0000","last_clean":"2024-05-08T20:03:29.878229+0000","last_became_active":"2024-05-08T20:03:29.680419+0000","last_became_peered":"2024-05-08T20:03:29.680419+0000","last_unstale":"2024-05-08T20:03:29.878229+0000","last_undegraded":"2024-05-08T20:03:29.878229+0000","last_fullsized":"2024-05-08T20:03:29.878229+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:33.006404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'4","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048865+0000","last_change":"2024-05-08T20:03:29.163340+0000","last_active":"2024-05-08T20:03:33.048865+0000","last_peered":"2024-05-08T20:03:33.048865+0000","last_clean":"2024-05-08T20:03:33.048865+0000","last_became_active":"2024-05-08T20:03:29.162995+0000","last_became_peered":"2024-05-08T20:03:29.162995+0000","last_unstale":"2024-05-08T20:03:33.048865+0000","last_undegraded":"2024-05-08T20:03:33.048865+0000","last_fullsized":"2024-05-08T20:03:33.048865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:21:18.097991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790227+0000","last_change":"2024-05-08T20:03:29.683013+0000","last_active":"2024-05-08T20:03:31.790227+0000","last_peered":"2024-05-08T20:03:31.790227+0000","last_clean":"2024-05-08T20:03:31.790227+0000","last_became_active":"2024-05-08T20:03:29.682648+0000","last_became_peered":"2024-05-08T20:03:29.682648+0000","last_unstale":"2024-05-08T20:03:31.790227+0000","last_undegraded":"2024-05-08T20:03:31.790227+0000","last_fullsized":"2024-05-08T20:03:31.790227+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:24:11.950896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.048514+0000","last_change":"2024-05-08T20:03:29.163521+0000","last_active":"2024-05-08T20:03:33.048514+0000","last_peered":"2024-05-08T20:03:33.048514+0000","last_clean":"2024-05-08T20:03:33.048514+0000","last_became_active":"2024-05-08T20:03:29.163181+0000","last_became_peered":"2024-05-08T20:03:29.163181+0000","last_unstale":"2024-05-08T20:03:33.048514+0000","last_undegraded":"2024-05-08T20:03:33.048514+0000","last_fullsized":"2024-05-08T20:03:33.048514+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:57:46.167984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790172+0000","last_change":"2024-05-08T20:03:29.678246+0000","last_active":"2024-05-08T20:03:31.790172+0000","last_peered":"2024-05-08T20:03:31.790172+0000","last_clean":"2024-05-08T20:03:31.790172+0000","last_became_active":"2024-05-08T20:03:29.677868+0000","last_became_peered":"2024-05-08T20:03:29.677868+0000","last_unstale":"2024-05-08T20:03:31.790172+0000","last_undegraded":"2024-05-08T20:03:31.790172+0000","last_fullsized":"2024-05-08T20:03:31.790172+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:37:34.232071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'3","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049862+0000","last_change":"2024-05-08T20:03:29.170314+0000","last_active":"2024-05-08T20:03:33.049862+0000","last_peered":"2024-05-08T20:03:33.049862+0000","last_clean":"2024-05-08T20:03:33.049862+0000","last_became_active":"2024-05-08T20:03:29.169952+0000","last_became_peered":"2024-05-08T20:03:29.169952+0000","last_unstale":"2024-05-08T20:03:33.049862+0000","last_undegraded":"2024-05-08T20:03:33.049862+0000","last_fullsized":"2024-05-08T20:03:33.049862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T01:10:34.399603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183806+0000","last_change":"2024-05-08T20:03:29.691046+0000","last_active":"2024-05-08T20:03:32.183806+0000","last_peered":"2024-05-08T20:03:32.183806+0000","last_clean":"2024-05-08T20:03:32.183806+0000","last_became_active":"2024-05-08T20:03:29.690681+0000","last_became_peered":"2024-05-08T20:03:29.690681+0000","last_unstale":"2024-05-08T20:03:32.183806+0000","last_undegraded":"2024-05-08T20:03:32.183806+0000","last_fullsized":"2024-05-08T20:03:32.183806+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:53:01.340274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'1","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.356235+0000","last_change":"2024-05-08T20:03:29.170122+0000","last_active":"2024-05-08T20:03:32.356235+0000","last_peered":"2024-05-08T20:03:32.356235+0000","last_clean":"2024-05-08T20:03:32.356235+0000","last_became_active":"2024-05-08T20:03:29.169766+0000","last_became_peered":"2024-05-08T20:03:29.169766+0000","last_unstale":"2024-05-08T20:03:32.356235+0000","last_undegraded":"2024-05-08T20:03:32.356235+0000","last_fullsized":"2024-05-08T20:03:32.356235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:27:55.969796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878178+0000","last_change":"2024-05-08T20:03:29.678943+0000","last_active":"2024-05-08T20:03:29.878178+0000","last_peered":"2024-05-08T20:03:29.878178+0000","last_clean":"2024-05-08T20:03:29.878178+0000","last_became_active":"2024-05-08T20:03:29.678616+0000","last_became_peered":"2024-05-08T20:03:29.678616+0000","last_unstale":"2024-05-08T20:03:29.878178+0000","last_undegraded":"2024-05-08T20:03:29.878178+0000","last_fullsized":"2024-05-08T20:03:29.878178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T00:43:28.997261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:33.049422+0000","last_change":"2024-05-08T20:03:29.161096+0000","last_active":"2024-05-08T20:03:33.049422+0000","last_peered":"2024-05-08T20:03:33.049422+0000","last_clean":"2024-05-08T20:03:33.049422+0000","last_became_active":"2024-05-08T20:03:29.160768+0000","last_became_peered":"2024-05-08T20:03:29.160768+0000","last_unstale":"2024-05-08T20:03:33.049422+0000","last_undegraded":"2024-05-08T20:03:33.049422+0000","last_fullsized":"2024-05-08T20:03:33.049422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:12:38.830599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346794+0000","last_change":"2024-05-08T20:03:29.690624+0000","last_active":"2024-05-08T20:03:30.346794+0000","last_peered":"2024-05-08T20:03:30.346794+0000","last_clean":"2024-05-08T20:03:30.346794+0000","last_became_active":"2024-05-08T20:03:29.689889+0000","last_became_peered":"2024-05-08T20:03:29.689889+0000","last_unstale":"2024-05-08T20:03:30.346794+0000","last_undegraded":"2024-05-08T20:03:30.346794+0000","last_fullsized":"2024-05-08T20:03:30.346794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:44:05.968617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'3","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:34.018520+0000","last_change":"2024-05-08T20:03:29.164559+0000","last_active":"2024-05-08T20:03:34.018520+0000","last_peered":"2024-05-08T20:03:34.018520+0000","last_clean":"2024-05-08T20:03:34.018520+0000","last_became_active":"2024-05-08T20:03:29.164201+0000","last_became_peered":"2024-05-08T20:03:29.164201+0000","last_unstale":"2024-05-08T20:03:34.018520+0000","last_undegraded":"2024-05-08T20:03:34.018520+0000","last_fullsized":"2024-05-08T20:03:34.018520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:59:12.678098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346856+0000","last_change":"2024-05-08T20:03:29.690256+0000","last_active":"2024-05-08T20:03:30.346856+0000","last_peered":"2024-05-08T20:03:30.346856+0000","last_clean":"2024-05-08T20:03:30.346856+0000","last_became_active":"2024-05-08T20:03:29.689310+0000","last_became_peered":"2024-05-08T20:03:29.689310+0000","last_unstale":"2024-05-08T20:03:30.346856+0000","last_undegraded":"2024-05-08T20:03:30.346856+0000","last_fullsized":"2024-05-08T20:03:30.346856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:33:49.424266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"79'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.670818+0000","last_change":"2024-05-08T20:03:29.164733+0000","last_active":"2024-05-08T20:03:30.670818+0000","last_peered":"2024-05-08T20:03:30.670818+0000","last_clean":"2024-05-08T20:03:30.670818+0000","last_became_active":"2024-05-08T20:03:29.164395+0000","last_became_peered":"2024-05-08T20:03:29.164395+0000","last_unstale":"2024-05-08T20:03:30.670818+0000","last_undegraded":"2024-05-08T20:03:30.670818+0000","last_fullsized":"2024-05-08T20:03:30.670818+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:16:48.650690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790860+0000","last_change":"2024-05-08T20:03:29.679616+0000","last_active":"2024-05-08T20:03:31.790860+0000","last_peered":"2024-05-08T20:03:31.790860+0000","last_clean":"2024-05-08T20:03:31.790860+0000","last_became_active":"2024-05-08T20:03:29.679235+0000","last_became_peered":"2024-05-08T20:03:29.679235+0000","last_unstale":"2024-05-08T20:03:31.790860+0000","last_undegraded":"2024-05-08T20:03:31.790860+0000","last_fullsized":"2024-05-08T20:03:31.790860+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T02:14:20.825327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"79'2","reported_seq":14,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.687694+0000","last_change":"2024-05-08T20:03:29.165731+0000","last_active":"2024-05-08T20:03:29.687694+0000","last_peered":"2024-05-08T20:03:29.687694+0000","last_clean":"2024-05-08T20:03:29.687694+0000","last_became_active":"2024-05-08T20:03:29.165397+0000","last_became_peered":"2024-05-08T20:03:29.165397+0000","last_unstale":"2024-05-08T20:03:29.687694+0000","last_undegraded":"2024-05-08T20:03:29.687694+0000","last_fullsized":"2024-05-08T20:03:29.687694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:28.136977+0000","last_clean_scrub_stamp":"2024-05-08T20:03:28.136977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T23:14:55.541984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.346880+0000","last_change":"2024-05-08T20:03:29.682523+0000","last_active":"2024-05-08T20:03:30.346880+0000","last_peered":"2024-05-08T20:03:30.346880+0000","last_clean":"2024-05-08T20:03:30.346880+0000","last_became_active":"2024-05-08T20:03:29.682188+0000","last_became_peered":"2024-05-08T20:03:29.682188+0000","last_unstale":"2024-05-08T20:03:30.346880+0000","last_undegraded":"2024-05-08T20:03:30.346880+0000","last_fullsized":"2024-05-08T20:03:30.346880+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T05:50:16.871494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183830+0000","last_change":"2024-05-08T20:03:29.692315+0000","last_active":"2024-05-08T20:03:32.183830+0000","last_peered":"2024-05-08T20:03:32.183830+0000","last_clean":"2024-05-08T20:03:32.183830+0000","last_became_active":"2024-05-08T20:03:29.691944+0000","last_became_peered":"2024-05-08T20:03:29.691944+0000","last_unstale":"2024-05-08T20:03:32.183830+0000","last_undegraded":"2024-05-08T20:03:32.183830+0000","last_fullsized":"2024-05-08T20:03:32.183830+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T22:46:02.614054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466270+0000","last_change":"2024-05-08T20:03:29.677763+0000","last_active":"2024-05-08T20:03:31.466270+0000","last_peered":"2024-05-08T20:03:31.466270+0000","last_clean":"2024-05-08T20:03:31.466270+0000","last_became_active":"2024-05-08T20:03:29.677282+0000","last_became_peered":"2024-05-08T20:03:29.677282+0000","last_unstale":"2024-05-08T20:03:31.466270+0000","last_undegraded":"2024-05-08T20:03:31.466270+0000","last_fullsized":"2024-05-08T20:03:31.466270+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:32:03.039093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466116+0000","last_change":"2024-05-08T20:03:29.680085+0000","last_active":"2024-05-08T20:03:31.466116+0000","last_peered":"2024-05-08T20:03:31.466116+0000","last_clean":"2024-05-08T20:03:31.466116+0000","last_became_active":"2024-05-08T20:03:29.679793+0000","last_became_peered":"2024-05-08T20:03:29.679793+0000","last_unstale":"2024-05-08T20:03:31.466116+0000","last_undegraded":"2024-05-08T20:03:31.466116+0000","last_fullsized":"2024-05-08T20:03:31.466116+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:19:24.679742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.790883+0000","last_change":"2024-05-08T20:03:29.679987+0000","last_active":"2024-05-08T20:03:31.790883+0000","last_peered":"2024-05-08T20:03:31.790883+0000","last_clean":"2024-05-08T20:03:31.790883+0000","last_became_active":"2024-05-08T20:03:29.679630+0000","last_became_peered":"2024-05-08T20:03:29.679630+0000","last_unstale":"2024-05-08T20:03:31.790883+0000","last_undegraded":"2024-05-08T20:03:31.790883+0000","last_fullsized":"2024-05-08T20:03:31.790883+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T07:21:25.119165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.674002+0000","last_change":"2024-05-08T20:03:29.672906+0000","last_active":"2024-05-08T20:03:29.674002+0000","last_peered":"2024-05-08T20:03:29.674002+0000","last_clean":"2024-05-08T20:03:29.674002+0000","last_became_active":"2024-05-08T20:03:29.672522+0000","last_became_peered":"2024-05-08T20:03:29.672522+0000","last_unstale":"2024-05-08T20:03:29.674002+0000","last_undegraded":"2024-05-08T20:03:29.674002+0000","last_fullsized":"2024-05-08T20:03:29.674002+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:07:09.803843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183855+0000","last_change":"2024-05-08T20:03:29.692439+0000","last_active":"2024-05-08T20:03:32.183855+0000","last_peered":"2024-05-08T20:03:32.183855+0000","last_clean":"2024-05-08T20:03:32.183855+0000","last_became_active":"2024-05-08T20:03:29.691768+0000","last_became_peered":"2024-05-08T20:03:29.691768+0000","last_unstale":"2024-05-08T20:03:32.183855+0000","last_undegraded":"2024-05-08T20:03:32.183855+0000","last_fullsized":"2024-05-08T20:03:32.183855+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:40:36.412128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:31.466556+0000","last_change":"2024-05-08T20:03:29.687551+0000","last_active":"2024-05-08T20:03:31.466556+0000","last_peered":"2024-05-08T20:03:31.466556+0000","last_clean":"2024-05-08T20:03:31.466556+0000","last_became_active":"2024-05-08T20:03:29.687188+0000","last_became_peered":"2024-05-08T20:03:29.687188+0000","last_unstale":"2024-05-08T20:03:31.466556+0000","last_undegraded":"2024-05-08T20:03:31.466556+0000","last_fullsized":"2024-05-08T20:03:31.466556+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:36.167104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878210+0000","last_change":"2024-05-08T20:03:29.679077+0000","last_active":"2024-05-08T20:03:29.878210+0000","last_peered":"2024-05-08T20:03:29.878210+0000","last_clean":"2024-05-08T20:03:29.878210+0000","last_became_active":"2024-05-08T20:03:29.678712+0000","last_became_peered":"2024-05-08T20:03:29.678712+0000","last_unstale":"2024-05-08T20:03:29.878210+0000","last_undegraded":"2024-05-08T20:03:29.878210+0000","last_fullsized":"2024-05-08T20:03:29.878210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T08:02:25.023184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.671086+0000","last_change":"2024-05-08T20:03:29.677428+0000","last_active":"2024-05-08T20:03:30.671086+0000","last_peered":"2024-05-08T20:03:30.671086+0000","last_clean":"2024-05-08T20:03:30.671086+0000","last_became_active":"2024-05-08T20:03:29.676210+0000","last_became_peered":"2024-05-08T20:03:29.676210+0000","last_unstale":"2024-05-08T20:03:30.671086+0000","last_undegraded":"2024-05-08T20:03:30.671086+0000","last_fullsized":"2024-05-08T20:03:30.671086+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:56:44.508673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.878127+0000","last_change":"2024-05-08T20:03:29.676957+0000","last_active":"2024-05-08T20:03:29.878127+0000","last_peered":"2024-05-08T20:03:29.878127+0000","last_clean":"2024-05-08T20:03:29.878127+0000","last_became_active":"2024-05-08T20:03:29.676580+0000","last_became_peered":"2024-05-08T20:03:29.676580+0000","last_unstale":"2024-05-08T20:03:29.878127+0000","last_undegraded":"2024-05-08T20:03:29.878127+0000","last_fullsized":"2024-05-08T20:03:29.878127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T06:08:32.710411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:30.301687+0000","last_change":"2024-05-08T20:03:29.685336+0000","last_active":"2024-05-08T20:03:30.301687+0000","last_peered":"2024-05-08T20:03:30.301687+0000","last_clean":"2024-05-08T20:03:30.301687+0000","last_became_active":"2024-05-08T20:03:29.685025+0000","last_became_peered":"2024-05-08T20:03:29.685025+0000","last_unstale":"2024-05-08T20:03:30.301687+0000","last_undegraded":"2024-05-08T20:03:30.301687+0000","last_fullsized":"2024-05-08T20:03:30.301687+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T04:05:24.170359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:29.682488+0000","last_change":"2024-05-08T20:03:29.681684+0000","last_active":"2024-05-08T20:03:29.682488+0000","last_peered":"2024-05-08T20:03:29.682488+0000","last_clean":"2024-05-08T20:03:29.682488+0000","last_became_active":"2024-05-08T20:03:29.681302+0000","last_became_peered":"2024-05-08T20:03:29.681302+0000","last_unstale":"2024-05-08T20:03:29.682488+0000","last_undegraded":"2024-05-08T20:03:29.682488+0000","last_fullsized":"2024-05-08T20:03:29.682488+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:55:48.963279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-05-08T20:03:32.183840+0000","last_change":"2024-05-08T20:03:29.689885+0000","last_active":"2024-05-08T20:03:32.183840+0000","last_peered":"2024-05-08T20:03:32.183840+0000","last_clean":"2024-05-08T20:03:32.183840+0000","last_became_active":"2024-05-08T20:03:29.689562+0000","last_became_peered":"2024-05-08T20:03:29.689562+0000","last_unstale":"2024-05-08T20:03:32.183840+0000","last_undegraded":"2024-05-08T20:03:32.183840+0000","last_fullsized":"2024-05-08T20:03:32.183840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T20:03:29.139111+0000","last_clean_scrub_stamp":"2024-05-08T20:03:29.139111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-10T03:52:24.363101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":246656,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60975,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":230,"num_read_kb":177,"num_write":149,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":182925,"data_compressed":5568,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547218,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":868352,"data_stored":416405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52400000000000002}]},{"osd":1,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.495},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.71099999999999997}]},{"osd":2,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.41299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":4,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64000000000000001}]},{"osd":5,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.61799999999999999}]},{"osd":6,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65900000000000003}]},{"osd":7,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.75700000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]},{"osd":9,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.73199999999999998}]},{"osd":10,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.74399999999999999}]}]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":1007616,"data_stored":1065018,"data_compressed":37562,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":1598,"internal_metadata":31848898},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.65300000000000002}]},{"osd":2,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.69499999999999995}]},{"osd":3,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.60099999999999998}]},{"osd":4,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.749},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.82399999999999995}]},{"osd":6,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.81200000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":8,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.88700000000000001}]},{"osd":9,"last update":"Wed May 8 20:03:42 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.79600000000000004}]},{"osd":11,"last update":"Wed May 8 20:03:57 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.92400000000000004}]}]},{"osd":9,"up_from":62,"seq":266287972376,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":884736,"data_stored":416641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54100000000000004}]},{"osd":1,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.60699999999999998}]},{"osd":2,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.70399999999999996}]},{"osd":3,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.68100000000000005}]},{"osd":5,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.623}]},{"osd":6,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.46300000000000002}]},{"osd":7,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.753},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.69399999999999995}]},{"osd":8,"last update":"Wed May 8 20:03:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.554,"5min":1.554,"15min":1.554},"last":0.78100000000000003}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.73999999999999999}]}]},{"osd":8,"up_from":55,"seq":236223201308,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31972,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713180,"statfs":{"total":95995035648,"available":95962296320,"internally_reserved":0,"allocated":880640,"data_stored":416230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61799999999999999,"15min":0.624},"min":{"1min":0.36699999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.85599999999999998,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38900000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84999999999999998,"5min":1.252,"15min":1.252},"last":0.65700000000000003}]},{"osd":1,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64500000000000002,"15min":0.64200000000000002},"min":{"1min":0.437,"5min":0.435,"15min":0.435},"max":{"1min":0.92100000000000004,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.61899999999999999,"15min":0.61599999999999999},"min":{"1min":0.43099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81599999999999995,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.61699999999999999}]},{"osd":2,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.439},"min":{"1min":0.316,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.73499999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.505},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.502,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":1.6439999999999999,"15min":1.6439999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.57399999999999995},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.47999999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.83699999999999997,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.84199999999999997}]},{"osd":4,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59199999999999997,"15min":0.58599999999999997},"min":{"1min":0.45200000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88400000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.754}]},{"osd":5,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.78800000000000003,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72299999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.67800000000000005}]},{"osd":6,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.71099999999999997,"15min":0.70499999999999996},"min":{"1min":0.57699999999999996,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.89300000000000002,"5min":1.419,"15min":1.419},"last":0.874},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.55700000000000005,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83599999999999997,"5min":1.3,"15min":1.3},"last":0.85299999999999998}]},{"osd":7,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.86299999999999999,"5min":1.276,"15min":1.276},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66800000000000004,"15min":0.66500000000000004},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82099999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73799999999999999}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.89600000000000002}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.82199999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":7,"up_from":48,"seq":206158430239,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":1008397,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.39900000000000002},"min":{"1min":0.29899999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.42899999999999999,"15min":0.41799999999999998},"min":{"1min":0.33000000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.58999999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.436},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.58399999999999996},"min":{"1min":0.40500000000000003,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79800000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73999999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.44900000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.68799999999999994,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.51100000000000001}]},{"osd":4,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.317,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64500000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63,"15min":0.627},"min":{"1min":0.45700000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.85599999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Wed May 8 20:03:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65700000000000003,"15min":0.65900000000000003},"min":{"1min":0.47799999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88700000000000001,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.66900000000000004,"15min":0.66700000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93200000000000005,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68600000000000005}]},{"osd":8,"last update":"Wed May 8 20:04:03 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.67500000000000004,"15min":0.67100000000000004},"min":{"1min":0.54400000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.91600000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.70799999999999996},"min":{"1min":0.63800000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93400000000000005,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.64700000000000002}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.66300000000000003}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.623}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":6,"up_from":43,"seq":184683593763,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27868,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717284,"statfs":{"total":95995035648,"available":95966498816,"internally_reserved":0,"allocated":872448,"data_stored":416030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.41399999999999998,"15min":0.40699999999999997},"min":{"1min":0.28899999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.433},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.437,"15min":0.434},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.45500000000000002}]},{"osd":1,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.622,"15min":0.61599999999999999},"min":{"1min":0.46899999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83699999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54700000000000004,"15min":0.54800000000000004},"min":{"1min":0.38300000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70299999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.53400000000000003}]},{"osd":2,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60399999999999998,"15min":0.60899999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80400000000000005,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.621},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.66100000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.90700000000000003,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":4,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61899999999999999,"15min":0.625},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.73899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.504}]},{"osd":5,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.626,"15min":0.627},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.68600000000000005,"15min":0.69199999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.84899999999999998,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Wed May 8 20:03:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.63,"5min":0.621,"15min":0.621},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.63}]},{"osd":8,"last update":"Wed May 8 20:03:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70899999999999996}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.48599999999999999}]},{"osd":10,"last update":"Wed May 8 20:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.65800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":472618,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.503,"15min":0.48599999999999999},"min":{"1min":0.38900000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.496,"15min":0.47899999999999998},"min":{"1min":0.34999999999999998,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56399999999999995}]},{"osd":2,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.47699999999999998,"15min":0.45600000000000002},"min":{"1min":0.375,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48799999999999999,"15min":0.46700000000000003},"min":{"1min":0.42099999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55500000000000005,"15min":0.52500000000000002},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81000000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.56799999999999995,"15min":0.54000000000000004},"min":{"1min":0.39800000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.82299999999999995}]},{"osd":4,"last update":"Wed May 8 20:03:00 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41099999999999998,"15min":0.40699999999999997},"min":{"1min":0.30499999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.43099999999999999,"15min":0.42799999999999999},"min":{"1min":0.34499999999999997,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58599999999999997,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.69699999999999995}]},{"osd":5,"last update":"Wed May 8 20:03:14 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.56799999999999995,"15min":0.55700000000000005},"min":{"1min":0.46700000000000003,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.72999999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.57799999999999996,"15min":0.56999999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.75600000000000001}]},{"osd":6,"last update":"Wed May 8 20:03:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.61299999999999999,"15min":0.60299999999999998},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63300000000000001,"15min":0.626},"min":{"1min":0.51500000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.73899999999999999}]},{"osd":7,"last update":"Wed May 8 20:03:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54600000000000004,"15min":0.54300000000000004},"min":{"1min":0.41799999999999998,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.442,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.79000000000000004}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.93200000000000005}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.84099999999999997}]},{"osd":10,"last update":"Wed May 8 20:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.871},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.88200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31984,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713168,"statfs":{"total":95995035648,"available":95962284032,"internally_reserved":0,"allocated":892928,"data_stored":417301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":0.63100000000000001,"15min":0.53700000000000003},"min":{"1min":0.35999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":12.023999999999999,"5min":12.023999999999999,"15min":12.023999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.55500000000000005,"15min":0.50700000000000001},"min":{"1min":0.39000000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.66600000000000004}]},{"osd":2,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.57999999999999996,"15min":0.54600000000000004},"min":{"1min":0.41099999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.55900000000000005,"15min":0.53900000000000003},"min":{"1min":0.435,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.82599999999999996}]},{"osd":3,"last update":"Wed May 8 20:02:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.45100000000000001,"15min":0.44500000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.48999999999999999,"15min":0.48299999999999998},"min":{"1min":0.41599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.72399999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46800000000000003}]},{"osd":4,"last update":"Wed May 8 20:03:59 2024","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":0.67300000000000004,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":11.933999999999999,"5min":11.933999999999999,"15min":11.933999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.621,"15min":0.59099999999999997},"min":{"1min":0.53000000000000003,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.76600000000000001}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46800000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.69199999999999995,"15min":0.67900000000000005},"min":{"1min":0.55800000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.73399999999999999}]},{"osd":6,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.61099999999999999,"15min":0.60699999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85599999999999998,"5min":1.014,"15min":1.014},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.258,"5min":0.84399999999999997,"15min":0.77500000000000002},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":12.125999999999999,"5min":12.125999999999999,"15min":12.125999999999999},"last":0.89800000000000002}]},{"osd":9,"last update":"Wed May 8 20:03:24 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.98399999999999999}]},{"osd":10,"last update":"Wed May 8 20:03:41 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.879}]},{"osd":11,"last update":"Wed May 8 20:03:59 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.02},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":12.093999999999999,"5min":12.093999999999999,"15min":12.093999999999999},"last":0.94499999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411378,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":474193,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.48899999999999999,"15min":0.47999999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.45100000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.48899999999999999,"15min":0.46500000000000002},"min":{"1min":0.38600000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.49199999999999999,"15min":0.46999999999999997},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.70099999999999996}]},{"osd":3,"last update":"Wed May 8 20:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.51900000000000002,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.77300000000000002,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.56699999999999995,"15min":0.54300000000000004},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81200000000000006,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.755}]},{"osd":4,"last update":"Wed May 8 20:02:59 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.53600000000000003,"15min":0.53000000000000003},"min":{"1min":0.437,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Wed May 8 20:03:09 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.44800000000000001,"15min":0.438},"min":{"1min":0.32000000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.66400000000000003}]},{"osd":6,"last update":"Wed May 8 20:03:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63,"15min":0.63},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.89000000000000001,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.45100000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.86599999999999999}]},{"osd":7,"last update":"Wed May 8 20:02:48 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.77900000000000003}]},{"osd":8,"last update":"Wed May 8 20:04:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.58199999999999996,"15min":0.56499999999999995},"min":{"1min":0.44500000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.49199999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.877,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.84999999999999998}]},{"osd":9,"last update":"Wed May 8 20:03:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.90200000000000002}]},{"osd":10,"last update":"Wed May 8 20:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.88}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":3,"up_from":24,"seq":103079215149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31980,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713172,"statfs":{"total":95995035648,"available":95962288128,"internally_reserved":0,"allocated":888832,"data_stored":416341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.39100000000000001,"15min":0.379},"min":{"1min":0.309,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.41599999999999998,"15min":0.40699999999999997},"min":{"1min":0.311,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.66400000000000003,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.42299999999999999}]},{"osd":1,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54100000000000004,"15min":0.51800000000000002},"min":{"1min":0.42299999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54800000000000004},"min":{"1min":0.42199999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.77100000000000002,"5min":1.119,"15min":1.119},"last":0.63600000000000001}]},{"osd":2,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.47999999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.439,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76400000000000001,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.65100000000000002}]},{"osd":4,"last update":"Wed May 8 20:04:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.48799999999999999,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.59399999999999997,"15min":0.58299999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.69999999999999996}]},{"osd":5,"last update":"Wed May 8 20:03:13 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65000000000000002,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86099999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.69399999999999995,"15min":0.69199999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.88,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61499999999999999}]},{"osd":6,"last update":"Wed May 8 20:03:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.57399999999999995,"15min":0.56799999999999995},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.871,"5min":0.88,"15min":0.88},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56000000000000005,"15min":0.56200000000000006},"min":{"1min":0.38300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.81000000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.38200000000000001}]},{"osd":7,"last update":"Wed May 8 20:03:52 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.49099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.71699999999999997,"15min":0.70899999999999996},"min":{"1min":0.49099999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.73199999999999998}]},{"osd":8,"last update":"Wed May 8 20:03:03 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.628},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.77000000000000002}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.50800000000000001}]},{"osd":10,"last update":"Wed May 8 20:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.76100000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":4,"up_from":31,"seq":133143986218,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31968,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":93713184,"statfs":{"total":95995035648,"available":95962300416,"internally_reserved":0,"allocated":876544,"data_stored":416812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:02:56 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.42699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.39100000000000001,"15min":0.372},"min":{"1min":0.28199999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.36699999999999999},"min":{"1min":0.33200000000000002,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.57999999999999996,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.379,"15min":0.379},"max":{"1min":0.76600000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.66700000000000004}]},{"osd":3,"last update":"Wed May 8 20:03:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.55100000000000005,"15min":0.52100000000000002},"min":{"1min":0.45700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.69999999999999996,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.629},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.42099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.57299999999999995}]},{"osd":5,"last update":"Wed May 8 20:03:16 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.60699999999999998,"15min":0.60399999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.64400000000000002}]},{"osd":6,"last update":"Wed May 8 20:03:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.42499999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95999999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.44600000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Wed May 8 20:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.54900000000000004,"15min":0.53700000000000003},"min":{"1min":0.36699999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57099999999999995,"15min":0.56000000000000005},"min":{"1min":0.439,"5min":0.315,"15min":0.315},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.74099999999999999}]},{"osd":8,"last update":"Wed May 8 20:04:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84899999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.745,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.81299999999999994,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.75800000000000001}]},{"osd":9,"last update":"Wed May 8 20:03:22 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.94899999999999995}]},{"osd":10,"last update":"Wed May 8 20:03:38 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.89900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]},{"osd":5,"up_from":36,"seq":154618822695,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":1007736,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.48899999999999999,"15min":0.48099999999999998},"min":{"1min":0.313,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.51200000000000001,"15min":0.5},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55400000000000005}]},{"osd":1,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.52100000000000002,"15min":0.50700000000000001},"min":{"1min":0.39100000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.624},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.40300000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60099999999999998}]},{"osd":2,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.374,"15min":0.36599999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.38200000000000001}]},{"osd":3,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.52900000000000003,"15min":0.52000000000000002},"min":{"1min":0.38600000000000001,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Wed May 8 20:03:15 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Wed May 8 20:03:31 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58299999999999996,"15min":0.57499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69299999999999995}]},{"osd":7,"last update":"Wed May 8 20:03:50 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.60899999999999999,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.75900000000000001}]},{"osd":8,"last update":"Wed May 8 20:03:04 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.501},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.745}]},{"osd":9,"last update":"Wed May 8 20:03:25 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.72299999999999998}]},{"osd":10,"last update":"Wed May 8 20:03:41 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.79600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35706,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":57068,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":58370,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":58991,"data_compressed":1856,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T20:04:11.006 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T20:04:11.006 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T20:04:11.006 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-08T20:04:11.006 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-08T20:04:11.263 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:12.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 -- 172.21.15.33:0/698284498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac068950 msgr2=0x7fa1ac068db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:12.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/698284498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac068950 0x7fa1ac068db0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa1a0009990 tx=0x7fa1a0009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 -- 172.21.15.33:0/698284498 shutdown_connections 2024-05-08T20:04:12.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/698284498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1ac0692f0 0x7fa1ac10de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/698284498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1ac107020 0x7fa1ac107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/698284498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac068950 0x7fa1ac068db0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 -- 172.21.15.33:0/698284498 >> 172.21.15.33:0/698284498 conn(0x7fa1ac075f80 msgr2=0x7fa1ac076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:12.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 -- 172.21.15.33:0/698284498 shutdown_connections 2024-05-08T20:04:12.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.284+0000 7fa1b09b0700 1 -- 172.21.15.33:0/698284498 wait complete. 2024-05-08T20:04:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 Processor -- start 2024-05-08T20:04:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 -- start start 2024-05-08T20:04:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1ac068950 0x7fa1ac1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac0692f0 0x7fa1ac197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1ac107020 0x7fa1ac19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac19c380 con 0x7fa1ac0692f0 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac19c4f0 con 0x7fa1ac107020 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1b09b0700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac19c6b0 con 0x7fa1ac068950 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1a9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac0692f0 0x7fa1ac197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1a9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac0692f0 0x7fa1ac197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:38672/0 (socket says 172.21.15.33:38672) 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1a9d9b700 1 -- 172.21.15.33:0/1634250529 learned_addr learned my addr 172.21.15.33:0/1634250529 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1aad9d700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1ac107020 0x7fa1ac19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.285+0000 7fa1aa59c700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1ac068950 0x7fa1ac1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1a9d9b700 1 -- 172.21.15.33:0/1634250529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1ac068950 msgr2=0x7fa1ac1974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1a9d9b700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1ac068950 0x7fa1ac1974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1a9d9b700 1 -- 172.21.15.33:0/1634250529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1ac107020 msgr2=0x7fa1ac19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:12.276 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1a9d9b700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1ac107020 0x7fa1ac19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1a9d9b700 1 -- 172.21.15.33:0/1634250529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a00095f0 con 0x7fa1ac0692f0 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1aad9d700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1ac107020 0x7fa1ac19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1a9d9b700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac0692f0 0x7fa1ac197a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00098e0 tx=0x7fa1a000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa19b7fe700 1 -- 172.21.15.33:0/1634250529 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a001d070 con 0x7fa1ac0692f0 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac19c930 con 0x7fa1ac0692f0 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa19b7fe700 1 -- 172.21.15.33:0/1634250529 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa1a0003680 con 0x7fa1ac0692f0 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa19b7fe700 1 -- 172.21.15.33:0/1634250529 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0017650 con 0x7fa1ac0692f0 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.286+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac1a41f0 con 0x7fa1ac0692f0 2024-05-08T20:04:12.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.287+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1ac109540 con 0x7fa1ac0692f0 2024-05-08T20:04:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.288+0000 7fa19b7fe700 1 -- 172.21.15.33:0/1634250529 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa1a0022470 con 0x7fa1ac0692f0 2024-05-08T20:04:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.289+0000 7fa19b7fe700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa1940a11b0 0x7fa1940a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.289+0000 7fa1aa59c700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa1940a11b0 0x7fa1940a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:12.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.289+0000 7fa19b7fe700 1 -- 172.21.15.33:0/1634250529 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa1a00ce010 con 0x7fa1ac0692f0 2024-05-08T20:04:12.279 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.289+0000 7fa1aa59c700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa1940a11b0 0x7fa1940a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009c90 tx=0x7fa19c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:12.282 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.292+0000 7fa19b7fe700 1 -- 172.21.15.33:0/1634250529 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa1a0097780 con 0x7fa1ac0692f0 2024-05-08T20:04:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.553+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa1ac04ec90 con 0x7fa1ac0692f0 2024-05-08T20:04:12.542 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.553+0000 7fa19b7fe700 1 -- 172.21.15.33:0/1634250529 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa1a009ada0 con 0x7fa1ac0692f0 2024-05-08T20:04:12.543 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:12.543 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa1940a11b0 msgr2=0x7fa1940a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa1940a11b0 0x7fa1940a3670 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa19c009c90 tx=0x7fa19c009040 comp rx=0 tx=0).stop 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac0692f0 msgr2=0x7fa1ac197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac0692f0 0x7fa1ac197a10 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa1a00098e0 tx=0x7fa1a000f690 comp rx=0 tx=0).stop 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 shutdown_connections 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa1ac107020 0x7fa1ac19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa1940a11b0 0x7fa1940a3670 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1ac068950 0x7fa1ac1974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 --2- 172.21.15.33:0/1634250529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1ac0692f0 0x7fa1ac197a10 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:12.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 >> 172.21.15.33:0/1634250529 conn(0x7fa1ac075f80 msgr2=0x7fa1ac0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:12.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 shutdown_connections 2024-05-08T20:04:12.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:12.555+0000 7fa1b09b0700 1 -- 172.21.15.33:0/1634250529 wait complete. 2024-05-08T20:04:12.565 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:12 smithi033 ceph-mon[42490]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:04:12.565 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:12 smithi033 ceph-mon[42490]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T20:04:12.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:12 smithi082 ceph-mon[46774]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:04:12.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:12 smithi082 ceph-mon[46774]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T20:04:12.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:12 smithi132 ceph-mon[47484]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T20:04:12.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:12 smithi132 ceph-mon[47484]: pgmap v242: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T20:04:12.908 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-08T20:04:12.909 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:04:13.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 -- 172.21.15.33:0/4154860901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c106b40 msgr2=0x7f286c108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 --2- 172.21.15.33:0/4154860901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c106b40 0x7f286c108fb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f286400b0a0 tx=0x7f286400b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 -- 172.21.15.33:0/4154860901 shutdown_connections 2024-05-08T20:04:13.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 --2- 172.21.15.33:0/4154860901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c106b40 0x7f286c108fb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.060 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 --2- 172.21.15.33:0/4154860901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f286c1018e0 0x7f286c103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 --2- 172.21.15.33:0/4154860901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f286c104210 0x7f286c106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 -- 172.21.15.33:0/4154860901 >> 172.21.15.33:0/4154860901 conn(0x7f286c0fb2f0 msgr2=0x7f286c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:13.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 -- 172.21.15.33:0/4154860901 shutdown_connections 2024-05-08T20:04:13.061 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.070+0000 7f28736f4700 1 -- 172.21.15.33:0/4154860901 wait complete. 2024-05-08T20:04:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 Processor -- start 2024-05-08T20:04:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 -- start start 2024-05-08T20:04:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f286c1018e0 0x7f286c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c104210 0x7f286c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f286c106b40 0x7f286c1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1a0c60 con 0x7f286c104210 2024-05-08T20:04:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1a0da0 con 0x7f286c1018e0 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f28736f4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286c1a0f30 con 0x7f286c106b40 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c104210 0x7f286c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c104210 0x7f286c199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59560/0 (socket says 172.21.15.33:59560) 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 -- 172.21.15.33:0/3620584205 learned_addr learned my addr 172.21.15.33:0/3620584205 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2871c91700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f286c106b40 0x7f286c1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2871490700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f286c1018e0 0x7f286c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 -- 172.21.15.33:0/3620584205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f286c106b40 msgr2=0x7f286c1a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f286c106b40 0x7f286c1a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 -- 172.21.15.33:0/3620584205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f286c1018e0 msgr2=0x7f286c199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f286c1018e0 0x7f286c199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.072+0000 7f2870c8f700 1 -- 172.21.15.33:0/3620584205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2864009d00 con 0x7f286c104210 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.073+0000 7f2870c8f700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c104210 0x7f286c199670 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f285c00d950 tx=0x7f285c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.073+0000 7f28627fc700 1 -- 172.21.15.33:0/3620584205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00f890 con 0x7f286c104210 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.073+0000 7f28627fc700 1 -- 172.21.15.33:0/3620584205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f285c010460 con 0x7f286c104210 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.073+0000 7f28627fc700 1 -- 172.21.15.33:0/3620584205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c00e610 con 0x7f286c104210 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.073+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f286c1a1210 con 0x7f286c104210 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.073+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286c1a16d0 con 0x7f286c104210 2024-05-08T20:04:13.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.074+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286c1086c0 con 0x7f286c104210 2024-05-08T20:04:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.076+0000 7f28627fc700 1 -- 172.21.15.33:0/3620584205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f285c010960 con 0x7f286c104210 2024-05-08T20:04:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.076+0000 7f28627fc700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f28580a1230 0x7f28580a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.076+0000 7f2871490700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f28580a1230 0x7f28580a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.076+0000 7f28627fc700 1 -- 172.21.15.33:0/3620584205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f285c0cc610 con 0x7f286c104210 2024-05-08T20:04:13.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.077+0000 7f2871490700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f28580a1230 0x7f28580a36f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f286800ac50 tx=0x7f286800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.080+0000 7f28627fc700 1 -- 172.21.15.33:0/3620584205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f285c095df0 con 0x7f286c104210 2024-05-08T20:04:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.302+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f286c10c790 con 0x7f286c104210 2024-05-08T20:04:13.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.304+0000 7f28627fc700 1 -- 172.21.15.33:0/3620584205 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f285c020090 con 0x7f286c104210 2024-05-08T20:04:13.293 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:13.294 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:30.657561+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f28580a1230 msgr2=0x7f28580a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f28580a1230 0x7f28580a36f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f286800ac50 tx=0x7f286800a380 comp rx=0 tx=0).stop 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c104210 msgr2=0x7f286c199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c104210 0x7f286c199670 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f285c00d950 tx=0x7f285c00dc60 comp rx=0 tx=0).stop 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 shutdown_connections 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f28580a1230 0x7f28580a36f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f286c106b40 0x7f286c1a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f286c1018e0 0x7f286c199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 --2- 172.21.15.33:0/3620584205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f286c104210 0x7f286c199670 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 >> 172.21.15.33:0/3620584205 conn(0x7f286c0fb2f0 msgr2=0x7f286c100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.306+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 shutdown_connections 2024-05-08T20:04:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.307+0000 7f28736f4700 1 -- 172.21.15.33:0/3620584205 wait complete. 2024-05-08T20:04:13.310 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:03:27.926660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:03:28.993433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:04:13.311 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:04:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 -- 172.21.15.33:0/1480781957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f08101970 msgr2=0x7f6f08108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 --2- 172.21.15.33:0/1480781957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f08101970 0x7f6f08108290 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000b0a0 tx=0x7f6f0000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 -- 172.21.15.33:0/1480781957 shutdown_connections 2024-05-08T20:04:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 --2- 172.21.15.33:0/1480781957 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f08101970 0x7f6f08108290 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 --2- 172.21.15.33:0/1480781957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f080ffe60 0x7f6f08100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 --2- 172.21.15.33:0/1480781957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f08100fb0 0x7f6f08101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 -- 172.21.15.33:0/1480781957 >> 172.21.15.33:0/1480781957 conn(0x7f6f080fb3f0 msgr2=0x7f6f080fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 -- 172.21.15.33:0/1480781957 shutdown_connections 2024-05-08T20:04:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 -- 172.21.15.33:0/1480781957 wait complete. 2024-05-08T20:04:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 Processor -- start 2024-05-08T20:04:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.463+0000 7f6f0e892700 1 -- start start 2024-05-08T20:04:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0e892700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f080ffe60 0x7f6f0810a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0e892700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f08100fb0 0x7f6f08108d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0e892700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f08101970 0x7f6f081092c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0e892700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08109a60 con 0x7f6f080ffe60 2024-05-08T20:04:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0e892700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f08109bd0 con 0x7f6f08101970 2024-05-08T20:04:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0e892700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f081a1150 con 0x7f6f08100fb0 2024-05-08T20:04:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f080ffe60 0x7f6f0810a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f080ffe60 0x7f6f0810a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59580/0 (socket says 172.21.15.33:59580) 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 -- 172.21.15.33:0/3023481527 learned_addr learned my addr 172.21.15.33:0/3023481527 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f077fe700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f08100fb0 0x7f6f08108d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0ce2f700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f08101970 0x7f6f081092c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 -- 172.21.15.33:0/3023481527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f08100fb0 msgr2=0x7f6f08108d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f08100fb0 0x7f6f08108d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 -- 172.21.15.33:0/3023481527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f08101970 msgr2=0x7f6f081092c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f08101970 0x7f6f081092c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 -- 172.21.15.33:0/3023481527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00009d00 con 0x7f6f080ffe60 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f0ce2f700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f08101970 0x7f6f081092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.464+0000 7f6f07fff700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f080ffe60 0x7f6f0810a6f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d950 tx=0x7f6ef800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:13.457 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.465+0000 7f6f057fa700 1 -- 172.21.15.33:0/3023481527 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef80098e0 con 0x7f6f080ffe60 2024-05-08T20:04:13.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.465+0000 7f6f057fa700 1 -- 172.21.15.33:0/3023481527 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ef8010460 con 0x7f6f080ffe60 2024-05-08T20:04:13.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.465+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f081a13e0 con 0x7f6f080ffe60 2024-05-08T20:04:13.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.465+0000 7f6f057fa700 1 -- 172.21.15.33:0/3023481527 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef800f620 con 0x7f6f080ffe60 2024-05-08T20:04:13.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.465+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f081a18f0 con 0x7f6f080ffe60 2024-05-08T20:04:13.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.466+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f08107200 con 0x7f6f080ffe60 2024-05-08T20:04:13.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.467+0000 7f6f057fa700 1 -- 172.21.15.33:0/3023481527 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f6ef8010960 con 0x7f6f080ffe60 2024-05-08T20:04:13.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.467+0000 7f6f057fa700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6ef00a11b0 0x7f6ef00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.468+0000 7f6f077fe700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6ef00a11b0 0x7f6ef00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.468+0000 7f6f057fa700 1 -- 172.21.15.33:0/3023481527 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6ef80cc880 con 0x7f6f080ffe60 2024-05-08T20:04:13.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.468+0000 7f6f077fe700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6ef00a11b0 0x7f6ef00a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6efc005950 tx=0x7f6efc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:13.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.472+0000 7f6f057fa700 1 -- 172.21.15.33:0/3023481527 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f6ef8095f60 con 0x7f6f080ffe60 2024-05-08T20:04:13.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:13 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1634250529' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T20:04:13.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:13 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1634250529' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T20:04:13.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:13 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1634250529' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T20:04:13.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.688+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f0810cb80 con 0x7f6f080ffe60 2024-05-08T20:04:13.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.689+0000 7f6f057fa700 1 -- 172.21.15.33:0/3023481527 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ef8099580 con 0x7f6f080ffe60 2024-05-08T20:04:13.678 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:04:13.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6ef00a11b0 msgr2=0x7f6ef00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6ef00a11b0 0x7f6ef00a3670 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6efc005950 tx=0x7f6efc00b410 comp rx=0 tx=0).stop 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f080ffe60 msgr2=0x7f6f0810a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f080ffe60 0x7f6f0810a6f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800d950 tx=0x7f6ef800dc60 comp rx=0 tx=0).stop 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 shutdown_connections 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6f08101970 0x7f6f081092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f080ffe60 0x7f6f0810a6f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f6ef00a11b0 0x7f6ef00a3670 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 --2- 172.21.15.33:0/3023481527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f08100fb0 0x7f6f08108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 >> 172.21.15.33:0/3023481527 conn(0x7f6f080fb3f0 msgr2=0x7f6f08104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 shutdown_connections 2024-05-08T20:04:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.691+0000 7f6f0e892700 1 -- 172.21.15.33:0/3023481527 wait complete. 2024-05-08T20:04:13.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:04:13.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 -- 172.21.15.33:0/1022730841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24701020f0 msgr2=0x7f2470102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1022730841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24701020f0 0x7f2470102570 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2464009990 tx=0x7f2464009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 -- 172.21.15.33:0/1022730841 shutdown_connections 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1022730841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2470102ab0 0x7f24701093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1022730841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2470100f20 0x7f2470101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1022730841 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24701020f0 0x7f2470102570 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 -- 172.21.15.33:0/1022730841 >> 172.21.15.33:0/1022730841 conn(0x7f24700fc4e0 msgr2=0x7f24700fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 -- 172.21.15.33:0/1022730841 shutdown_connections 2024-05-08T20:04:13.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.846+0000 7f2474fe3700 1 -- 172.21.15.33:0/1022730841 wait complete. 2024-05-08T20:04:13.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 Processor -- start 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 -- start start 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2470100f20 0x7f2470074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24701020f0 0x7f2470073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2470102ab0 0x7f24700738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2470074070 con 0x7f2470102ab0 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700741e0 con 0x7f2470100f20 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f2474fe3700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24701a1010 con 0x7f24701020f0 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2470102ab0 0x7f24700738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2470102ab0 0x7f24700738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59604/0 (socket says 172.21.15.33:59604) 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 -- 172.21.15.33:0/1787037966 learned_addr learned my addr 172.21.15.33:0/1787037966 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246dd9b700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24701020f0 0x7f2470073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246e59c700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2470100f20 0x7f2470074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 -- 172.21.15.33:0/1787037966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24701020f0 msgr2=0x7f2470073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24701020f0 0x7f2470073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 -- 172.21.15.33:0/1787037966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2470100f20 msgr2=0x7f2470074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2470100f20 0x7f2470074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.847+0000 7f246ed9d700 1 -- 172.21.15.33:0/1787037966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24640095f0 con 0x7f2470102ab0 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.848+0000 7f246ed9d700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2470102ab0 0x7f24700738d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f246800ef30 tx=0x7f246800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.848+0000 7f245f7fe700 1 -- 172.21.15.33:0/1787037966 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2468018070 con 0x7f2470102ab0 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.848+0000 7f245f7fe700 1 -- 172.21.15.33:0/1787037966 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f246800f040 con 0x7f2470102ab0 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.848+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24701a1240 con 0x7f2470102ab0 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.848+0000 7f245f7fe700 1 -- 172.21.15.33:0/1787037966 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f246800ccf0 con 0x7f2470102ab0 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.848+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24701a1700 con 0x7f2470102ab0 2024-05-08T20:04:13.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.849+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2470108410 con 0x7f2470102ab0 2024-05-08T20:04:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.850+0000 7f245f7fe700 1 -- 172.21.15.33:0/1787037966 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2468003a00 con 0x7f2470102ab0 2024-05-08T20:04:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.851+0000 7f245f7fe700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f24580a11b0 0x7f24580a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.851+0000 7f246e59c700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f24580a11b0 0x7f24580a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.851+0000 7f245f7fe700 1 -- 172.21.15.33:0/1787037966 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f24680ccdf0 con 0x7f2470102ab0 2024-05-08T20:04:13.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.851+0000 7f246e59c700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f24580a11b0 0x7f24580a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2470100c40 tx=0x7f246000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:13.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:13.854+0000 7f245f7fe700 1 -- 172.21.15.33:0/1787037966 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2468096660 con 0x7f2470102ab0 2024-05-08T20:04:14.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.075+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f247010caf0 con 0x7f2470102ab0 2024-05-08T20:04:14.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.075+0000 7f245f7fe700 1 -- 172.21.15.33:0/1787037966 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2468099c80 con 0x7f2470102ab0 2024-05-08T20:04:14.065 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-05-08T20:04:14.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f24580a11b0 msgr2=0x7f24580a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f24580a11b0 0x7f24580a3670 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2470100c40 tx=0x7f246000b410 comp rx=0 tx=0).stop 2024-05-08T20:04:14.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2470102ab0 msgr2=0x7f24700738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2470102ab0 0x7f24700738d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f246800ef30 tx=0x7f246800c3a0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 shutdown_connections 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2470102ab0 0x7f24700738d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2470100f20 0x7f2470074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f24580a11b0 0x7f24580a3670 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 --2- 172.21.15.33:0/1787037966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24701020f0 0x7f2470073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 >> 172.21.15.33:0/1787037966 conn(0x7f24700fc4e0 msgr2=0x7f2470105550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 shutdown_connections 2024-05-08T20:04:14.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.078+0000 7f2474fe3700 1 -- 172.21.15.33:0/1787037966 wait complete. 2024-05-08T20:04:14.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:04:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 -- 172.21.15.33:0/1188024980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc1021f0 msgr2=0x7fd0cc102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 --2- 172.21.15.33:0/1188024980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc1021f0 0x7fd0cc102650 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009990 tx=0x7fd0bc009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 -- 172.21.15.33:0/1188024980 shutdown_connections 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 --2- 172.21.15.33:0/1188024980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0cc102b90 0x7fd0cc109440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 --2- 172.21.15.33:0/1188024980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0cc0ff220 0x7fd0cc0ff640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 --2- 172.21.15.33:0/1188024980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc1021f0 0x7fd0cc102650 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 -- 172.21.15.33:0/1188024980 >> 172.21.15.33:0/1188024980 conn(0x7fd0cc0fab50 msgr2=0x7fd0cc0fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 -- 172.21.15.33:0/1188024980 shutdown_connections 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.232+0000 7fd0d35db700 1 -- 172.21.15.33:0/1188024980 wait complete. 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 Processor -- start 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 -- start start 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc0ff220 0x7fd0cc196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0cc1021f0 0x7fd0cc197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0cc102b90 0x7fd0cc19e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19eb10 con 0x7fd0cc0ff220 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19ec50 con 0x7fd0cc1021f0 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d35db700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19ede0 con 0x7fd0cc102b90 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d1377700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc0ff220 0x7fd0cc196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d1377700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc0ff220 0x7fd0cc196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59620/0 (socket says 172.21.15.33:59620) 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.233+0000 7fd0d1377700 1 -- 172.21.15.33:0/595791992 learned_addr learned my addr 172.21.15.33:0/595791992 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d0b76700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0cc1021f0 0x7fd0cc197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d1b78700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0cc102b90 0x7fd0cc19e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d1377700 1 -- 172.21.15.33:0/595791992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0cc102b90 msgr2=0x7fd0cc19e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d1377700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0cc102b90 0x7fd0cc19e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d1377700 1 -- 172.21.15.33:0/595791992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0cc1021f0 msgr2=0x7fd0cc197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d1377700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0cc1021f0 0x7fd0cc197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d1377700 1 -- 172.21.15.33:0/595791992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8009520 con 0x7fd0cc0ff220 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d0b76700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0cc1021f0 0x7fd0cc197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d1377700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc0ff220 0x7fd0cc196fe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800ea50 tx=0x7fd0c800ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0c27fc700 1 -- 172.21.15.33:0/595791992 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800cc90 con 0x7fd0cc0ff220 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0c27fc700 1 -- 172.21.15.33:0/595791992 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd0c800cdf0 con 0x7fd0cc0ff220 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc0095f0 con 0x7fd0cc0ff220 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0c27fc700 1 -- 172.21.15.33:0/595791992 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8018840 con 0x7fd0cc0ff220 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.234+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc19f440 con 0x7fd0cc0ff220 2024-05-08T20:04:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.235+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc108430 con 0x7fd0cc0ff220 2024-05-08T20:04:14.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.237+0000 7fd0c27fc700 1 -- 172.21.15.33:0/595791992 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd0c8010a80 con 0x7fd0cc0ff220 2024-05-08T20:04:14.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.237+0000 7fd0c27fc700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0b80a11b0 0x7fd0b80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.237+0000 7fd0d0b76700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0b80a11b0 0x7fd0b80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.237+0000 7fd0c27fc700 1 -- 172.21.15.33:0/595791992 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd0c8014070 con 0x7fd0cc0ff220 2024-05-08T20:04:14.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.238+0000 7fd0d0b76700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0b80a11b0 0x7fd0b80a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00b2e0 tx=0x7fd0bc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:14.230 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.241+0000 7fd0c27fc700 1 -- 172.21.15.33:0/595791992 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd0c8096cb0 con 0x7fd0cc0ff220 2024-05-08T20:04:14.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.460+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0cc10cb50 con 0x7fd0cc0ff220 2024-05-08T20:04:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.460+0000 7fd0c27fc700 1 -- 172.21.15.33:0/595791992 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0c809a2d0 con 0x7fd0cc0ff220 2024-05-08T20:04:14.450 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-05-08T20:04:14.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.462+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0b80a11b0 msgr2=0x7fd0b80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.462+0000 7fd0d35db700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0b80a11b0 0x7fd0b80a3670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00b2e0 tx=0x7fd0bc005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.462+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc0ff220 msgr2=0x7fd0cc196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.462+0000 7fd0d35db700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc0ff220 0x7fd0cc196fe0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800ea50 tx=0x7fd0c800ee10 comp rx=0 tx=0).stop 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 shutdown_connections 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd0b80a11b0 0x7fd0b80a3670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0cc102b90 0x7fd0cc19e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0cc0ff220 0x7fd0cc196fe0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 --2- 172.21.15.33:0/595791992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd0cc1021f0 0x7fd0cc197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 >> 172.21.15.33:0/595791992 conn(0x7fd0cc0fab50 msgr2=0x7fd0cc105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 shutdown_connections 2024-05-08T20:04:14.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.463+0000 7fd0d35db700 1 -- 172.21.15.33:0/595791992 wait complete. 2024-05-08T20:04:14.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:14 smithi033 ceph-mon[42490]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:14.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:14 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3620584205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:14.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:14 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3023481527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:14.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:14 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1787037966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:14.466 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:04:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 -- 172.21.15.33:0/3226689879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 msgr2=0x7fd420108fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 --2- 172.21.15.33:0/3226689879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd420108fe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd41800b0a0 tx=0x7fd41800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 -- 172.21.15.33:0/3226689879 shutdown_connections 2024-05-08T20:04:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 --2- 172.21.15.33:0/3226689879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd420108fe0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 --2- 172.21.15.33:0/3226689879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420101910 0x7fd420103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.603 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 --2- 172.21.15.33:0/3226689879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd420104240 0x7fd420106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 -- 172.21.15.33:0/3226689879 >> 172.21.15.33:0/3226689879 conn(0x7fd4200fb320 msgr2=0x7fd4200fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 -- 172.21.15.33:0/3226689879 shutdown_connections 2024-05-08T20:04:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.613+0000 7fd426135700 1 -- 172.21.15.33:0/3226689879 wait complete. 2024-05-08T20:04:14.604 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 Processor -- start 2024-05-08T20:04:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 -- start start 2024-05-08T20:04:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420101910 0x7fd420196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd420104240 0x7fd420197370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.606 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd42019e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42019e960 con 0x7fd420106b70 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42019eaa0 con 0x7fd420101910 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.614+0000 7fd426135700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42019ec30 con 0x7fd420104240 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd42019e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd42019e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59640/0 (socket says 172.21.15.33:59640) 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 -- 172.21.15.33:0/1289360353 learned_addr learned my addr 172.21.15.33:0/1289360353 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41effd700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd420104240 0x7fd420197370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41f7fe700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420101910 0x7fd420196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 -- 172.21.15.33:0/1289360353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd420104240 msgr2=0x7fd420197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd420104240 0x7fd420197370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 -- 172.21.15.33:0/1289360353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420101910 msgr2=0x7fd420196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420101910 0x7fd420196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 -- 172.21.15.33:0/1289360353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd418009d00 con 0x7fd420106b70 2024-05-08T20:04:14.607 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41ffff700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd42019e390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd4180094c0 tx=0x7fd4180095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41cff9700 1 -- 172.21.15.33:0/1289360353 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800e040 con 0x7fd420106b70 2024-05-08T20:04:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41cff9700 1 -- 172.21.15.33:0/1289360353 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd41801d960 con 0x7fd420106b70 2024-05-08T20:04:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42019eeb0 con 0x7fd420106b70 2024-05-08T20:04:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd41cff9700 1 -- 172.21.15.33:0/1289360353 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41801ba80 con 0x7fd420106b70 2024-05-08T20:04:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.615+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42019f2d0 con 0x7fd420106b70 2024-05-08T20:04:14.608 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.616+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4200fcea0 con 0x7fd420106b70 2024-05-08T20:04:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.618+0000 7fd41cff9700 1 -- 172.21.15.33:0/1289360353 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd41801dad0 con 0x7fd420106b70 2024-05-08T20:04:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.619+0000 7fd41cff9700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd4080a11b0 0x7fd4080a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.619+0000 7fd41f7fe700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd4080a11b0 0x7fd4080a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.619+0000 7fd41cff9700 1 -- 172.21.15.33:0/1289360353 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd4180ceed0 con 0x7fd420106b70 2024-05-08T20:04:14.609 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.620+0000 7fd41f7fe700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd4080a11b0 0x7fd4080a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd410005ea0 tx=0x7fd410005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:14.612 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.623+0000 7fd41cff9700 1 -- 172.21.15.33:0/1289360353 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd418098640 con 0x7fd420106b70 2024-05-08T20:04:14.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:14 smithi082 ceph-mon[46774]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:14.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:14 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3620584205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:14.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:14 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3023481527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:14.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:14 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1787037966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:14 smithi132 ceph-mon[47484]: pgmap v243: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:14 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3620584205' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:14 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3023481527' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:14 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1787037966' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:14.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.891+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd420067380 con 0x7fd420106b70 2024-05-08T20:04:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.892+0000 7fd41cff9700 1 -- 172.21.15.33:0/1289360353 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10848 (secure 0 0 0) 0x7fd41801de60 con 0x7fd420106b70 2024-05-08T20:04:14.881 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:14.882 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:03:35.012471+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:04:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd4080a11b0 msgr2=0x7fd4080a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd4080a11b0 0x7fd4080a3670 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd410005ea0 tx=0x7fd410005e30 comp rx=0 tx=0).stop 2024-05-08T20:04:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 msgr2=0x7fd42019e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd42019e390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd4180094c0 tx=0x7fd4180095a0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 shutdown_connections 2024-05-08T20:04:14.884 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd420106b70 0x7fd42019e390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd420101910 0x7fd420196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd4080a11b0 0x7fd4080a3670 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 --2- 172.21.15.33:0/1289360353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd420104240 0x7fd420197370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 >> 172.21.15.33:0/1289360353 conn(0x7fd4200fb320 msgr2=0x7fd420102210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.894+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 shutdown_connections 2024-05-08T20:04:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:14.895+0000 7fd426135700 1 -- 172.21.15.33:0/1289360353 wait complete. 2024-05-08T20:04:14.885 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-05-08T20:04:14.899 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:04:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 -- 172.21.15.33:0/4109170364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 msgr2=0x7f0ca01013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/4109170364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca01013b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0c900099c0 tx=0x7f0c90009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 -- 172.21.15.33:0/4109170364 shutdown_connections 2024-05-08T20:04:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/4109170364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ca01018f0 0x7f0ca01081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/4109170364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ca00ffd60 0x7f0ca0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/4109170364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca01013b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 -- 172.21.15.33:0/4109170364 >> 172.21.15.33:0/4109170364 conn(0x7f0ca00fb2f0 msgr2=0x7f0ca00fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 -- 172.21.15.33:0/4109170364 shutdown_connections 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 -- 172.21.15.33:0/4109170364 wait complete. 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 Processor -- start 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.048+0000 7f0ca86f3700 1 -- start start 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca86f3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ca00ffd60 0x7f0ca0103d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca86f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca0102400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca86f3700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ca01018f0 0x7f0ca0102940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca86f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01030e0 con 0x7f0ca0100f50 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca86f3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0103250 con 0x7f0ca00ffd60 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca86f3700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca01a0f50 con 0x7f0ca01018f0 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca0102400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca0102400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59656/0 (socket says 172.21.15.33:59656) 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 -- 172.21.15.33:0/1192421898 learned_addr learned my addr 172.21.15.33:0/1192421898 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca648f700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ca00ffd60 0x7f0ca0103d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca6c90700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ca01018f0 0x7f0ca0102940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 -- 172.21.15.33:0/1192421898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ca01018f0 msgr2=0x7f0ca0102940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ca01018f0 0x7f0ca0102940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 -- 172.21.15.33:0/1192421898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ca00ffd60 msgr2=0x7f0ca0103d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ca00ffd60 0x7f0ca0103d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 -- 172.21.15.33:0/1192421898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900095f0 con 0x7f0ca0100f50 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca648f700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ca00ffd60 0x7f0ca0103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0ca5c8e700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca0102400 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c010 tx=0x7f0c90009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.049+0000 7f0c977fe700 1 -- 172.21.15.33:0/1192421898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9001d070 con 0x7f0ca0100f50 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.050+0000 7f0c977fe700 1 -- 172.21.15.33:0/1192421898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0c9000fb40 con 0x7f0ca0100f50 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.050+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca01a1180 con 0x7f0ca0100f50 2024-05-08T20:04:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.050+0000 7f0c977fe700 1 -- 172.21.15.33:0/1192421898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900173f0 con 0x7f0ca0100f50 2024-05-08T20:04:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.050+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca01a1540 con 0x7f0ca0100f50 2024-05-08T20:04:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.051+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca0067c10 con 0x7f0ca0100f50 2024-05-08T20:04:15.043 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.052+0000 7f0c977fe700 1 -- 172.21.15.33:0/1192421898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0c9000fcb0 con 0x7f0ca0100f50 2024-05-08T20:04:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.052+0000 7f0c977fe700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0c8c0a11b0 0x7f0c8c0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.053+0000 7f0ca648f700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0c8c0a11b0 0x7f0c8c0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.053+0000 7f0c977fe700 1 -- 172.21.15.33:0/1192421898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0c900cdb50 con 0x7f0ca0100f50 2024-05-08T20:04:15.044 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.053+0000 7f0ca648f700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0c8c0a11b0 0x7f0c8c0a3670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005950 tx=0x7f0c9c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.057+0000 7f0c977fe700 1 -- 172.21.15.33:0/1192421898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0c9005dd60 con 0x7f0ca0100f50 2024-05-08T20:04:15.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.277+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca010b700 con 0x7f0ca0100f50 2024-05-08T20:04:15.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.279+0000 7f0c977fe700 1 -- 172.21.15.33:0/1192421898 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f0c900972c0 con 0x7f0ca0100f50 2024-05-08T20:04:15.269 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:15.269 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:30.657561+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:04:15.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0c8c0a11b0 msgr2=0x7f0c8c0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0c8c0a11b0 0x7f0c8c0a3670 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c005950 tx=0x7f0c9c0058e0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 msgr2=0x7f0ca0102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca0102400 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c010 tx=0x7f0c90009580 comp rx=0 tx=0).stop 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 shutdown_connections 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0c8c0a11b0 0x7f0c8c0a3670 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ca01018f0 0x7f0ca0102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0ca00ffd60 0x7f0ca0103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 --2- 172.21.15.33:0/1192421898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca0100f50 0x7f0ca0102400 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 >> 172.21.15.33:0/1192421898 conn(0x7f0ca00fb2f0 msgr2=0x7f0ca0067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 shutdown_connections 2024-05-08T20:04:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.281+0000 7f0ca86f3700 1 -- 172.21.15.33:0/1192421898 wait complete. 2024-05-08T20:04:15.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:03:27.926660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:03:28.993433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:04:15.286 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:04:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 -- 172.21.15.33:0/2683194645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 msgr2=0x7fca080733b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 --2- 172.21.15.33:0/2683194645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca080733b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009990 tx=0x7fc9f8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 -- 172.21.15.33:0/2683194645 shutdown_connections 2024-05-08T20:04:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 --2- 172.21.15.33:0/2683194645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08108e60 0x7fca0810b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 --2- 172.21.15.33:0/2683194645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca080733b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 --2- 172.21.15.33:0/2683194645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca08073980 0x7fca08073e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 -- 172.21.15.33:0/2683194645 >> 172.21.15.33:0/2683194645 conn(0x7fca080fc4e0 msgr2=0x7fca080fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.437+0000 7fca0e180700 1 -- 172.21.15.33:0/2683194645 shutdown_connections 2024-05-08T20:04:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.438+0000 7fca0e180700 1 -- 172.21.15.33:0/2683194645 wait complete. 2024-05-08T20:04:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.438+0000 7fca0e180700 1 Processor -- start 2024-05-08T20:04:15.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.438+0000 7fca0e180700 1 -- start start 2024-05-08T20:04:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca0e180700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca08073980 0x7fca081991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca0e180700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca081996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca0e180700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08108e60 0x7fca081a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca0e180700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca081a0ce0 con 0x7fca08074f60 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca0e180700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca081a0e20 con 0x7fca08108e60 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca0e180700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca081a0fb0 con 0x7fca08073980 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca081996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca077fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca08073980 0x7fca081991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca081996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59684/0 (socket says 172.21.15.33:59684) 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca07fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08108e60 0x7fca081a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 -- 172.21.15.33:0/1484253898 learned_addr learned my addr 172.21.15.33:0/1484253898 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 -- 172.21.15.33:0/1484253898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca08073980 msgr2=0x7fca081991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca08073980 0x7fca081991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 -- 172.21.15.33:0/1484253898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08108e60 msgr2=0x7fca081a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08108e60 0x7fca081a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 -- 172.21.15.33:0/1484253898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f80095f0 con 0x7fca08074f60 2024-05-08T20:04:15.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca077fe700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca08073980 0x7fca081991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca06ffd700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca081996f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00d950 tx=0x7fc9fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.439+0000 7fca04ff9700 1 -- 172.21.15.33:0/1484253898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00f890 con 0x7fca08074f60 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.440+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca081a1290 con 0x7fca08074f60 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.440+0000 7fca04ff9700 1 -- 172.21.15.33:0/1484253898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc9fc010460 con 0x7fca08074f60 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.440+0000 7fca04ff9700 1 -- 172.21.15.33:0/1484253898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc00e610 con 0x7fca08074f60 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.440+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca081a17f0 con 0x7fca08074f60 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.441+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca08107c70 con 0x7fca08074f60 2024-05-08T20:04:15.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.442+0000 7fca04ff9700 1 -- 172.21.15.33:0/1484253898 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc9fc010960 con 0x7fca08074f60 2024-05-08T20:04:15.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.443+0000 7fca04ff9700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc9f00a1230 0x7fc9f00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.443+0000 7fca077fe700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc9f00a1230 0x7fc9f00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.443+0000 7fca04ff9700 1 -- 172.21.15.33:0/1484253898 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc9fc0cc7d0 con 0x7fca08074f60 2024-05-08T20:04:15.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.443+0000 7fca077fe700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc9f00a1230 0x7fc9f00a36f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800b5c0 tx=0x7fc9f8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:15.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.446+0000 7fca04ff9700 1 -- 172.21.15.33:0/1484253898 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc9fc095eb0 con 0x7fca08074f60 2024-05-08T20:04:15.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:15 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/595791992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:15.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:15 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1289360353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:15.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:15 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/595791992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:15.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:15 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1289360353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:15 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/595791992' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:15.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:15 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1289360353' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:15.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.665+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca08067460 con 0x7fca08074f60 2024-05-08T20:04:15.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.665+0000 7fca04ff9700 1 -- 172.21.15.33:0/1484253898 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9fc0160a0 con 0x7fca08074f60 2024-05-08T20:04:15.655 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:04:15.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc9f00a1230 msgr2=0x7fc9f00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc9f00a1230 0x7fc9f00a36f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc9f800b5c0 tx=0x7fc9f8005fd0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 msgr2=0x7fca081996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca081996f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00d950 tx=0x7fc9fc00dc60 comp rx=0 tx=0).stop 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 shutdown_connections 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fca08108e60 0x7fca081a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc9f00a1230 0x7fc9f00a36f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca08073980 0x7fca081991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 --2- 172.21.15.33:0/1484253898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca08074f60 0x7fca081996f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 >> 172.21.15.33:0/1484253898 conn(0x7fca080fc4e0 msgr2=0x7fca08104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 shutdown_connections 2024-05-08T20:04:15.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.668+0000 7fca0e180700 1 -- 172.21.15.33:0/1484253898 wait complete. 2024-05-08T20:04:15.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:04:15.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 -- 172.21.15.33:0/3477201562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f10102ab0 msgr2=0x7f1f101093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/3477201562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f10102ab0 0x7f1f101093d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800b0a0 tx=0x7f1f0800b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 -- 172.21.15.33:0/3477201562 shutdown_connections 2024-05-08T20:04:15.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/3477201562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f10102ab0 0x7f1f101093d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/3477201562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f10100f20 0x7f1f10101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/3477201562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f101020f0 0x7f1f10102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 -- 172.21.15.33:0/3477201562 >> 172.21.15.33:0/3477201562 conn(0x7f1f100fc4e0 msgr2=0x7f1f100fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:15.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 -- 172.21.15.33:0/3477201562 shutdown_connections 2024-05-08T20:04:15.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.824+0000 7f1f14b0e700 1 -- 172.21.15.33:0/3477201562 wait complete. 2024-05-08T20:04:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 Processor -- start 2024-05-08T20:04:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 -- start start 2024-05-08T20:04:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f10100f20 0x7f1f10199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f101020f0 0x7f1f101998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f10102ab0 0x7f1f101a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101a0ea0 con 0x7f1f101020f0 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101a0fe0 con 0x7f1f10100f20 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f14b0e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f101a1170 con 0x7f1f10102ab0 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f101020f0 0x7f1f101998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f101020f0 0x7f1f101998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59704/0 (socket says 172.21.15.33:59704) 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 -- 172.21.15.33:0/1103200877 learned_addr learned my addr 172.21.15.33:0/1103200877 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0e59c700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f10100f20 0x7f1f10199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0ed9d700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f10102ab0 0x7f1f101a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 -- 172.21.15.33:0/1103200877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f10102ab0 msgr2=0x7f1f101a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f10102ab0 0x7f1f101a08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 -- 172.21.15.33:0/1103200877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f10100f20 msgr2=0x7f1f10199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f10100f20 0x7f1f10199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 -- 172.21.15.33:0/1103200877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f08009d00 con 0x7f1f101020f0 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.825+0000 7f1f0dd9b700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f101020f0 0x7f1f101998b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9a0 tx=0x7f1f0400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.826+0000 7f1eff7fe700 1 -- 172.21.15.33:0/1103200877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04009790 con 0x7f1f101020f0 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.826+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f101a1450 con 0x7f1f101020f0 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.826+0000 7f1eff7fe700 1 -- 172.21.15.33:0/1103200877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f0400cbd0 con 0x7f1f101020f0 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.826+0000 7f1eff7fe700 1 -- 172.21.15.33:0/1103200877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f04018680 con 0x7f1f101020f0 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.826+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f101a19b0 con 0x7f1f101020f0 2024-05-08T20:04:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.827+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f10067460 con 0x7f1f101020f0 2024-05-08T20:04:15.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.828+0000 7f1eff7fe700 1 -- 172.21.15.33:0/1103200877 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f1f0400cd40 con 0x7f1f101020f0 2024-05-08T20:04:15.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.829+0000 7f1eff7fe700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ef80a11b0 0x7f1ef80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:15.819 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.829+0000 7f1f0e59c700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ef80a11b0 0x7f1ef80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.829+0000 7f1eff7fe700 1 -- 172.21.15.33:0/1103200877 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1f04014070 con 0x7f1f101020f0 2024-05-08T20:04:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.829+0000 7f1f0e59c700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ef80a11b0 0x7f1ef80a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1f10100c40 tx=0x7f1f00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:15.832+0000 7f1eff7fe700 1 -- 172.21.15.33:0/1103200877 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f1f040967b0 con 0x7f1f101020f0 2024-05-08T20:04:16.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.047+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f1010c930 con 0x7f1f101020f0 2024-05-08T20:04:16.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.047+0000 7f1eff7fe700 1 -- 172.21.15.33:0/1103200877 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f04099dd0 con 0x7f1f101020f0 2024-05-08T20:04:16.037 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ef80a11b0 msgr2=0x7f1ef80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ef80a11b0 0x7f1ef80a3670 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1f10100c40 tx=0x7f1f00009260 comp rx=0 tx=0).stop 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f101020f0 msgr2=0x7f1f101998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f101020f0 0x7f1f101998b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400e9a0 tx=0x7f1f0400ecb0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 shutdown_connections 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f1ef80a11b0 0x7f1ef80a3670 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f10102ab0 0x7f1f101a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f10100f20 0x7f1f10199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 --2- 172.21.15.33:0/1103200877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f101020f0 0x7f1f101998b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.049+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 >> 172.21.15.33:0/1103200877 conn(0x7f1f100fc4e0 msgr2=0x7f1f100731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.050+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 shutdown_connections 2024-05-08T20:04:16.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.050+0000 7f1f14b0e700 1 -- 172.21.15.33:0/1103200877 wait complete. 2024-05-08T20:04:16.053 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:04:16.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 -- 172.21.15.33:0/203801771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72581019e0 msgr2=0x7f7258103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 --2- 172.21.15.33:0/203801771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72581019e0 0x7f7258103dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72540098f0 tx=0x7f7254009c00 comp rx=0 tx=0).stop 2024-05-08T20:04:16.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 -- 172.21.15.33:0/203801771 shutdown_connections 2024-05-08T20:04:16.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 --2- 172.21.15.33:0/203801771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7258106c40 0x7f72581090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 --2- 172.21.15.33:0/203801771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72581019e0 0x7f7258103dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 --2- 172.21.15.33:0/203801771 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7258104310 0x7f7258106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 -- 172.21.15.33:0/203801771 >> 172.21.15.33:0/203801771 conn(0x7f72580fb3f0 msgr2=0x7f72580fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:16.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 -- 172.21.15.33:0/203801771 shutdown_connections 2024-05-08T20:04:16.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.205+0000 7f725ed76700 1 -- 172.21.15.33:0/203801771 wait complete. 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 Processor -- start 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 -- start start 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72581019e0 0x7f7258196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7258104310 0x7f72581974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7258106c40 0x7f725819e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725819ead0 con 0x7f72581019e0 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725819ec10 con 0x7f7258104310 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725ed76700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725819eda0 con 0x7f7258106c40 2024-05-08T20:04:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725cb12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72581019e0 0x7f7258196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725cb12700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72581019e0 0x7f7258196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59728/0 (socket says 172.21.15.33:59728) 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725cb12700 1 -- 172.21.15.33:0/2709907194 learned_addr learned my addr 172.21.15.33:0/2709907194 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f724ffff700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7258104310 0x7f72581974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.206+0000 7f725d313700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7258106c40 0x7f725819e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725cb12700 1 -- 172.21.15.33:0/2709907194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7258106c40 msgr2=0x7f725819e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725cb12700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7258106c40 0x7f725819e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725cb12700 1 -- 172.21.15.33:0/2709907194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7258104310 msgr2=0x7f72581974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725cb12700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7258104310 0x7f72581974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725cb12700 1 -- 172.21.15.33:0/2709907194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480095f0 con 0x7f72581019e0 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725cb12700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72581019e0 0x7f7258196fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7254009810 tx=0x7f7254005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:16.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f724dffb700 1 -- 172.21.15.33:0/2709907194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725401c070 con 0x7f72581019e0 2024-05-08T20:04:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f724dffb700 1 -- 172.21.15.33:0/2709907194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f725400f950 con 0x7f72581019e0 2024-05-08T20:04:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7254009520 con 0x7f72581019e0 2024-05-08T20:04:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f724dffb700 1 -- 172.21.15.33:0/2709907194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254003b40 con 0x7f72581019e0 2024-05-08T20:04:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.207+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725819f2b0 con 0x7f72581019e0 2024-05-08T20:04:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.208+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580fcf70 con 0x7f72581019e0 2024-05-08T20:04:16.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.209+0000 7f724dffb700 1 -- 172.21.15.33:0/2709907194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f7254020030 con 0x7f72581019e0 2024-05-08T20:04:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.210+0000 7f724dffb700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f72400a11b0 0x7f72400a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.210+0000 7f724ffff700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f72400a11b0 0x7f72400a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.211+0000 7f724dffb700 1 -- 172.21.15.33:0/2709907194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f72540cdd00 con 0x7f72581019e0 2024-05-08T20:04:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.211+0000 7f724ffff700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f72400a11b0 0x7f72400a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7248005fd0 tx=0x7f7248009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.214+0000 7f724dffb700 1 -- 172.21.15.33:0/2709907194 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7254097570 con 0x7f72581019e0 2024-05-08T20:04:16.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:16 smithi033 ceph-mon[42490]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:04:16.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:16 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1192421898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:16.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:16 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1484253898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:16.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:16 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1103200877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:16.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.432+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f725810c990 con 0x7f72581019e0 2024-05-08T20:04:16.422 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.433+0000 7f724dffb700 1 -- 172.21.15.33:0/2709907194 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7f725409ab90 con 0x7f72581019e0 2024-05-08T20:04:16.422 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-05-08T20:04:16.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f72400a11b0 msgr2=0x7f72400a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f72400a11b0 0x7f72400a3670 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7248005fd0 tx=0x7f7248009310 comp rx=0 tx=0).stop 2024-05-08T20:04:16.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72581019e0 msgr2=0x7f7258196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72581019e0 0x7f7258196fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7254009810 tx=0x7f7254005270 comp rx=0 tx=0).stop 2024-05-08T20:04:16.425 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 shutdown_connections 2024-05-08T20:04:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f72400a11b0 0x7f72400a3670 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7258106c40 0x7f725819e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72581019e0 0x7f7258196fa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 --2- 172.21.15.33:0/2709907194 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7258104310 0x7f72581974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 >> 172.21.15.33:0/2709907194 conn(0x7f72580fb3f0 msgr2=0x7f72581024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.435+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 shutdown_connections 2024-05-08T20:04:16.426 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.436+0000 7f725ed76700 1 -- 172.21.15.33:0/2709907194 wait complete. 2024-05-08T20:04:16.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 -- 172.21.15.33:0/3193860465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 msgr2=0x7ff2a41092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/3193860465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a41092a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00b0a0 tx=0x7ff29c00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 -- 172.21.15.33:0/3193860465 shutdown_connections 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/3193860465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a41092a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/3193860465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a4100e70 0x7ff2a4101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/3193860465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a4101fc0 0x7ff2a4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 -- 172.21.15.33:0/3193860465 >> 172.21.15.33:0/3193860465 conn(0x7ff2a40fc400 msgr2=0x7ff2a40fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 -- 172.21.15.33:0/3193860465 shutdown_connections 2024-05-08T20:04:16.580 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.587+0000 7ff2ac28d700 1 -- 172.21.15.33:0/3193860465 wait complete. 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 Processor -- start 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 -- start start 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a4100e70 0x7ff2a4074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a4101fc0 0x7ff2a4073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a40738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a4074070 con 0x7ff2a4102980 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a40741e0 con 0x7ff2a4100e70 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2ac28d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a41a1040 con 0x7ff2a4101fc0 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2aa82a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a40738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2aa82a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a40738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59750/0 (socket says 172.21.15.33:59750) 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2aa82a700 1 -- 172.21.15.33:0/2389882920 learned_addr learned my addr 172.21.15.33:0/2389882920 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2aa029700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a4100e70 0x7ff2a4074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2a9828700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a4101fc0 0x7ff2a4073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.588+0000 7ff2aa82a700 1 -- 172.21.15.33:0/2389882920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a4101fc0 msgr2=0x7ff2a4073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.581 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2aa82a700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a4101fc0 0x7ff2a4073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2aa82a700 1 -- 172.21.15.33:0/2389882920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a4100e70 msgr2=0x7ff2a4074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2aa82a700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a4100e70 0x7ff2a4074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2aa82a700 1 -- 172.21.15.33:0/2389882920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c009d00 con 0x7ff2a4102980 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2a9828700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a4101fc0 0x7ff2a4073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2aa82a700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a40738d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0079b0 tx=0x7ff29c0079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff29b7fe700 1 -- 172.21.15.33:0/2389882920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c00e040 con 0x7ff2a4102980 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff29b7fe700 1 -- 172.21.15.33:0/2389882920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff29c004c50 con 0x7ff2a4102980 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a41a1270 con 0x7ff2a4102980 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff29b7fe700 1 -- 172.21.15.33:0/2389882920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0052a0 con 0x7ff2a4102980 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.589+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a41a16f0 con 0x7ff2a4102980 2024-05-08T20:04:16.582 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.590+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a4108210 con 0x7ff2a4102980 2024-05-08T20:04:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.591+0000 7ff29b7fe700 1 -- 172.21.15.33:0/2389882920 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff29c01d470 con 0x7ff2a4102980 2024-05-08T20:04:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.592+0000 7ff29b7fe700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff2900a1230 0x7ff2900a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.592+0000 7ff2aa029700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff2900a1230 0x7ff2900a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.592+0000 7ff29b7fe700 1 -- 172.21.15.33:0/2389882920 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff29c0ce420 con 0x7ff2a4102980 2024-05-08T20:04:16.583 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.592+0000 7ff2aa029700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff2900a1230 0x7ff2900a36f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009c60 tx=0x7ff2a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:16.584 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.595+0000 7ff29b7fe700 1 -- 172.21.15.33:0/2389882920 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7ff29c097c10 con 0x7ff2a4102980 2024-05-08T20:04:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:16 smithi082 ceph-mon[46774]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:04:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:16 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1192421898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:16 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1484253898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:16.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:16 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1103200877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:16.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:16 smithi132 ceph-mon[47484]: pgmap v244: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:04:16.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:16 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1192421898' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:16.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:16 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1484253898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:16.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:16 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1103200877' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:16.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.861+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2a4067380 con 0x7ff2a4102980 2024-05-08T20:04:16.851 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.862+0000 7ff29b7fe700 1 -- 172.21.15.33:0/2389882920 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10848 (secure 0 0 0) 0x7ff29c09b230 con 0x7ff2a4102980 2024-05-08T20:04:16.852 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:16.852 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:03:35.012471+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff2900a1230 msgr2=0x7ff2900a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff2900a1230 0x7ff2900a36f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009c60 tx=0x7ff2a0009260 comp rx=0 tx=0).stop 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 msgr2=0x7ff2a40738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a40738d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0079b0 tx=0x7ff29c0079e0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 shutdown_connections 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2a4102980 0x7ff2a40738d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff2a4100e70 0x7ff2a4074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff2900a1230 0x7ff2900a36f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 --2- 172.21.15.33:0/2389882920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2a4101fc0 0x7ff2a4073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 >> 172.21.15.33:0/2389882920 conn(0x7ff2a40fc400 msgr2=0x7ff2a4105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:16.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 shutdown_connections 2024-05-08T20:04:16.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:16.865+0000 7ff2ac28d700 1 -- 172.21.15.33:0/2389882920 wait complete. 2024-05-08T20:04:16.856 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-05-08T20:04:16.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:04:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1675257147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 msgr2=0x7f8eb4100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1675257147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4100180 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00099c0 tx=0x7f8eb0009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1675257147 shutdown_connections 2024-05-08T20:04:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1675257147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb41018f0 0x7f8eb41081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.009 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1675257147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4100180 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1675257147 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4100f50 0x7f8eb41013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1675257147 >> 172.21.15.33:0/1675257147 conn(0x7f8eb40fb2f0 msgr2=0x7f8eb40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1675257147 shutdown_connections 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.017+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1675257147 wait complete. 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 Processor -- start 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 -- start start 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4100f50 0x7f8eb41973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb41018f0 0x7f8eb419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb419e9a0 con 0x7f8eb40ffd60 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb419eae0 con 0x7f8eb4100f50 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8ebc1aa700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb419ec70 con 0x7f8eb41018f0 2024-05-08T20:04:17.010 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8eb9f46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8eb9f46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59772/0 (socket says 172.21.15.33:59772) 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.018+0000 7f8eb9f46700 1 -- 172.21.15.33:0/1637271428 learned_addr learned my addr 172.21.15.33:0/1637271428 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eba747700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb41018f0 0x7f8eb419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eb9745700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4100f50 0x7f8eb41973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eb9f46700 1 -- 172.21.15.33:0/1637271428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb41018f0 msgr2=0x7f8eb419e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eb9f46700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb41018f0 0x7f8eb419e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eb9f46700 1 -- 172.21.15.33:0/1637271428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4100f50 msgr2=0x7f8eb41973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eb9f46700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4100f50 0x7f8eb41973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eb9f46700 1 -- 172.21.15.33:0/1637271428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb00095f0 con 0x7f8eb40ffd60 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eb9f46700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4196e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006010 tx=0x7f8eb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eaaffd700 1 -- 172.21.15.33:0/1637271428 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb001d070 con 0x7f8eb40ffd60 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eaaffd700 1 -- 172.21.15.33:0/1637271428 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8eb00041a0 con 0x7f8eb40ffd60 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb419eef0 con 0x7f8eb40ffd60 2024-05-08T20:04:17.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8eaaffd700 1 -- 172.21.15.33:0/1637271428 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000f460 con 0x7f8eb40ffd60 2024-05-08T20:04:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.019+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb419f2b0 con 0x7f8eb40ffd60 2024-05-08T20:04:17.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.020+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4067c10 con 0x7f8eb40ffd60 2024-05-08T20:04:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.021+0000 7f8eaaffd700 1 -- 172.21.15.33:0/1637271428 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8eb0022470 con 0x7f8eb40ffd60 2024-05-08T20:04:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.022+0000 7f8eaaffd700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8ea00a1230 0x7f8ea00a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.022+0000 7f8eb9745700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8ea00a1230 0x7f8ea00a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.022+0000 7f8eaaffd700 1 -- 172.21.15.33:0/1637271428 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8eb00cddf0 con 0x7f8eb40ffd60 2024-05-08T20:04:17.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.023+0000 7f8eb9745700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8ea00a1230 0x7f8ea00a36f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005ea0 tx=0x7f8ea4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.026+0000 7f8eaaffd700 1 -- 172.21.15.33:0/1637271428 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8eb0097560 con 0x7f8eb40ffd60 2024-05-08T20:04:17.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.252+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eb410b6b0 con 0x7f8eb40ffd60 2024-05-08T20:04:17.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.253+0000 7f8eaaffd700 1 -- 172.21.15.33:0/1637271428 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f8eb009ab80 con 0x7f8eb40ffd60 2024-05-08T20:04:17.243 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:17.243 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":80,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:03:30.657561+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:04:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8ea00a1230 msgr2=0x7f8ea00a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8ea00a1230 0x7f8ea00a36f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4005ea0 tx=0x7f8ea4005e30 comp rx=0 tx=0).stop 2024-05-08T20:04:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 msgr2=0x7f8eb4196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4196e70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0006010 tx=0x7f8eb0004730 comp rx=0 tx=0).stop 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 shutdown_connections 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8ea00a1230 0x7f8ea00a36f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb41018f0 0x7f8eb419e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8eb40ffd60 0x7f8eb4196e70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 --2- 172.21.15.33:0/1637271428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8eb4100f50 0x7f8eb41973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 >> 172.21.15.33:0/1637271428 conn(0x7f8eb40fb2f0 msgr2=0x7f8eb40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 shutdown_connections 2024-05-08T20:04:17.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.256+0000 7f8ebc1aa700 1 -- 172.21.15.33:0/1637271428 wait complete. 2024-05-08T20:04:17.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:04:17.403 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 -- 172.21.15.33:0/3943034815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa41019d0 msgr2=0x7f2aa4103dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/3943034815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa41019d0 0x7f2aa4103dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2a94009990 tx=0x7f2a94009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 -- 172.21.15.33:0/3943034815 shutdown_connections 2024-05-08T20:04:17.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/3943034815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2aa4106c30 0x7f2aa4109020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/3943034815 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa41019d0 0x7f2aa4103dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/3943034815 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aa4104300 0x7f2aa41066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 -- 172.21.15.33:0/3943034815 >> 172.21.15.33:0/3943034815 conn(0x7f2aa40fb320 msgr2=0x7f2aa40fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 -- 172.21.15.33:0/3943034815 shutdown_connections 2024-05-08T20:04:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.408+0000 7f2aa93dc700 1 -- 172.21.15.33:0/3943034815 wait complete. 2024-05-08T20:04:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 Processor -- start 2024-05-08T20:04:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 -- start start 2024-05-08T20:04:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aa41019d0 0x7f2aa4196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2aa4104300 0x7f2aa41973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa4106c30 0x7f2aa419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa419e9d0 con 0x7f2aa4106c30 2024-05-08T20:04:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa419eb10 con 0x7f2aa4104300 2024-05-08T20:04:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa93dc700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa419eca0 con 0x7f2aa41019d0 2024-05-08T20:04:17.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa4106c30 0x7f2aa419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa4106c30 0x7f2aa419e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59780/0 (socket says 172.21.15.33:59780) 2024-05-08T20:04:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.409+0000 7f2aa37fe700 1 -- 172.21.15.33:0/1127581356 learned_addr learned my addr 172.21.15.33:0/1127581356 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa2ffd700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aa41019d0 0x7f2aa4196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa27fc700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2aa4104300 0x7f2aa41973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa37fe700 1 -- 172.21.15.33:0/1127581356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aa41019d0 msgr2=0x7f2aa4196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa37fe700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aa41019d0 0x7f2aa4196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa37fe700 1 -- 172.21.15.33:0/1127581356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2aa4104300 msgr2=0x7f2aa41973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa37fe700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2aa4104300 0x7f2aa41973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa37fe700 1 -- 172.21.15.33:0/1127581356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a940095f0 con 0x7f2aa4106c30 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa2ffd700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aa41019d0 0x7f2aa4196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa37fe700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa4106c30 0x7f2aa419e400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c007ee0 tx=0x7f2a9c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2a9bfff700 1 -- 172.21.15.33:0/1127581356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c017070 con 0x7f2aa4106c30 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa419ef80 con 0x7f2aa4106c30 2024-05-08T20:04:17.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2a9bfff700 1 -- 172.21.15.33:0/1127581356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2a9c00f040 con 0x7f2aa4106c30 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2a9bfff700 1 -- 172.21.15.33:0/1127581356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005760 con 0x7f2aa4106c30 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.410+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa419f450 con 0x7f2aa4106c30 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.411+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa40fcea0 con 0x7f2aa4106c30 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.412+0000 7f2a9bfff700 1 -- 172.21.15.33:0/1127581356 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2a9c0058c0 con 0x7f2aa4106c30 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.413+0000 7f2a9bfff700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2a900a11b0 0x7f2a900a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.413+0000 7f2aa2ffd700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2a900a11b0 0x7f2a900a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.413+0000 7f2a9bfff700 1 -- 172.21.15.33:0/1127581356 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2a9c0cc740 con 0x7f2aa4106c30 2024-05-08T20:04:17.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.414+0000 7f2aa2ffd700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2a900a11b0 0x7f2a900a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a940038c0 tx=0x7f2a94005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.417+0000 7f2a9bfff700 1 -- 172.21.15.33:0/1127581356 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2a9c095ea0 con 0x7f2aa4106c30 2024-05-08T20:04:17.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:17 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2709907194' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:17.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:17 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2389882920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:17.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:17 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2709907194' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:17.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:17 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2389882920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:17.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:17 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2709907194' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:17.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:17 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2389882920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.688+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2aa4067380 con 0x7f2aa4106c30 2024-05-08T20:04:17.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.689+0000 7f2a9bfff700 1 -- 172.21.15.33:0/1127581356 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10848 (secure 0 0 0) 0x7f2a9c0994c0 con 0x7f2aa4106c30 2024-05-08T20:04:17.679 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:17.680 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:03:35.012471+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:04:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2a900a11b0 msgr2=0x7f2a900a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2a900a11b0 0x7f2a900a3670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a940038c0 tx=0x7f2a94005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa4106c30 msgr2=0x7f2aa419e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa4106c30 0x7f2aa419e400 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c007ee0 tx=0x7f2a9c00d3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 shutdown_connections 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa4106c30 0x7f2aa419e400 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2a900a11b0 0x7f2a900a3670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2aa41019d0 0x7f2aa4196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 --2- 172.21.15.33:0/1127581356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2aa4104300 0x7f2aa41973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 >> 172.21.15.33:0/1127581356 conn(0x7f2aa40fb320 msgr2=0x7f2aa4102270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 shutdown_connections 2024-05-08T20:04:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.692+0000 7f2aa93dc700 1 -- 172.21.15.33:0/1127581356 wait complete. 2024-05-08T20:04:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-05-08T20:04:17.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T20:03:29.655534+0000', 'modified': '2024-05-08T20:03:35.012471+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24566, 'mds_1': 24535, 'mds_2': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24503': {'gid': 24503, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/120986217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 120986217}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 120986217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.132:6837/852069157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 852069157}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 852069157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.132:6839/3830178924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6838', 'nonce': 3830178924}, {'type': 'v1', 'addr': '172.21.15.132:6839', 'nonce': 3830178924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24527': {'gid': 24527, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6837/84840757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 84840757}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 84840757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24535': {'gid': 24535, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.33:6839/151321489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6838', 'nonce': 151321489}, {'type': 'v1', 'addr': '172.21.15.33:6839', 'nonce': 151321489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24566': {'gid': 24566, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6839/3735435957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 3735435957}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 3735435957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T20:04:17.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-08T20:04:17.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-08T20:04:17.835 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.845+0000 7f3ea59c1700 1 -- 172.21.15.33:0/4022764417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea01020f0 msgr2=0x7f3ea0102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.845+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/4022764417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea01020f0 0x7f3ea0102570 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3e94009990 tx=0x7f3e94009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 -- 172.21.15.33:0/4022764417 shutdown_connections 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/4022764417 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea0102ab0 0x7f3ea01093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/4022764417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea0100f20 0x7f3ea0101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/4022764417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea01020f0 0x7f3ea0102570 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 -- 172.21.15.33:0/4022764417 >> 172.21.15.33:0/4022764417 conn(0x7f3ea00fc4e0 msgr2=0x7f3ea00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 -- 172.21.15.33:0/4022764417 shutdown_connections 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 -- 172.21.15.33:0/4022764417 wait complete. 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 Processor -- start 2024-05-08T20:04:17.836 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.846+0000 7f3ea59c1700 1 -- start start 2024-05-08T20:04:17.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3ea59c1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea0100f20 0x7f3ea01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3ea59c1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea01020f0 0x7f3ea01996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.838 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3ea59c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea0102ab0 0x7f3ea01a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3ea59c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01a0ce0 con 0x7f3ea0102ab0 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3ea59c1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01a0e20 con 0x7f3ea01020f0 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3ea59c1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01a0fb0 con 0x7f3ea0100f20 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea0102ab0 0x7f3ea01a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9e7fc700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea01020f0 0x7f3ea01996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea0102ab0 0x7f3ea01a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59792/0 (socket says 172.21.15.33:59792) 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1743453191 learned_addr learned my addr 172.21.15.33:0/1743453191 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea0100f20 0x7f3ea01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1743453191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea0100f20 msgr2=0x7f3ea01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea0100f20 0x7f3ea01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1743453191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea01020f0 msgr2=0x7f3ea01996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea01020f0 0x7f3ea01996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1743453191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e940095f0 con 0x7f3ea0102ab0 2024-05-08T20:04:17.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea0102ab0 0x7f3ea01a0710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3e98007ee0 tx=0x7f3e9800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.847+0000 7f3ea49bf700 1 -- 172.21.15.33:0/1743453191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98017070 con 0x7f3ea0102ab0 2024-05-08T20:04:17.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.848+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea01a1290 con 0x7f3ea0102ab0 2024-05-08T20:04:17.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.848+0000 7f3ea49bf700 1 -- 172.21.15.33:0/1743453191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e9800f040 con 0x7f3ea0102ab0 2024-05-08T20:04:17.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.848+0000 7f3ea49bf700 1 -- 172.21.15.33:0/1743453191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98005610 con 0x7f3ea0102ab0 2024-05-08T20:04:17.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.848+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea01a1750 con 0x7f3ea0102ab0 2024-05-08T20:04:17.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.850+0000 7f3ea49bf700 1 -- 172.21.15.33:0/1743453191 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3e98005790 con 0x7f3ea0102ab0 2024-05-08T20:04:17.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.851+0000 7f3ea49bf700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3e880a11b0 0x7f3e880a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.851+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3e880a11b0 0x7f3e880a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.851+0000 7f3ea49bf700 1 -- 172.21.15.33:0/1743453191 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3e980cc100 con 0x7f3ea0102ab0 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.851+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3e880a11b0 0x7f3e880a3670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0100c40 tx=0x7f3e9000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.851+0000 7f3eb1b7bb80 1 Processor -- start 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3eb1b7bb80 1 -- start start 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb681a100 con 0x55bbb68c4810 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb6817ac0 con 0x55bbb68c34f0 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb68133b0 con 0x55bbb68c3e50 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59804/0 (socket says 172.21.15.33:59804) 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/4082686188 learned_addr learned my addr 172.21.15.33:0/4082686188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9effd700 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/4082686188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 msgr2=0x55bbb68c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/4082686188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 msgr2=0x55bbb68c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/4082686188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbb6694360 con 0x55bbb68c4810 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.852+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68c4c90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3e980a13f0 tx=0x7f3e98098f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c11beebb1d65fda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3e85ffb700 1 -- 172.21.15.33:0/4082686188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9809d2d0 con 0x55bbb68c4810 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3e85ffb700 1 -- 172.21.15.33:0/4082686188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e980a1920 con 0x55bbb68c4810 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3e85ffb700 1 -- 172.21.15.33:0/4082686188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98095bb0 con 0x55bbb68c4810 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/4082686188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 msgr2=0x55bbb68c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68c4c90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3e980a13f0 tx=0x7f3e98098f30 comp rx=0 tx=0).stop 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/4082686188 shutdown_connections 2024-05-08T20:04:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68c4c90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/4082686188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/4082686188 >> 172.21.15.33:0/4082686188 conn(0x55bbb68211c0 msgr2=0x55bbb68bdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/4082686188 shutdown_connections 2024-05-08T20:04:17.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.853+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/4082686188 wait complete. 2024-05-08T20:04:17.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 -- start start 2024-05-08T20:04:17.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 Processor -- start 2024-05-08T20:04:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68cce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68d4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb67af510 con 0x55bbb68c34f0 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb67af1b0 con 0x55bbb68c3e50 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb6696650 con 0x55bbb68c4810 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3eb1b7bb80 10 client.0 _ll_register_callbacks cb 0x55bbb67b8ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3e9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.854+0000 7f3e9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59818/0 (socket says 172.21.15.33:59818) 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9effd700 1 -- 172.21.15.33:0/366945188 learned_addr learned my addr 172.21.15.33:0/366945188 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68d4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9effd700 1 -- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 msgr2=0x55bbb68d4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9effd700 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68d4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9effd700 1 -- 172.21.15.33:0/366945188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 msgr2=0x55bbb68cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9effd700 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9effd700 1 -- 172.21.15.33:0/366945188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea01a1750 con 0x55bbb68c34f0 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e9effd700 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68cce10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e900116f0 tx=0x7f3e900047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b8762b03cb83da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e7effd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:17.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e7effd700 1 -- 172.21.15.33:0/366945188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9001f840 con 0x55bbb68c34f0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e7effd700 1 -- 172.21.15.33:0/366945188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3e90017070 con 0x55bbb68c34f0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbb676c220 con 0x55bbb68c34f0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3e7effd700 1 -- 172.21.15.33:0/366945188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e90011e90 con 0x55bbb68c34f0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3eb1b7bb80 10 client.15036 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.855+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bbb6640b10 con 0x55bbb68c34f0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3e7effd700 1 -- 172.21.15.33:0/366945188 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55bbb676c220 con 0x55bbb68c34f0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3e7effd700 1 -- 172.21.15.33:0/366945188 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3e9001eaa0 con 0x55bbb68c34f0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3eb1b7bb80 10 client.15036 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3eb1b7bb80 10 client.15036 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3eb1b7bb80 20 client.15036 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb68d80b0 0x55bbb68dd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3eb1b7bb80 4 client.15036 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 --> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbb68927c0 con 0x55bbb68d80b0 2024-05-08T20:04:17.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.856+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb68d80b0 0x55bbb68dd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.857+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb68d80b0 0x55bbb68dd370 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d564b168b5e76ebb server_cookie=1b74db6bbc100f09 in_seq=0 out_seq=0 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.857+0000 7f3e7effd700 10 client.15036 ms_handle_connect on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.857+0000 7f3e7effd700 1 -- 172.21.15.33:0/366945188 <== mds.2 v2:172.21.15.132:6836/852069157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bbb68927c0 con 0x55bbb68d80b0 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.857+0000 7f3e7effd700 10 client.15036 handle_command_reply: tid=0 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.857+0000 7f3eb1b7bb80 1 client.15036 shutdown 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 msgr2=0x55bbb68cce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68cce10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3e900116f0 tx=0x7f3e900047c0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 shutdown_connections 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68d4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb68d80b0 0x55bbb68dd370 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68cce10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/366945188 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.856 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3e7effd700 0 client.15036 ms_handle_reset on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:17.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 >> 172.21.15.33:0/366945188 conn(0x55bbb68211c0 msgr2=0x55bbb68bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 shutdown_connections 2024-05-08T20:04:17.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/366945188 wait complete. 2024-05-08T20:04:17.857 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.858+0000 7f3eb1b7bb80 20 client.15036 trim_cache size 0 max 16384 2024-05-08T20:04:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 Processor -- start 2024-05-08T20:04:17.868 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 -- start start 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68d4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb67d12b0 con 0x55bbb68c4810 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb680c150 con 0x55bbb68c34f0 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb6810010 con 0x55bbb68c3e50 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3e9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68d4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3e9f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68d4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59832/0 (socket says 172.21.15.33:59832) 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1015813695 learned_addr learned my addr 172.21.15.33:0/1015813695 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1015813695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 msgr2=0x55bbb68d4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.869 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.877+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1015813695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 msgr2=0x55bbb68c38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e9f7fe700 1 -- 172.21.15.33:0/1015813695 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbb67d9510 con 0x55bbb68c4810 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68d4350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e980991a0 tx=0x7f3e9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70de0c38409cbf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e867fc700 1 -- 172.21.15.33:0/1015813695 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9809d2d0 con 0x55bbb68c4810 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e867fc700 1 -- 172.21.15.33:0/1015813695 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e98004cb0 con 0x55bbb68c4810 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3e867fc700 1 -- 172.21.15.33:0/1015813695 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98099700 con 0x55bbb68c4810 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1015813695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 msgr2=0x55bbb68d4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68d4350 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3e980991a0 tx=0x7f3e9800b040 comp rx=0 tx=0).stop 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1015813695 shutdown_connections 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c4810 0x55bbb68d4350 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c34f0 0x55bbb68c38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.870 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1015813695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.878+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1015813695 >> 172.21.15.33:0/1015813695 conn(0x55bbb68211c0 msgr2=0x55bbb68ba1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.879+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1015813695 shutdown_connections 2024-05-08T20:04:17.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.879+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1015813695 wait complete. 2024-05-08T20:04:17.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.879+0000 7f3eb1b7bb80 1 -- start start 2024-05-08T20:04:17.871 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.879+0000 7f3eb1b7bb80 1 Processor -- start 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb68c9640 con 0x55bbb68c34f0 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb68c97b0 con 0x55bbb68c3e50 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbb68c9970 con 0x55bbb68c4810 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 10 client.0 _ll_register_callbacks cb 0x55bbb67b8ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59834/0 (socket says 172.21.15.33:59834) 2024-05-08T20:04:17.875 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 -- 172.21.15.33:0/1025923869 learned_addr learned my addr 172.21.15.33:0/1025923869 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9f7fe700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 -- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 msgr2=0x55bbb68c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 -- 172.21.15.33:0/1025923869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 msgr2=0x55bbb68d4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 -- 172.21.15.33:0/1025923869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbb6694360 con 0x55bbb68c34f0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e9effd700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68c89f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b580 tx=0x7f3e9001a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb15f500d0e3e88 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e7effd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e7effd700 1 -- 172.21.15.33:0/1025923869 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000b9e0 con 0x55bbb68c34f0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3e7effd700 1 -- 172.21.15.33:0/1025923869 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3e90017070 con 0x55bbb68c34f0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.880+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e980a1920 con 0x55bbb68c34f0 2024-05-08T20:04:17.876 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3e7effd700 1 -- 172.21.15.33:0/1025923869 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e9001e430 con 0x55bbb68c34f0 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 10 client.15042 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bbb6698c80 con 0x55bbb68c34f0 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3e7effd700 1 -- 172.21.15.33:0/1025923869 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e980a1920 con 0x55bbb68c34f0 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3e7effd700 1 -- 172.21.15.33:0/1025923869 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3e9001fcf0 con 0x55bbb68c34f0 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 10 client.15042 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 10 client.15042 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 20 client.15042 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb6932f30 0x55bbb692f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 4 client.15042 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 --> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bbb680be70 con 0x55bbb6932f30 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.881+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb6932f30 0x55bbb692f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3e7effd700 10 client.15042 ms_handle_connect on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3e9e7fc700 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb6932f30 0x55bbb692f860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70097075374c79 server_cookie=28c96fadde60ff6f in_seq=0 out_seq=0 2024-05-08T20:04:17.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3e7effd700 1 -- 172.21.15.33:0/1025923869 <== mds.2 v2:172.21.15.132:6836/852069157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55bbb680be70 con 0x55bbb6932f30 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3e7effd700 10 client.15042 handle_command_reply: tid=0 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 client.15042 shutdown 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 msgr2=0x55bbb68c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68c89f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3e9000b580 tx=0x7f3e9001a9f0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 shutdown_connections 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bbb68c4810 0x55bbb68c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bbb6932f30 0x55bbb692f860 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bbb68c34f0 0x55bbb68c89f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 --2- 172.21.15.33:0/1025923869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb68c3e50 0x55bbb68d4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 >> 172.21.15.33:0/1025923869 conn(0x55bbb68211c0 msgr2=0x55bbb68cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3e7effd700 0 client.15042 ms_handle_reset on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.882+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 shutdown_connections 2024-05-08T20:04:17.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3eb1b7bb80 1 -- 172.21.15.33:0/1025923869 wait complete. 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3eb1b7bb80 20 client.15042 trim_cache size 0 max 16384 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24508, 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 43.874770441000003, 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 23, 2024-05-08T20:04:17.879 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 80, 2024-05-08T20:04:17.880 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T20:04:17.880 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 63.551119491999998 2024-05-08T20:04:17.880 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:04:17.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3e880a11b0 msgr2=0x7f3e880a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3e880a11b0 0x7f3e880a3670 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0100c40 tx=0x7f3e9000b410 comp rx=0 tx=0).stop 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea0102ab0 msgr2=0x7f3ea01a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea0102ab0 0x7f3ea01a0710 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3e98007ee0 tx=0x7f3e9800d3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 shutdown_connections 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ea0102ab0 0x7f3ea01a0710 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f3e880a11b0 0x7f3e880a3670 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea0100f20 0x7f3ea01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 --2- 172.21.15.33:0/1743453191 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ea01020f0 0x7f3ea01996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 >> 172.21.15.33:0/1743453191 conn(0x7f3ea00fc4e0 msgr2=0x7f3ea0107950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 shutdown_connections 2024-05-08T20:04:17.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:17.883+0000 7f3ea59c1700 1 -- 172.21.15.33:0/1743453191 wait complete. 2024-05-08T20:04:17.886 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-05-08T20:04:18.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.035+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1760307307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 msgr2=0x7fcd54101360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.035+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1760307307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54101360 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fcd48009990 tx=0x7fcd48009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1760307307 shutdown_connections 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1760307307 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd54102ab0 0x7fcd541093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1760307307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54101360 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1760307307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd541020f0 0x7fcd54102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1760307307 >> 172.21.15.33:0/1760307307 conn(0x7fcd540fc4e0 msgr2=0x7fcd540fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1760307307 shutdown_connections 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1760307307 wait complete. 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 Processor -- start 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.036+0000 7fcd5aae0700 1 -- start start 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5aae0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5aae0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd541020f0 0x7fcd54073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5aae0700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd54102ab0 0x7fcd540738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5aae0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd54074070 con 0x7fcd54100f20 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5aae0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd540741e0 con 0x7fcd541020f0 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5aae0700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd541a1070 con 0x7fcd54102ab0 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59852/0 (socket says 172.21.15.33:59852) 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 -- 172.21.15.33:0/1194747643 learned_addr learned my addr 172.21.15.33:0/1194747643 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd53fff700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd541020f0 0x7fcd54073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5907d700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd54102ab0 0x7fcd540738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 -- 172.21.15.33:0/1194747643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd54102ab0 msgr2=0x7fcd540738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd54102ab0 0x7fcd540738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 -- 172.21.15.33:0/1194747643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd541020f0 msgr2=0x7fcd54073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd541020f0 0x7fcd54073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 -- 172.21.15.33:0/1194747643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009520 con 0x7fcd54100f20 2024-05-08T20:04:18.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd5887c700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54074d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd48004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.037+0000 7fcd51ffb700 1 -- 172.21.15.33:0/1194747643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4801d070 con 0x7fcd54100f20 2024-05-08T20:04:18.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.038+0000 7fcd51ffb700 1 -- 172.21.15.33:0/1194747643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd48005030 con 0x7fcd54100f20 2024-05-08T20:04:18.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.038+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c009c40 con 0x7fcd54100f20 2024-05-08T20:04:18.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.038+0000 7fcd51ffb700 1 -- 172.21.15.33:0/1194747643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd48004c40 con 0x7fcd54100f20 2024-05-08T20:04:18.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.038+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd480095f0 con 0x7fcd54100f20 2024-05-08T20:04:18.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.041+0000 7fcd51ffb700 1 -- 172.21.15.33:0/1194747643 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fcd4802a400 con 0x7fcd54100f20 2024-05-08T20:04:18.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.041+0000 7fcd51ffb700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd440a1230 0x7fcd440a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd51ffb700 1 -- 172.21.15.33:0/1194747643 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcd480cdb40 con 0x7fcd54100f20 2024-05-08T20:04:18.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd53fff700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd440a1230 0x7fcd440a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 Processor -- start 2024-05-08T20:04:18.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 -- start start 2024-05-08T20:04:18.034 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd53fff700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd440a1230 0x7fcd440a36f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009df0 tx=0x7fcd40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f1a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1ae50 0x560b22f1b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f1bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22e71100 con 0x560b22f1ae50 2024-05-08T20:04:18.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22e6eac0 con 0x560b22f1b810 2024-05-08T20:04:18.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.042+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22e6a3b0 con 0x560b22f1a4f0 2024-05-08T20:04:18.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1ae50 0x560b22f1b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1ae50 0x560b22f1b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59864/0 (socket says 172.21.15.33:59864) 2024-05-08T20:04:18.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 -- 172.21.15.33:0/4045575667 learned_addr learned my addr 172.21.15.33:0/4045575667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd5907d700 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f1bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd5887c700 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f1a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 -- 172.21.15.33:0/4045575667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 msgr2=0x560b22f1a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f1a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 -- 172.21.15.33:0/4045575667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 msgr2=0x560b22f1bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f1bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 -- 172.21.15.33:0/4045575667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b22ceb360 con 0x560b22f1ae50 2024-05-08T20:04:18.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd53fff700 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1ae50 0x560b22f1b2d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcd400094f0 tx=0x7fcd40014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31f46af486081 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.037 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd3effd700 1 -- 172.21.15.33:0/4045575667 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40026630 con 0x560b22f1ae50 2024-05-08T20:04:18.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd3effd700 1 -- 172.21.15.33:0/4045575667 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd40021070 con 0x560b22f1ae50 2024-05-08T20:04:18.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.043+0000 7fcd3effd700 1 -- 172.21.15.33:0/4045575667 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4001d800 con 0x560b22f1ae50 2024-05-08T20:04:18.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4045575667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1ae50 msgr2=0x560b22f1b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1ae50 0x560b22f1b2d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fcd400094f0 tx=0x7fcd40014000 comp rx=0 tx=0).stop 2024-05-08T20:04:18.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4045575667 shutdown_connections 2024-05-08T20:04:18.038 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f1bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f1a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4045575667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1ae50 0x560b22f1b2d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4045575667 >> 172.21.15.33:0/4045575667 conn(0x560b22e781c0 msgr2=0x560b22f14d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4045575667 shutdown_connections 2024-05-08T20:04:18.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4045575667 wait complete. 2024-05-08T20:04:18.039 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.044+0000 7fcd66c9ab80 1 -- start start 2024-05-08T20:04:18.040 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 1 Processor -- start 2024-05-08T20:04:18.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1a4f0 0x560b22f23dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1ae50 0x560b22f24310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f2b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22e06510 con 0x560b22f1a4f0 2024-05-08T20:04:18.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22e061b0 con 0x560b22f1b810 2024-05-08T20:04:18.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22ced650 con 0x560b22f1ae50 2024-05-08T20:04:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd66c9ab80 10 client.0 _ll_register_callbacks cb 0x560b22e0fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1a4f0 0x560b22f23dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1a4f0 0x560b22f23dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59876/0 (socket says 172.21.15.33:59876) 2024-05-08T20:04:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 -- 172.21.15.33:0/4271439983 learned_addr learned my addr 172.21.15.33:0/4271439983 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd53fff700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1ae50 0x560b22f24310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5907d700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f2b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 -- 172.21.15.33:0/4271439983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1ae50 msgr2=0x560b22f24310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1ae50 0x560b22f24310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 -- 172.21.15.33:0/4271439983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 msgr2=0x560b22f2b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f2b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd5887c700 1 -- 172.21.15.33:0/4271439983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd40017070 con 0x560b22f1a4f0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.045+0000 7fcd53fff700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1ae50 0x560b22f24310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd5887c700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1a4f0 0x560b22f23dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcd4809ac70 tx=0x7fcd4809b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b63ae3cecfbff91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd33fff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd33fff700 1 -- 172.21.15.33:0/4271439983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4809eda0 con 0x560b22f1a4f0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd33fff700 1 -- 172.21.15.33:0/4271439983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcd480a3360 con 0x560b22f1a4f0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560b22dc3220 con 0x560b22f1a4f0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd33fff700 1 -- 172.21.15.33:0/4271439983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd480b9130 con 0x560b22f1a4f0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd66c9ab80 10 client.15054 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560b22c97b10 con 0x560b22f1a4f0 2024-05-08T20:04:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd33fff700 1 -- 172.21.15.33:0/4271439983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x560b22dc3220 con 0x560b22f1a4f0 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd33fff700 1 -- 172.21.15.33:0/4271439983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcd4809a4f0 con 0x560b22f1a4f0 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd66c9ab80 10 client.15054 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd66c9ab80 10 client.15054 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd66c9ab80 20 client.15054 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.046+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f2ec40 0x560b22f33f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.047+0000 7fcd66c9ab80 4 client.15054 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.047+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 --> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560b22ee97c0 con 0x560b22f2ec40 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.047+0000 7fcd53fff700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f2ec40 0x560b22f33f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.047+0000 7fcd33fff700 10 client.15054 ms_handle_connect on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.047+0000 7fcd53fff700 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f2ec40 0x560b22f33f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6391eb7ff3b24161 server_cookie=d30599f75d6b90fd in_seq=0 out_seq=0 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd33fff700 1 -- 172.21.15.33:0/4271439983 <== mds.1 v2:172.21.15.33:6838/151321489 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560b22ee97c0 con 0x560b22f2ec40 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd33fff700 10 client.15054 handle_command_reply: tid=0 2024-05-08T20:04:18.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 client.15054 shutdown 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1a4f0 msgr2=0x560b22f23dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1a4f0 0x560b22f23dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fcd4809ac70 tx=0x7fcd4809b7a0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 shutdown_connections 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f2ec40 0x560b22f33f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1b810 0x560b22f2b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1a4f0 0x560b22f23dd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd33fff700 0 client.15054 ms_handle_reset on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/4271439983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1ae50 0x560b22f24310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 >> 172.21.15.33:0/4271439983 conn(0x560b22e781c0 msgr2=0x560b22f14550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 shutdown_connections 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/4271439983 wait complete. 2024-05-08T20:04:18.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.048+0000 7fcd66c9ab80 20 client.15054 trim_cache size 0 max 16384 2024-05-08T20:04:18.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.067+0000 7fcd66c9ab80 1 Processor -- start 2024-05-08T20:04:18.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.067+0000 7fcd66c9ab80 1 -- start start 2024-05-08T20:04:18.065 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f23350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f2b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22ee97c0 con 0x560b22f1b810 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22dc3220 con 0x560b22f1ae50 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22e282b0 con 0x560b22f1a4f0 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f23b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59882/0 (socket says 172.21.15.33:59882) 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 -- 172.21.15.33:0/600873890 learned_addr learned my addr 172.21.15.33:0/600873890 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd53fff700 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f2b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5887c700 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f23350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 -- 172.21.15.33:0/600873890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 msgr2=0x560b22f23350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f23350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 -- 172.21.15.33:0/600873890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 msgr2=0x560b22f2b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f2b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 -- 172.21.15.33:0/600873890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560b22e30510 con 0x560b22f1b810 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd53fff700 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f2b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.068+0000 7fcd5907d700 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f23b80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007630 tx=0x7fcd4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdabec42cd9b641d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd3f7fe700 1 -- 172.21.15.33:0/600873890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00e040 con 0x560b22f1b810 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd3f7fe700 1 -- 172.21.15.33:0/600873890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd4c00f040 con 0x560b22f1b810 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd3f7fe700 1 -- 172.21.15.33:0/600873890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0176b0 con 0x560b22f1b810 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/600873890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 msgr2=0x560b22f23b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f23b80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007630 tx=0x7fcd4c00b040 comp rx=0 tx=0).stop 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/600873890 shutdown_connections 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f23b80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f23350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/600873890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f2b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/600873890 >> 172.21.15.33:0/600873890 conn(0x560b22e781c0 msgr2=0x560b22f21dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/600873890 shutdown_connections 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.069+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/600873890 wait complete. 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 -- start start 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 Processor -- start 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f25490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f259d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f2a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22f2abd0 con 0x560b22f1b810 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22f2ad40 con 0x560b22f1ae50 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560b22f2af00 con 0x560b22f1a4f0 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd66c9ab80 10 client.0 _ll_register_callbacks cb 0x560b22e0fae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd5907d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f2a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd5907d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f2a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59890/0 (socket says 172.21.15.33:59890) 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd5907d700 1 -- 172.21.15.33:0/3690238097 learned_addr learned my addr 172.21.15.33:0/3690238097 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.070+0000 7fcd53fff700 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f259d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd5887c700 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f25490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd5907d700 1 -- 172.21.15.33:0/3690238097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 msgr2=0x560b22f25490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd5907d700 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f25490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd5907d700 1 -- 172.21.15.33:0/3690238097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 msgr2=0x560b22f259d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd5907d700 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f259d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd5907d700 1 -- 172.21.15.33:0/3690238097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4002a040 con 0x560b22f1b810 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd5907d700 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f2a690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007600 tx=0x7fcd4c005250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb6d161ba00cd28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd33fff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd33fff700 1 -- 172.21.15.33:0/3690238097 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c024070 con 0x560b22f1b810 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd33fff700 1 -- 172.21.15.33:0/3690238097 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcd4c01f440 con 0x560b22f1b810 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd40021070 con 0x560b22f1b810 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd33fff700 1 -- 172.21.15.33:0/3690238097 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd4c0057d0 con 0x560b22f1b810 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd66c9ab80 10 client.15060 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fcd4c0092c0 con 0x560b22f1b810 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.071+0000 7fcd33fff700 1 -- 172.21.15.33:0/3690238097 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd40021070 con 0x560b22f1b810 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd33fff700 1 -- 172.21.15.33:0/3690238097 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcd4c01d070 con 0x560b22f1b810 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 10 client.15060 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 10 client.15060 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 20 client.15060 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f89f30 0x560b22f86880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 4 client.15060 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 --> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560b22e62e70 con 0x560b22f89f30 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd5887c700 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f89f30 0x560b22f86880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd33fff700 10 client.15060 ms_handle_connect on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd5887c700 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f89f30 0x560b22f86880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6236ae075edd9002 server_cookie=627af7e16467c63 in_seq=0 out_seq=0 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd33fff700 1 -- 172.21.15.33:0/3690238097 <== mds.1 v2:172.21.15.33:6838/151321489 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560b22e62e70 con 0x560b22f89f30 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd33fff700 10 client.15060 handle_command_reply: tid=0 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 1 client.15060 shutdown 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 msgr2=0x560b22f2a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f2a690 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c007600 tx=0x7fcd4c005250 comp rx=0 tx=0).stop 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.072+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 shutdown_connections 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560b22f89f30 0x560b22f86880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560b22f1b810 0x560b22f2a690 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd33fff700 0 client.15060 ms_handle_reset on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:18.072 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560b22f1a4f0 0x560b22f25490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 1 --2- 172.21.15.33:0/3690238097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560b22f1ae50 0x560b22f259d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 >> 172.21.15.33:0/3690238097 conn(0x560b22e781c0 msgr2=0x560b22f219c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 shutdown_connections 2024-05-08T20:04:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 1 -- 172.21.15.33:0/3690238097 wait complete. 2024-05-08T20:04:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd66c9ab80 20 client.15060 trim_cache size 0 max 16384 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24535, 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T20:04:18.074 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 45.03418714, 2024-05-08T20:04:18.075 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 23, 2024-05-08T20:04:18.075 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 80, 2024-05-08T20:04:18.075 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T20:04:18.075 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 58.328190753000001 2024-05-08T20:04:18.075 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd440a1230 msgr2=0x7fcd440a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd440a1230 0x7fcd440a36f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009df0 tx=0x7fcd40009260 comp rx=0 tx=0).stop 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 msgr2=0x7fcd54074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54074d00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fcd48000c00 tx=0x7fcd48004730 comp rx=0 tx=0).stop 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 shutdown_connections 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fcd440a1230 0x7fcd440a36f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd54102ab0 0x7fcd540738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcd54100f20 0x7fcd54074d00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 --2- 172.21.15.33:0/1194747643 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd541020f0 0x7fcd54073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.073+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 >> 172.21.15.33:0/1194747643 conn(0x7fcd540fc4e0 msgr2=0x7fcd541055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.074+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 shutdown_connections 2024-05-08T20:04:18.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.074+0000 7fcd5aae0700 1 -- 172.21.15.33:0/1194747643 wait complete. 2024-05-08T20:04:18.078 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-08T20:04:18.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 -- 172.21.15.33:0/3289649396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 msgr2=0x7fa80c1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 --2- 172.21.15.33:0/3289649396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1093d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa80400b0a0 tx=0x7fa80400b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 -- 172.21.15.33:0/3289649396 shutdown_connections 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 --2- 172.21.15.33:0/3289649396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1093d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 --2- 172.21.15.33:0/3289649396 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa80c100f20 0x7fa80c101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 --2- 172.21.15.33:0/3289649396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c1020f0 0x7fa80c102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 -- 172.21.15.33:0/3289649396 >> 172.21.15.33:0/3289649396 conn(0x7fa80c0fc4e0 msgr2=0x7fa80c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 -- 172.21.15.33:0/3289649396 shutdown_connections 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.227+0000 7fa81169f700 1 -- 172.21.15.33:0/3289649396 wait complete. 2024-05-08T20:04:18.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 Processor -- start 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 -- start start 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c100f20 0x7fa80c199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa80c1020f0 0x7fa80c1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c1a0d90 con 0x7fa80c102ab0 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c1a0ed0 con 0x7fa80c1020f0 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.228+0000 7fa81169f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80c1a1060 con 0x7fa80c100f20 2024-05-08T20:04:18.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1a07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59898/0 (socket says 172.21.15.33:59898) 2024-05-08T20:04:18.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80affd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c100f20 0x7fa80c199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1935079203 learned_addr learned my addr 172.21.15.33:0/1935079203 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa80c1020f0 0x7fa80c1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1935079203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c100f20 msgr2=0x7fa80c199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c100f20 0x7fa80c199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1935079203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa80c1020f0 msgr2=0x7fa80c1997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa80c1020f0 0x7fa80c1997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1935079203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa804009d00 con 0x7fa80c102ab0 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1a07c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa8040079b0 tx=0x7fa8040079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa7f3fff700 1 -- 172.21.15.33:0/1935079203 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400e040 con 0x7fa80c102ab0 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa80c1a12e0 con 0x7fa80c102ab0 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa7f3fff700 1 -- 172.21.15.33:0/1935079203 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa80400be50 con 0x7fa80c102ab0 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa7f3fff700 1 -- 172.21.15.33:0/1935079203 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8040052a0 con 0x7fa80c102ab0 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.229+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80c1a17b0 con 0x7fa80c102ab0 2024-05-08T20:04:18.223 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.232+0000 7fa7f3fff700 1 -- 172.21.15.33:0/1935079203 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa80401d470 con 0x7fa80c102ab0 2024-05-08T20:04:18.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.232+0000 7fa7f3fff700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7f40a11b0 0x7fa7f40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.232+0000 7fa80affd700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7f40a11b0 0x7fa7f40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.232+0000 7fa7f3fff700 1 -- 172.21.15.33:0/1935079203 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa8040cde40 con 0x7fa80c102ab0 2024-05-08T20:04:18.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa80affd700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7f40a11b0 0x7fa7f40a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa80c100c40 tx=0x7fa7fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 Processor -- start 2024-05-08T20:04:18.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 -- start start 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940abf7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940abf82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940abf8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ab4e100 con 0x55940abf8810 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ab4bac0 con 0x55940abf7e50 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.233+0000 7fa81d859b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ab473b0 con 0x55940abf74f0 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940abf8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940abf8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59902/0 (socket says 172.21.15.33:59902) 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1727575103 learned_addr learned my addr 172.21.15.33:0/1727575103 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940abf82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80affd700 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940abf7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1727575103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 msgr2=0x55940abf7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940abf7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1727575103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 msgr2=0x55940abf82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940abf82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 -- 172.21.15.33:0/1727575103 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a9c8360 con 0x55940abf8810 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940abf82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940abf8c90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa8040a3130 tx=0x7fa804006230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a850fc3618847ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa7f17fa700 1 -- 172.21.15.33:0/1727575103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80409b270 con 0x55940abf8810 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa7f17fa700 1 -- 172.21.15.33:0/1727575103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa80409f0a0 con 0x55940abf8810 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.234+0000 7fa7f17fa700 1 -- 172.21.15.33:0/1727575103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80409b730 con 0x55940abf8810 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 -- 172.21.15.33:0/1727575103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 msgr2=0x55940abf8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940abf8c90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa8040a3130 tx=0x7fa804006230 comp rx=0 tx=0).stop 2024-05-08T20:04:18.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 -- 172.21.15.33:0/1727575103 shutdown_connections 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940abf8c90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940abf7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 --2- 172.21.15.33:0/1727575103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940abf82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 -- 172.21.15.33:0/1727575103 >> 172.21.15.33:0/1727575103 conn(0x55940ab551c0 msgr2=0x55940abf1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 -- 172.21.15.33:0/1727575103 shutdown_connections 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 -- 172.21.15.33:0/1727575103 wait complete. 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.235+0000 7fa81d859b80 1 -- start start 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 1 Processor -- start 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf74f0 0x55940ac00ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf7e50 0x55940ac010e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac08120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940aae3510 con 0x55940abf8810 2024-05-08T20:04:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940aae31b0 con 0x55940abf74f0 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940a9ca650 con 0x55940abf7e50 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa81d859b80 10 client.0 _ll_register_callbacks cb 0x55940aaecae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac08120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac08120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59910/0 (socket says 172.21.15.33:59910) 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 -- 172.21.15.33:0/3692987525 learned_addr learned my addr 172.21.15.33:0/3692987525 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80affd700 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf74f0 0x55940ac00ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf7e50 0x55940ac010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 -- 172.21.15.33:0/3692987525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf7e50 msgr2=0x55940ac010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf7e50 0x55940ac010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 -- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf74f0 msgr2=0x55940ac00ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf74f0 0x55940ac00ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.236+0000 7fa80b7fe700 1 -- 172.21.15.33:0/3692987525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8000098e0 con 0x55940abf8810 2024-05-08T20:04:18.235 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac08120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa80409af70 tx=0x7fa804004f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4c08df8085a0de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa7eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa7eeff5700 1 -- 172.21.15.33:0/3692987525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80409b270 con 0x55940abf8810 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa7eeff5700 1 -- 172.21.15.33:0/3692987525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa80409b4d0 con 0x55940abf8810 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55940aaa0220 con 0x55940abf8810 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa7eeff5700 1 -- 172.21.15.33:0/3692987525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa80409b690 con 0x55940abf8810 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 10 client.15072 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fa80c1a17b0 con 0x55940abf8810 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa7eeff5700 1 -- 172.21.15.33:0/3692987525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa80407f020 con 0x55940abf8810 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa7eeff5700 1 -- 172.21.15.33:0/3692987525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa804065070 con 0x55940abf8810 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 10 client.15072 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 10 client.15072 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 20 client.15072 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac0ba40 0x55940ac10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.236 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 4 client.15072 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.237+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55940abc67c0 con 0x55940ac0ba40 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.238+0000 7fa80affd700 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac0ba40 0x55940ac10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.238+0000 7fa80affd700 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac0ba40 0x55940ac10ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13e4ea40640b0e34 server_cookie=2daec34322706c86 in_seq=0 out_seq=0 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.238+0000 7fa7eeff5700 10 client.15072 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.239+0000 7fa7eeff5700 1 -- 172.21.15.33:0/3692987525 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55940abc67c0 con 0x55940ac0ba40 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.239+0000 7fa7eeff5700 10 client.15072 handle_command_reply: tid=0 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.239+0000 7fa81d859b80 1 client.15072 shutdown 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.239+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 msgr2=0x55940ac08120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.239+0000 7fa81d859b80 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac08120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa80409af70 tx=0x7fa804004f20 comp rx=0 tx=0).stop 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 shutdown_connections 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac0ba40 0x55940ac10ce0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac08120 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf74f0 0x55940ac00ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.237 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa7eeff5700 0 client.15072 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 --2- 172.21.15.33:0/3692987525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf7e50 0x55940ac010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 >> 172.21.15.33:0/3692987525 conn(0x55940ab551c0 msgr2=0x55940abf1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 shutdown_connections 2024-05-08T20:04:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 1 -- 172.21.15.33:0/3692987525 wait complete. 2024-05-08T20:04:18.238 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.240+0000 7fa81d859b80 20 client.15072 trim_cache size 0 max 16384 2024-05-08T20:04:18.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 Processor -- start 2024-05-08T20:04:18.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 -- start start 2024-05-08T20:04:18.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac011e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf7e50 0x55940abf78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf8810 0x55940ac087d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.257 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940abc67c0 con 0x55940abf7e50 2024-05-08T20:04:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ab052b0 con 0x55940abf8810 2024-05-08T20:04:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa81d859b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ab40150 con 0x55940abf74f0 2024-05-08T20:04:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa80a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf7e50 0x55940abf78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa80a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf7e50 0x55940abf78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59922/0 (socket says 172.21.15.33:59922) 2024-05-08T20:04:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa80a7fc700 1 -- 172.21.15.33:0/812188596 learned_addr learned my addr 172.21.15.33:0/812188596 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.260+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf8810 0x55940ac087d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.258 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80affd700 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80a7fc700 1 -- 172.21.15.33:0/812188596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 msgr2=0x55940ac011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80a7fc700 1 -- 172.21.15.33:0/812188596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf8810 msgr2=0x55940ac087d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf8810 0x55940ac087d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.262 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80a7fc700 1 -- 172.21.15.33:0/812188596 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55940a974b10 con 0x55940abf7e50 2024-05-08T20:04:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80affd700 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf7e50 0x55940abf78d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa800009fd0 tx=0x7fa800010710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5270b8d9832e1688 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa7f1ffb700 1 -- 172.21.15.33:0/812188596 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800004220 con 0x55940abf7e50 2024-05-08T20:04:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa7f1ffb700 1 -- 172.21.15.33:0/812188596 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa800018040 con 0x55940abf7e50 2024-05-08T20:04:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.261+0000 7fa7f1ffb700 1 -- 172.21.15.33:0/812188596 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80001c7b0 con 0x55940abf7e50 2024-05-08T20:04:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 -- 172.21.15.33:0/812188596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf7e50 msgr2=0x55940abf78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.263 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf7e50 0x55940abf78d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa800009fd0 tx=0x7fa800010710 comp rx=0 tx=0).stop 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 -- 172.21.15.33:0/812188596 shutdown_connections 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf8810 0x55940ac087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 --2- 172.21.15.33:0/812188596 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf7e50 0x55940abf78d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 -- 172.21.15.33:0/812188596 >> 172.21.15.33:0/812188596 conn(0x55940ab551c0 msgr2=0x55940abee1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 -- 172.21.15.33:0/812188596 shutdown_connections 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 -- 172.21.15.33:0/812188596 wait complete. 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 -- start start 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.262+0000 7fa81d859b80 1 Processor -- start 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac07d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940ac04950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.264 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac04e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ac053d0 con 0x55940abf8810 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ac05540 con 0x55940abf7e50 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55940ac629a0 con 0x55940abf74f0 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 10 client.0 _ll_register_callbacks cb 0x55940aaecae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac04e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac04e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59928/0 (socket says 172.21.15.33:59928) 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 -- 172.21.15.33:0/2545277434 learned_addr learned my addr 172.21.15.33:0/2545277434 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80a7fc700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940ac04950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80affd700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac07d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 -- 172.21.15.33:0/2545277434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 msgr2=0x55940ac07d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac07d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.265 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 -- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 msgr2=0x55940ac04950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940ac04950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 -- 172.21.15.33:0/2545277434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa800009c80 con 0x55940abf8810 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80affd700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac07d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa80b7fe700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac04e90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa804012000 tx=0x7fa80401dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47662f486dbd144b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa7eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa7eeff5700 1 -- 172.21.15.33:0/2545277434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80409b270 con 0x55940abf8810 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa7eeff5700 1 -- 172.21.15.33:0/2545277434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa804080080 con 0x55940abf8810 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.263+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa80409f0a0 con 0x55940abf8810 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa7eeff5700 1 -- 172.21.15.33:0/2545277434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa80401d960 con 0x55940abf8810 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 10 client.15078 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55940ab0d510 con 0x55940abf8810 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa7eeff5700 1 -- 172.21.15.33:0/2545277434 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa80409f0a0 con 0x55940abf8810 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa7eeff5700 1 -- 172.21.15.33:0/2545277434 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa804065030 con 0x55940abf8810 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 10 client.15078 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 20 client.15078 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac670d0 0x55940ac63ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 4 client.15078 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55940ab3fe70 con 0x55940ac670d0 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.264+0000 7fa80affd700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac670d0 0x55940ac63ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa7eeff5700 10 client.15078 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa80affd700 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac670d0 0x55940ac63ae0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2bdc296a56ff720 server_cookie=9c75d49e05debbb4 in_seq=0 out_seq=0 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa7eeff5700 1 -- 172.21.15.33:0/2545277434 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55940ab3fe70 con 0x55940ac670d0 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa7eeff5700 10 client.15078 handle_command_reply: tid=0 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 client.15078 shutdown 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 msgr2=0x55940ac04e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac04e90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa804012000 tx=0x7fa80401dc10 comp rx=0 tx=0).stop 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 shutdown_connections 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55940ac670d0 0x55940ac63ae0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55940abf8810 0x55940ac04e90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55940abf74f0 0x55940ac07d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa7eeff5700 0 client.15078 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 --2- 172.21.15.33:0/2545277434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55940abf7e50 0x55940ac04950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.268 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 >> 172.21.15.33:0/2545277434 conn(0x55940ab551c0 msgr2=0x55940ac000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 shutdown_connections 2024-05-08T20:04:18.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 1 -- 172.21.15.33:0/2545277434 wait complete. 2024-05-08T20:04:18.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.265+0000 7fa81d859b80 20 client.15078 trim_cache size 0 max 16384 2024-05-08T20:04:18.269 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:04:18.269 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T20:04:18.269 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24566, 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 48.607720876000002, 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 23, 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 80, 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 55.073691115000003 2024-05-08T20:04:18.270 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7f40a11b0 msgr2=0x7fa7f40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7f40a11b0 0x7fa7f40a3670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa80c100c40 tx=0x7fa7fc009260 comp rx=0 tx=0).stop 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 msgr2=0x7fa80c1a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1a07c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa8040079b0 tx=0x7fa8040079e0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 shutdown_connections 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa80c102ab0 0x7fa80c1a07c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7f40a11b0 0x7fa7f40a3670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa80c100f20 0x7fa80c199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 --2- 172.21.15.33:0/1935079203 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa80c1020f0 0x7fa80c1997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:18.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 >> 172.21.15.33:0/1935079203 conn(0x7fa80c0fc4e0 msgr2=0x7fa80c0731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:18.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 shutdown_connections 2024-05-08T20:04:18.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:18.266+0000 7fa81169f700 1 -- 172.21.15.33:0/1935079203 wait complete. 2024-05-08T20:04:18.273 INFO:tasks.cephadm:Setup complete, yielding 2024-05-08T20:04:18.273 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T20:04:18.283 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:04:18.284 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-08T20:04:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:18.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:18 smithi033 ceph-mon[42490]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:18.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:18 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1637271428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:18.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:18 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1127581356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:18.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:18 smithi082 ceph-mon[46774]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:18.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:18 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1637271428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:18.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:18 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1127581356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:18 smithi132 ceph-mon[47484]: pgmap v245: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:18 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1637271428' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:18 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1127581356' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:19.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 -- 172.21.15.33:0/1274940131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c1043c0 msgr2=0x7f569c1067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:19.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 --2- 172.21.15.33:0/1274940131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c1043c0 0x7f569c1067b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f568c009990 tx=0x7f568c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.530 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 -- 172.21.15.33:0/1274940131 shutdown_connections 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 --2- 172.21.15.33:0/1274940131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c106cf0 0x7f569c109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 --2- 172.21.15.33:0/1274940131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c101a90 0x7f569c103e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 --2- 172.21.15.33:0/1274940131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c1043c0 0x7f569c1067b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 -- 172.21.15.33:0/1274940131 >> 172.21.15.33:0/1274940131 conn(0x7f569c0fb4a0 msgr2=0x7f569c0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.538+0000 7f56a321d700 1 -- 172.21.15.33:0/1274940131 shutdown_connections 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.539+0000 7f56a321d700 1 -- 172.21.15.33:0/1274940131 wait complete. 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.539+0000 7f56a321d700 1 Processor -- start 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.539+0000 7f56a321d700 1 -- start start 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a321d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c101a90 0x7f569c1013a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:19.531 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a321d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043c0 0x7f569c0ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a321d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c106cf0 0x7f569c0fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a321d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c100720 con 0x7f569c101a90 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a321d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c100890 con 0x7f569c1043c0 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a321d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f569c1a1050 con 0x7f569c106cf0 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c101a90 0x7f569c1013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c101a90 0x7f569c1013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59940/0 (socket says 172.21.15.33:59940) 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 -- 172.21.15.33:0/2473846030 learned_addr learned my addr 172.21.15.33:0/2473846030 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a17ba700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c106cf0 0x7f569c0fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f569bfff700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043c0 0x7f569c0ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 -- 172.21.15.33:0/2473846030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c106cf0 msgr2=0x7f569c0fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c106cf0 0x7f569c0fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 -- 172.21.15.33:0/2473846030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043c0 msgr2=0x7f569c0ffa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043c0 0x7f569c0ffa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.532 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 -- 172.21.15.33:0/2473846030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0095f0 con 0x7f569c101a90 2024-05-08T20:04:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a17ba700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c106cf0 0x7f569c0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a0fb9700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c101a90 0x7f569c1013a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f568400d980 tx=0x7f568400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f5699ffb700 1 -- 172.21.15.33:0/2473846030 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684004220 con 0x7f569c101a90 2024-05-08T20:04:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f569c1a12e0 con 0x7f569c101a90 2024-05-08T20:04:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f5699ffb700 1 -- 172.21.15.33:0/2473846030 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5684007640 con 0x7f569c101a90 2024-05-08T20:04:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.540+0000 7f5699ffb700 1 -- 172.21.15.33:0/2473846030 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684005720 con 0x7f569c101a90 2024-05-08T20:04:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.541+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f569c1a1830 con 0x7f569c101a90 2024-05-08T20:04:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.542+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569c0fd020 con 0x7f569c101a90 2024-05-08T20:04:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.543+0000 7f5699ffb700 1 -- 172.21.15.33:0/2473846030 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5684004750 con 0x7f569c101a90 2024-05-08T20:04:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.544+0000 7f5699ffb700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f56880a11b0 0x7f56880a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.544+0000 7f569bfff700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f56880a11b0 0x7f56880a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.544+0000 7f5699ffb700 1 -- 172.21.15.33:0/2473846030 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f56840cc850 con 0x7f569c101a90 2024-05-08T20:04:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.544+0000 7f569bfff700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f56880a11b0 0x7f56880a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b2e0 tx=0x7f568c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:19.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.549+0000 7f5699ffb700 1 -- 172.21.15.33:0/2473846030 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5684095f30 con 0x7f569c101a90 2024-05-08T20:04:19.768 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.779+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f569c0613e0 con 0x7f56880a11b0 2024-05-08T20:04:19.769 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.780+0000 7f5699ffb700 1 -- 172.21.15.33:0/2473846030 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f569c0613e0 con 0x7f56880a11b0 2024-05-08T20:04:19.770 INFO:teuthology.orchestra.run.smithi033.stdout:Backend: cephadm 2024-05-08T20:04:19.770 INFO:teuthology.orchestra.run.smithi033.stdout:Available: Yes 2024-05-08T20:04:19.770 INFO:teuthology.orchestra.run.smithi033.stdout:Paused: No 2024-05-08T20:04:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.782+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f56880a11b0 msgr2=0x7f56880a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f56880a11b0 0x7f56880a3670 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f568c00b2e0 tx=0x7f568c005fd0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c101a90 msgr2=0x7f569c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c101a90 0x7f569c1013a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f568400d980 tx=0x7f568400dc90 comp rx=0 tx=0).stop 2024-05-08T20:04:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 shutdown_connections 2024-05-08T20:04:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f56880a11b0 0x7f56880a3670 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.772 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f569c106cf0 0x7f569c0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f569c101a90 0x7f569c1013a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 --2- 172.21.15.33:0/2473846030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f569c1043c0 0x7f569c0ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:19.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 >> 172.21.15.33:0/2473846030 conn(0x7f569c0fb4a0 msgr2=0x7f569c102550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:19.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 shutdown_connections 2024-05-08T20:04:19.773 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:19.783+0000 7f56a321d700 1 -- 172.21.15.33:0/2473846030 wait complete. 2024-05-08T20:04:20.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-08T20:04:20.388 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:20.529 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:20 smithi033 ceph-mon[42490]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T20:04:20.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:20 smithi082 ceph-mon[46774]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T20:04:20.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:20 smithi132 ceph-mon[47484]: pgmap v246: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-05-08T20:04:21.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 -- 172.21.15.33:0/2386208431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 msgr2=0x7f2918109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:21.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 --2- 172.21.15.33:0/2386208431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f2918109450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f291000b0d0 tx=0x7f291000b3e0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 -- 172.21.15.33:0/2386208431 shutdown_connections 2024-05-08T20:04:21.449 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 --2- 172.21.15.33:0/2386208431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f2918109450 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 --2- 172.21.15.33:0/2386208431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2918101000 0x7f2918101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 --2- 172.21.15.33:0/2386208431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918102200 0x7f2918102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 -- 172.21.15.33:0/2386208431 >> 172.21.15.33:0/2386208431 conn(0x7f29180fc5c0 msgr2=0x7f29180fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 -- 172.21.15.33:0/2386208431 shutdown_connections 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.457+0000 7f291fdb7700 1 -- 172.21.15.33:0/2386208431 wait complete. 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 Processor -- start 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 -- start start 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2918101000 0x7f2918074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918102200 0x7f2918073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f29180738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2918074070 con 0x7f2918102ba0 2024-05-08T20:04:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29180741e0 con 0x7f2918102200 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291fdb7700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29181a10f0 con 0x7f2918101000 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291e354700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f29180738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291e354700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f29180738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59960/0 (socket says 172.21.15.33:59960) 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291e354700 1 -- 172.21.15.33:0/3758261465 learned_addr learned my addr 172.21.15.33:0/3758261465 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291d352700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918102200 0x7f2918073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.458+0000 7f291db53700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2918101000 0x7f2918074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291e354700 1 -- 172.21.15.33:0/3758261465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2918101000 msgr2=0x7f2918074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291e354700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2918101000 0x7f2918074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.451 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291e354700 1 -- 172.21.15.33:0/3758261465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918102200 msgr2=0x7f2918073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:21.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291e354700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918102200 0x7f2918073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291e354700 1 -- 172.21.15.33:0/3758261465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2910009d00 con 0x7f2918102ba0 2024-05-08T20:04:21.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291e354700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f29180738d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2910007c90 tx=0x7f2910009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:21.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f290effd700 1 -- 172.21.15.33:0/3758261465 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291000e040 con 0x7f2918102ba0 2024-05-08T20:04:21.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f290effd700 1 -- 172.21.15.33:0/3758261465 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f291000ceb0 con 0x7f2918102ba0 2024-05-08T20:04:21.452 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29181a1320 con 0x7f2918102ba0 2024-05-08T20:04:21.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f290effd700 1 -- 172.21.15.33:0/3758261465 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910005260 con 0x7f2918102ba0 2024-05-08T20:04:21.453 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.459+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29181a1790 con 0x7f2918102ba0 2024-05-08T20:04:21.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.460+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29181083c0 con 0x7f2918102ba0 2024-05-08T20:04:21.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.461+0000 7f290effd700 1 -- 172.21.15.33:0/3758261465 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f29100053c0 con 0x7f2918102ba0 2024-05-08T20:04:21.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.462+0000 7f290effd700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29040a11b0 0x7f29040a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:21.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.462+0000 7f291db53700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29040a11b0 0x7f29040a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:21.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.462+0000 7f290effd700 1 -- 172.21.15.33:0/3758261465 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f29100ce230 con 0x7f2918102ba0 2024-05-08T20:04:21.454 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.463+0000 7f291db53700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29040a11b0 0x7f29040a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2918102060 tx=0x7f291400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:21.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.466+0000 7f290effd700 1 -- 172.21.15.33:0/3758261465 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2910097aa0 con 0x7f2918102ba0 2024-05-08T20:04:21.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:21 smithi033 ceph-mon[42490]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:21.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:21 smithi082 ceph-mon[46774]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:21.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:21 smithi132 ceph-mon[47484]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:21.678 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.688+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f29180613e0 con 0x7f29040a11b0 2024-05-08T20:04:21.692 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.702+0000 7f290effd700 1 -- 172.21.15.33:0/3758261465 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f29180613e0 con 0x7f29040a11b0 2024-05-08T20:04:21.692 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-08T20:04:21.692 INFO:teuthology.orchestra.run.smithi033.stdout:mds.a smithi033 running (60s) 55s ago 60s 16.7M - 18.2.2-1322-gd21e4f96 af23193ff691 a8981d8fd239 2024-05-08T20:04:21.692 INFO:teuthology.orchestra.run.smithi033.stdout:mds.b smithi082 running (58s) 55s ago 58s 16.5M - 18.2.2-1322-gd21e4f96 af23193ff691 98ca7e8be800 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.c smithi132 running (67s) 55s ago 67s 15.6M - 18.2.2-1322-gd21e4f96 af23193ff691 2ff95c276123 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.d smithi033 running (72s) 55s ago 72s 14.2M - 18.2.2-1322-gd21e4f96 af23193ff691 3ba253e19eae 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.e smithi082 running (71s) 55s ago 70s 14.3M - 18.2.2-1322-gd21e4f96 af23193ff691 8a0628489a2d 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.f smithi132 running (69s) 55s ago 69s 14.3M - 18.2.2-1322-gd21e4f96 af23193ff691 27cc1c23cab7 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.g smithi033 running (62s) 55s ago 61s 15.7M - 18.2.2-1322-gd21e4f96 af23193ff691 5e7dc104afbe 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.h smithi082 running (65s) 55s ago 65s 16.5M - 18.2.2-1322-gd21e4f96 af23193ff691 98d3fe716c11 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.i smithi132 running (64s) 55s ago 63s 16.8M - 18.2.2-1322-gd21e4f96 af23193ff691 533fe21632a1 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.j smithi033 running (74s) 55s ago 74s 15.7M - 18.2.2-1322-gd21e4f96 af23193ff691 b3fca6100c8c 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.k smithi082 running (76s) 55s ago 76s 16.8M - 18.2.2-1322-gd21e4f96 af23193ff691 ffb185bc9fe4 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mds.l smithi132 running (78s) 55s ago 77s 14.4M - 18.2.2-1322-gd21e4f96 af23193ff691 462f643b907b 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi033 *:9283,8765 running (6m) 55s ago 6m 524M - 18.2.2-1322-gd21e4f96 af23193ff691 c8a66ac8654d 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi082 *:8443,8765 running (5m) 55s ago 5m 458M - 18.2.2-1322-gd21e4f96 af23193ff691 692e54ac9c19 2024-05-08T20:04:21.693 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.z smithi132 *:8443,8765 running (5m) 55s ago 5m 460M - 18.2.2-1322-gd21e4f96 af23193ff691 0921424ae2e4 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (6m) 55s ago 6m 77.2M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 32d7ae85931a 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi082 running (5m) 55s ago 5m 56.0M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 529a6c41735f 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi132 running (5m) 55s ago 5m 55.9M 2048M 18.2.2-1322-gd21e4f96 af23193ff691 3b65f8f780b5 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 55s ago 4m 126M 4279M 18.2.2-1322-gd21e4f96 af23193ff691 5c1992e06465 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi082 running (4m) 55s ago 4m 60.9M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 3eb62d537ed8 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi132 running (4m) 55s ago 4m 58.3M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 300e2094e1e7 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (3m) 55s ago 3m 120M 4279M 18.2.2-1322-gd21e4f96 af23193ff691 f919eb471815 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi082 running (3m) 55s ago 3m 116M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 42a99a4eab93 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi132 running (3m) 55s ago 3m 50.4M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 04d83ee28a22 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi033 running (3m) 55s ago 3m 48.6M 4279M 18.2.2-1322-gd21e4f96 af23193ff691 01fa17aef1a1 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi082 running (2m) 55s ago 2m 49.5M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 2348f311411b 2024-05-08T20:04:21.694 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 smithi132 running (2m) 55s ago 2m 120M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 c6baffb2f5b5 2024-05-08T20:04:21.695 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 smithi033 running (2m) 55s ago 2m 47.1M 4279M 18.2.2-1322-gd21e4f96 af23193ff691 aad147a1ab0f 2024-05-08T20:04:21.695 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 smithi082 running (110s) 55s ago 109s 117M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 128143f9b82f 2024-05-08T20:04:21.695 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 smithi132 running (92s) 55s ago 92s 41.9M 4278M 18.2.2-1322-gd21e4f96 af23193ff691 0d1101510676 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29040a11b0 msgr2=0x7f29040a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29040a11b0 0x7f29040a3670 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2918102060 tx=0x7f291400a380 comp rx=0 tx=0).stop 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 msgr2=0x7f29180738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f29180738d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2910007c90 tx=0x7f2910009380 comp rx=0 tx=0).stop 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 shutdown_connections 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2918102ba0 0x7f29180738d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f29040a11b0 0x7f29040a3670 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2918101000 0x7f2918074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 --2- 172.21.15.33:0/3758261465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2918102200 0x7f2918073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.704+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 >> 172.21.15.33:0/3758261465 conn(0x7f29180fc5c0 msgr2=0x7f2918105500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.705+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 shutdown_connections 2024-05-08T20:04:21.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:21.705+0000 7f291fdb7700 1 -- 172.21.15.33:0/3758261465 wait complete. 2024-05-08T20:04:22.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-08T20:04:22.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:22 smithi033 ceph-mon[42490]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T20:04:22.331 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:22.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:22 smithi082 ceph-mon[46774]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T20:04:22.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:22 smithi132 ceph-mon[47484]: pgmap v247: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-05-08T20:04:23.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 -- 172.21.15.33:0/3792169935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 msgr2=0x7fa79c109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:23.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3792169935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c109430 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa79400b0d0 tx=0x7fa79400b3e0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 -- 172.21.15.33:0/3792169935 shutdown_connections 2024-05-08T20:04:23.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3792169935 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c109430 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3792169935 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 0x7fa79c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3792169935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1021e0 0x7fa79c102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.271 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 -- 172.21.15.33:0/3792169935 >> 172.21.15.33:0/3792169935 conn(0x7fa79c0fc580 msgr2=0x7fa79c0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 -- 172.21.15.33:0/3792169935 shutdown_connections 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.279+0000 7fa7a184d700 1 -- 172.21.15.33:0/3792169935 wait complete. 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.280+0000 7fa7a184d700 1 Processor -- start 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.280+0000 7fa7a184d700 1 -- start start 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.280+0000 7fa7a184d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 0x7fa79c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.280+0000 7fa7a184d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1021e0 0x7fa79c199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.280+0000 7fa7a184d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c1a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.280+0000 7fa7a184d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1a0e00 con 0x7fa79c102b80 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.280+0000 7fa7a184d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1a0f40 con 0x7fa79c100fe0 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa7a184d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1a10d0 con 0x7fa79c1021e0 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c1a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:23.272 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 0x7fa79c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c1a0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49594/0 (socket says 172.21.15.33:49594) 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 -- 172.21.15.33:0/3289025658 learned_addr learned my addr 172.21.15.33:0/3289025658 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 0x7fa79c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:43356/0 (socket says 172.21.15.33:43356) 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa7927fc700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1021e0 0x7fa79c199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 -- 172.21.15.33:0/3289025658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1021e0 msgr2=0x7fa79c199800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1021e0 0x7fa79c199800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 -- 172.21.15.33:0/3289025658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 msgr2=0x7fa79c1992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 0x7fa79c1992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 -- 172.21.15.33:0/3289025658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009d00 con 0x7fa79c102b80 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79affd700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 0x7fa79c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa79b7fe700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c1a0830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa79400d010 tx=0x7fa79400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:23.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa7a084b700 1 -- 172.21.15.33:0/3289025658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400e040 con 0x7fa79c102b80 2024-05-08T20:04:23.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa7a084b700 1 -- 172.21.15.33:0/3289025658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa794003e10 con 0x7fa79c102b80 2024-05-08T20:04:23.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c1a1350 con 0x7fa79c102b80 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.281+0000 7fa7a084b700 1 -- 172.21.15.33:0/3289025658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79401c9d0 con 0x7fa79c102b80 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.282+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c1a17c0 con 0x7fa79c102b80 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.282+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c04ec60 con 0x7fa79c102b80 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.284+0000 7fa7a084b700 1 -- 172.21.15.33:0/3289025658 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa79401cb30 con 0x7fa79c102b80 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.284+0000 7fa7a084b700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7880a1230 0x7fa7880a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.284+0000 7fa79affd700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7880a1230 0x7fa7880a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.284+0000 7fa7a084b700 1 -- 172.21.15.33:0/3289025658 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa7940cd9d0 con 0x7fa79c102b80 2024-05-08T20:04:23.275 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.285+0000 7fa79affd700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7880a1230 0x7fa7880a36f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa79c102040 tx=0x7fa78c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:23.277 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.288+0000 7fa7a084b700 1 -- 172.21.15.33:0/3289025658 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa794097240 con 0x7fa79c102b80 2024-05-08T20:04:23.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.509+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa79c0748f0 con 0x7fa7880a1230 2024-05-08T20:04:23.504 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.515+0000 7fa7a084b700 1 -- 172.21.15.33:0/3289025658 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fa79c0748f0 con 0x7fa7880a1230 2024-05-08T20:04:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-08T20:04:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:mds.all 12/12 57s ago 81s smithi033=a;smithi033=d;smithi033=g;smithi033=j;smithi082=b;smithi082=e;smithi082=h;smithi082=k;smithi132=c;smithi132=f;smithi132=i;smithi132=l;count:12 2024-05-08T20:04:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:mgr 3/3 57s ago 5m smithi033=x;smithi082=y;smithi132=z;count:3 2024-05-08T20:04:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:mon 3/3 57s ago 5m smithi033:172.21.15.33=a;smithi082:172.21.15.82=b;smithi132:172.21.15.132=c;count:3 2024-05-08T20:04:23.505 INFO:teuthology.orchestra.run.smithi033.stdout:osd 12 57s ago - 2024-05-08T20:04:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7880a1230 msgr2=0x7fa7880a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:23.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7880a1230 0x7fa7880a36f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fa79c102040 tx=0x7fa78c009260 comp rx=0 tx=0).stop 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 msgr2=0x7fa79c1a0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c1a0830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa79400d010 tx=0x7fa79400bd50 comp rx=0 tx=0).stop 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 shutdown_connections 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa79c102b80 0x7fa79c1a0830 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79c100fe0 0x7fa79c1992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa7880a1230 0x7fa7880a36f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 --2- 172.21.15.33:0/3289025658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa79c1021e0 0x7fa79c199800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 >> 172.21.15.33:0/3289025658 conn(0x7fa79c0fc580 msgr2=0x7fa79c0731d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 shutdown_connections 2024-05-08T20:04:23.508 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:23.518+0000 7fa7a184d700 1 -- 172.21.15.33:0/3289025658 wait complete. 2024-05-08T20:04:23.533 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:23 smithi033 ceph-mon[42490]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:23.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:23 smithi082 ceph-mon[46774]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:23.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:23 smithi132 ceph-mon[47484]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:23.882 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-08T20:04:24.141 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:24.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:24 smithi033 ceph-mon[42490]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:24.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:24 smithi082 ceph-mon[46774]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:24 smithi132 ceph-mon[47484]: pgmap v248: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 -- 172.21.15.33:0/2337746526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 msgr2=0x7f8f00101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 --2- 172.21.15.33:0/2337746526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00101420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00099c0 tx=0x7f8ef0009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 -- 172.21.15.33:0/2337746526 shutdown_connections 2024-05-08T20:04:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 --2- 172.21.15.33:0/2337746526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f00102ba0 0x7f8f00109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 --2- 172.21.15.33:0/2337746526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00101420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 --2- 172.21.15.33:0/2337746526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f00102200 0x7f8f00102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 -- 172.21.15.33:0/2337746526 >> 172.21.15.33:0/2337746526 conn(0x7f8f000fc5c0 msgr2=0x7f8f000fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 -- 172.21.15.33:0/2337746526 shutdown_connections 2024-05-08T20:04:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.148+0000 7f8f049fd700 1 -- 172.21.15.33:0/2337746526 wait complete. 2024-05-08T20:04:25.140 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 Processor -- start 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 -- start start 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f00102200 0x7f8f00197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f00102ba0 0x7f8f0019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0019eb60 con 0x7f8f00101000 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0019eca0 con 0x7f8f00102200 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8f049fd700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0019ee30 con 0x7f8f00102ba0 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49616/0 (socket says 172.21.15.33:49616) 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 -- 172.21.15.33:0/1025077658 learned_addr learned my addr 172.21.15.33:0/1025077658 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efdd9b700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f00102200 0x7f8f00197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efed9d700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f00102ba0 0x7f8f0019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 -- 172.21.15.33:0/1025077658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f00102ba0 msgr2=0x7f8f0019e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f00102ba0 0x7f8f0019e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 -- 172.21.15.33:0/1025077658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f00102200 msgr2=0x7f8f00197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f00102200 0x7f8f00197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.149+0000 7f8efe59c700 1 -- 172.21.15.33:0/1025077658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00095f0 con 0x7f8f00101000 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.150+0000 7f8efe59c700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00197020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0003910 tx=0x7f8ef0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.150+0000 7f8ef77fe700 1 -- 172.21.15.33:0/1025077658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef001d070 con 0x7f8f00101000 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.150+0000 7f8ef77fe700 1 -- 172.21.15.33:0/1025077658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8ef0005940 con 0x7f8f00101000 2024-05-08T20:04:25.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.150+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0019f0b0 con 0x7f8f00101000 2024-05-08T20:04:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.150+0000 7f8ef77fe700 1 -- 172.21.15.33:0/1025077658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0022d90 con 0x7f8f00101000 2024-05-08T20:04:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.150+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0019f520 con 0x7f8f00101000 2024-05-08T20:04:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.151+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f001084e0 con 0x7f8f00101000 2024-05-08T20:04:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.152+0000 7f8ef77fe700 1 -- 172.21.15.33:0/1025077658 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8ef0022470 con 0x7f8f00101000 2024-05-08T20:04:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.153+0000 7f8ef77fe700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eec0a1230 0x7f8eec0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.153+0000 7f8efdd9b700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eec0a1230 0x7f8eec0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.153+0000 7f8ef77fe700 1 -- 172.21.15.33:0/1025077658 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8ef00cda60 con 0x7f8f00101000 2024-05-08T20:04:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.153+0000 7f8efdd9b700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eec0a1230 0x7f8eec0a36f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8005950 tx=0x7f8ee800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:25.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.156+0000 7f8ef77fe700 1 -- 172.21.15.33:0/1025077658 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8ef005dd60 con 0x7f8f00101000 2024-05-08T20:04:25.367 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.377+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f000613e0 con 0x7f8eec0a1230 2024-05-08T20:04:25.368 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.379+0000 7f8ef77fe700 1 -- 172.21.15.33:0/1025077658 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f8f000613e0 con 0x7f8eec0a1230 2024-05-08T20:04:25.368 INFO:teuthology.orchestra.run.smithi033.stdout:HOST ADDR LABELS STATUS 2024-05-08T20:04:25.369 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 172.21.15.33 2024-05-08T20:04:25.369 INFO:teuthology.orchestra.run.smithi033.stdout:smithi082 172.21.15.82 2024-05-08T20:04:25.369 INFO:teuthology.orchestra.run.smithi033.stdout:smithi132 172.21.15.132 2024-05-08T20:04:25.369 INFO:teuthology.orchestra.run.smithi033.stdout:3 hosts in cluster 2024-05-08T20:04:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.381+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eec0a1230 msgr2=0x7f8eec0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.381+0000 7f8f049fd700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eec0a1230 0x7f8eec0a36f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8ee8005950 tx=0x7f8ee800b410 comp rx=0 tx=0).stop 2024-05-08T20:04:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.381+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 msgr2=0x7f8f00197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.381+0000 7f8f049fd700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00197020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0003910 tx=0x7f8ef0004730 comp rx=0 tx=0).stop 2024-05-08T20:04:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 shutdown_connections 2024-05-08T20:04:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eec0a1230 0x7f8eec0a36f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f00102ba0 0x7f8f0019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f00101000 0x7f8f00197020 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 --2- 172.21.15.33:0/1025077658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f00102200 0x7f8f00197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 >> 172.21.15.33:0/1025077658 conn(0x7f8f000fc5c0 msgr2=0x7f8f00105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 shutdown_connections 2024-05-08T20:04:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:25.382+0000 7f8f049fd700 1 -- 172.21.15.33:0/1025077658 wait complete. 2024-05-08T20:04:25.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:25 smithi033 ceph-mon[42490]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:25.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:25 smithi082 ceph-mon[46774]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:25.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:25 smithi132 ceph-mon[47484]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:25.741 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-08T20:04:26.001 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:26.419 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:26 smithi033 ceph-mon[42490]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:04:26.419 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:26 smithi033 ceph-mon[42490]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:26.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:26 smithi082 ceph-mon[46774]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:04:26.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:26 smithi082 ceph-mon[46774]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:26.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:26 smithi132 ceph-mon[47484]: pgmap v249: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:04:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:26 smithi132 ceph-mon[47484]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 -- 172.21.15.33:0/1990577320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 msgr2=0x7f982c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1990577320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c101420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f98200099c0 tx=0x7f9820009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 -- 172.21.15.33:0/1990577320 shutdown_connections 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1990577320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f982c102ba0 0x7f982c109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1990577320 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c101420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1990577320 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982c102200 0x7f982c102660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 -- 172.21.15.33:0/1990577320 >> 172.21.15.33:0/1990577320 conn(0x7f982c0fc5c0 msgr2=0x7f982c0fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 -- 172.21.15.33:0/1990577320 shutdown_connections 2024-05-08T20:04:26.955 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.965+0000 7f9832fa6700 1 -- 172.21.15.33:0/1990577320 wait complete. 2024-05-08T20:04:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 Processor -- start 2024-05-08T20:04:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 -- start start 2024-05-08T20:04:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:26.956 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982c102200 0x7f982c1975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f982c102ba0 0x7f982c19e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c19ebb0 con 0x7f982c101000 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c06a9c0 con 0x7f982c102200 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.966+0000 7f9832fa6700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982c06ab80 con 0x7f982c102ba0 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9830d42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9830d42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49640/0 (socket says 172.21.15.33:49640) 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9830d42700 1 -- 172.21.15.33:0/1215873177 learned_addr learned my addr 172.21.15.33:0/1215873177 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f982bfff700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982c102200 0x7f982c1975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9831543700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f982c102ba0 0x7f982c19e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f982bfff700 1 -- 172.21.15.33:0/1215873177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f982c102ba0 msgr2=0x7f982c19e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f982bfff700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f982c102ba0 0x7f982c19e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f982bfff700 1 -- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 msgr2=0x7f982c197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f982bfff700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:26.957 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f982bfff700 1 -- 172.21.15.33:0/1215873177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200095f0 con 0x7f982c102200 2024-05-08T20:04:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9830d42700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f982bfff700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982c102200 0x7f982c1975b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f981800e9f0 tx=0x7f981800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9829ffb700 1 -- 172.21.15.33:0/1215873177 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981800c9c0 con 0x7f982c102200 2024-05-08T20:04:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9829ffb700 1 -- 172.21.15.33:0/1215873177 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9818010430 con 0x7f982c102200 2024-05-08T20:04:26.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.967+0000 7f9829ffb700 1 -- 172.21.15.33:0/1215873177 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818018680 con 0x7f982c102200 2024-05-08T20:04:26.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.968+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982c06ae60 con 0x7f982c102200 2024-05-08T20:04:26.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.968+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982c06b310 con 0x7f982c102200 2024-05-08T20:04:26.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.969+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982c108480 con 0x7f982c102200 2024-05-08T20:04:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.971+0000 7f9829ffb700 1 -- 172.21.15.33:0/1215873177 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9818010910 con 0x7f982c102200 2024-05-08T20:04:26.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.972+0000 7f9829ffb700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f981c0a1230 0x7f981c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:26.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.972+0000 7f9830d42700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f981c0a1230 0x7f981c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:26.961 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.972+0000 7f9829ffb700 1 -- 172.21.15.33:0/1215873177 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9818014070 con 0x7f982c102200 2024-05-08T20:04:26.962 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.973+0000 7f9830d42700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f981c0a1230 0x7f981c0a36f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98200037f0 tx=0x7f9820005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:26.964 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:26.975+0000 7f9829ffb700 1 -- 172.21.15.33:0/1215873177 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9818096a00 con 0x7f982c102200 2024-05-08T20:04:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.212+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 --> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f982c02ce10 con 0x7f981c0a1230 2024-05-08T20:04:27.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.214+0000 7f9829ffb700 1 -- 172.21.15.33:0/1215873177 <== mgr.14152 v2:172.21.15.33:6800/3089330166 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f982c02ce10 con 0x7f981c0a1230 2024-05-08T20:04:27.203 INFO:teuthology.orchestra.run.smithi033.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-08T20:04:27.203 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-05-08T20:04:27.203 INFO:teuthology.orchestra.run.smithi033.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 110s ago Has a FileSystem, LVM detected 2024-05-08T20:04:27.203 INFO:teuthology.orchestra.run.smithi033.stdout:smithi132 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6232000B400BGN 372G No 93s ago Has a FileSystem, LVM detected 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f981c0a1230 msgr2=0x7f981c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f981c0a1230 0x7f981c0a36f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98200037f0 tx=0x7f9820005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982c102200 msgr2=0x7f982c1975b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982c102200 0x7f982c1975b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f981800e9f0 tx=0x7f981800ed00 comp rx=0 tx=0).stop 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 shutdown_connections 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f981c0a1230 0x7f981c0a36f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f982c102ba0 0x7f982c19e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f982c101000 0x7f982c197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:27.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 --2- 172.21.15.33:0/1215873177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f982c102200 0x7f982c1975b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.216+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 >> 172.21.15.33:0/1215873177 conn(0x7f982c0fc5c0 msgr2=0x7f982c1055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.217+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 shutdown_connections 2024-05-08T20:04:27.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:27.217+0000 7f9832fa6700 1 -- 172.21.15.33:0/1215873177 wait complete. 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-05-08T20:04:27.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:27 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-05-08T20:04:27.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:27.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T20:04:27.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-05-08T20:04:27.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:27 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]: dispatch 2024-05-08T20:04:27.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:27 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]: dispatch 2024-05-08T20:04:27.702 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T20:04:27.711 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:04:27.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-08T20:04:28.005 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:28.443 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: pgmap v250: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-05-08T20:04:28.444 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T20:04:28.445 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.445 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.445 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.445 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.445 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.445 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:28 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: pgmap v250: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:28.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:28 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: pgmap v250: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='client.25001 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [8, 11]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [2, 4]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.23", "id": [4, 7]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 8]}]': finished 2024-05-08T20:04:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [3, 9]}]': finished 2024-05-08T20:04:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T20:04:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:28.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:28 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 -- 172.21.15.33:0/1467590737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102200 msgr2=0x7fd3e4102660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/1467590737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102200 0x7fd3e4102660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd3d00099c0 tx=0x7fd3d0009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 -- 172.21.15.33:0/1467590737 shutdown_connections 2024-05-08T20:04:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/1467590737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3e4102ba0 0x7fd3e4109450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/1467590737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e4101000 0x7fd3e4101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.011 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/1467590737 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102200 0x7fd3e4102660 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 -- 172.21.15.33:0/1467590737 >> 172.21.15.33:0/1467590737 conn(0x7fd3e40fc5a0 msgr2=0x7fd3e40fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 -- 172.21.15.33:0/1467590737 shutdown_connections 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.019+0000 7fd3eaf51700 1 -- 172.21.15.33:0/1467590737 wait complete. 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 Processor -- start 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 -- start start 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e4101000 0x7fd3e4074cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3e4102200 0x7fd3e4073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102ba0 0x7fd3e40738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4074070 con 0x7fd3e4102ba0 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40741e0 con 0x7fd3e4101000 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3eaf51700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41a10c0 con 0x7fd3e4102200 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3e94ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102ba0 0x7fd3e40738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3e94ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102ba0 0x7fd3e40738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49662/0 (socket says 172.21.15.33:49662) 2024-05-08T20:04:29.012 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.020+0000 7fd3e94ee700 1 -- 172.21.15.33:0/2368366874 learned_addr learned my addr 172.21.15.33:0/2368366874 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e3fff700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3e4102200 0x7fd3e4073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e8ced700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e4101000 0x7fd3e4074cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e94ee700 1 -- 172.21.15.33:0/2368366874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3e4102200 msgr2=0x7fd3e4073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e94ee700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3e4102200 0x7fd3e4073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e94ee700 1 -- 172.21.15.33:0/2368366874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e4101000 msgr2=0x7fd3e4074cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e94ee700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e4101000 0x7fd3e4074cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e94ee700 1 -- 172.21.15.33:0/2368366874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00095f0 con 0x7fd3e4102ba0 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e8ced700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e4101000 0x7fd3e4074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e94ee700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102ba0 0x7fd3e40738d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00b970 tx=0x7fd3dc00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e1ffb700 1 -- 172.21.15.33:0/2368366874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc00c930 con 0x7fd3e4102ba0 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e1ffb700 1 -- 172.21.15.33:0/2368366874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd3dc014440 con 0x7fd3e4102ba0 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e41a1350 con 0x7fd3e4102ba0 2024-05-08T20:04:29.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.021+0000 7fd3e1ffb700 1 -- 172.21.15.33:0/2368366874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3dc0075d0 con 0x7fd3e4102ba0 2024-05-08T20:04:29.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.022+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e41a1800 con 0x7fd3e4102ba0 2024-05-08T20:04:29.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.023+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e4108430 con 0x7fd3e4102ba0 2024-05-08T20:04:29.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.023+0000 7fd3e1ffb700 1 -- 172.21.15.33:0/2368366874 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fd3dc0145b0 con 0x7fd3e4102ba0 2024-05-08T20:04:29.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.024+0000 7fd3e1ffb700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd3d40a11b0 0x7fd3d40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:29.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.024+0000 7fd3e8ced700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd3d40a11b0 0x7fd3d40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:29.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.024+0000 7fd3e1ffb700 1 -- 172.21.15.33:0/2368366874 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fd3dc006e40 con 0x7fd3e4102ba0 2024-05-08T20:04:29.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.025+0000 7fd3e8ced700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd3d40a11b0 0x7fd3d40a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4102060 tx=0x7fd3d8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:29.018 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.029+0000 7fd3e1ffb700 1 -- 172.21.15.33:0/2368366874 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fd3dc095790 con 0x7fd3e4102ba0 2024-05-08T20:04:29.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.288+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3e410c9c0 con 0x7fd3e4102ba0 2024-05-08T20:04:29.278 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.289+0000 7fd3e1ffb700 1 -- 172.21.15.33:0/2368366874 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2885 (secure 0 0 0) 0x7fd3dc019b60 con 0x7fd3e4102ba0 2024-05-08T20:04:29.278 INFO:teuthology.orchestra.run.smithi033.stdout:e23 2024-05-08T20:04:29.278 INFO:teuthology.orchestra.run.smithi033.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T20:04:29.278 INFO:teuthology.orchestra.run.smithi033.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:legacy client fscid: 1 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:Filesystem 'cephfs' (1) 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:fs_name cephfs 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 23 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-05-08T20:03:29.655534+0000 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-05-08T20:03:35.012471+0000 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:tableserver 0 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:root 0 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:session_timeout 300 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:session_autoclose 300 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:max_file_size 1099511627776 2024-05-08T20:04:29.279 INFO:teuthology.orchestra.run.smithi033.stdout:max_xattr_size 65536 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:required_client_features {} 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure 0 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:last_failure_osd_epoch 0 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:max_mds 3 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:in 0,1,2 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:up {0=24566,1=24535,2=24508} 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:failed 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:damaged 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:stopped 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:data_pools [3] 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:metadata_pool 2 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:inline_data disabled 2024-05-08T20:04:29.280 INFO:teuthology.orchestra.run.smithi033.stdout:balancer 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:bal_rank_mask -1 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:standby_count_wanted 0 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b{0:24566} state up:active seq 3 addr [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.h{0:24527} state up:standby-replay seq 1 addr [v2:172.21.15.82:6836/84840757,v1:172.21.15.82:6837/84840757] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.g{1:24535} state up:active seq 5 addr [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.i{1:24523} state up:standby-replay seq 1 addr [v2:172.21.15.132:6838/3830178924,v1:172.21.15.132:6839/3830178924] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c{2:24508} state up:active seq 6 addr [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.e{2:24503} state up:standby-replay seq 1 addr [v2:172.21.15.82:6834/120986217,v1:172.21.15.82:6835/120986217] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:Standby daemons: 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.33:6834/737673799,v1:172.21.15.33:6835/737673799] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a{-1:14619} state up:standby seq 1 addr [v2:172.21.15.33:6840/1914520158,v1:172.21.15.33:6841/1914520158] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.281 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.l{-1:24463} state up:standby seq 1 addr [v2:172.21.15.132:6832/2425560119,v1:172.21.15.132:6833/2425560119] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.282 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.k{-1:24467} state up:standby seq 1 addr [v2:172.21.15.82:6832/3776468536,v1:172.21.15.82:6833/3776468536] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.282 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d{-1:24487} state up:standby seq 1 addr [v2:172.21.15.33:6836/2880897493,v1:172.21.15.33:6837/2880897493] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.282 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.f{-1:24499} state up:standby seq 1 addr [v2:172.21.15.132:6834/3702888214,v1:172.21.15.132:6835/3702888214] compat {c=[1],r=[1],i=[7ff]}] 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd3d40a11b0 msgr2=0x7fd3d40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd3d40a11b0 0x7fd3d40a3670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd3e4102060 tx=0x7fd3d8005f90 comp rx=0 tx=0).stop 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102ba0 msgr2=0x7fd3e40738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102ba0 0x7fd3e40738d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc00b970 tx=0x7fd3dc00bc80 comp rx=0 tx=0).stop 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 shutdown_connections 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3e4102ba0 0x7fd3e40738d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3e4101000 0x7fd3e4074cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fd3d40a11b0 0x7fd3d40a3670 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 --2- 172.21.15.33:0/2368366874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3e4102200 0x7fd3e4073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 >> 172.21.15.33:0/2368366874 conn(0x7fd3e40fc5a0 msgr2=0x7fd3e4105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 shutdown_connections 2024-05-08T20:04:29.283 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:29.291+0000 7fd3eaf51700 1 -- 172.21.15.33:0/2368366874 wait complete. 2024-05-08T20:04:29.284 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-05-08T20:04:29.548 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:29 smithi033 ceph-mon[42490]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T20:04:29.548 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:29.548 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:29.548 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:29 smithi033 ceph-mon[42490]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:29.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:29 smithi082 ceph-mon[46774]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T20:04:29.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:29.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:29.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:29 smithi082 ceph-mon[46774]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:29 smithi132 ceph-mon[47484]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T20:04:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:29.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:29 smithi132 ceph-mon[47484]: from='mgr.14152 172.21.15.33:0/3177159581' entity='mgr.x' 2024-05-08T20:04:29.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-08T20:04:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:30.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:30 smithi033 ceph-mon[42490]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2024-05-08T20:04:30.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:30 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2368366874' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T20:04:30.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:30 smithi082 ceph-mon[46774]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2024-05-08T20:04:30.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:30 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2368366874' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T20:04:30.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:30 smithi132 ceph-mon[47484]: pgmap v253: 97 pgs: 1 peering, 96 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 13 B/s, 1 objects/s recovering 2024-05-08T20:04:30.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:30 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2368366874' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T20:04:30.918 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 -- 172.21.15.33:0/993314942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9174101a20 msgr2=0x7f9174108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 --2- 172.21.15.33:0/993314942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9174101a20 0x7f9174108340 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f916c00b0a0 tx=0x7f916c00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 -- 172.21.15.33:0/993314942 shutdown_connections 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 --2- 172.21.15.33:0/993314942 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9174101a20 0x7f9174108340 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 --2- 172.21.15.33:0/993314942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f91740fff00 0x7f9174100320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 --2- 172.21.15.33:0/993314942 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9174101060 0x7f91741014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 -- 172.21.15.33:0/993314942 >> 172.21.15.33:0/993314942 conn(0x7f91740fb4a0 msgr2=0x7f91740fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 -- 172.21.15.33:0/993314942 shutdown_connections 2024-05-08T20:04:30.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.929+0000 7f917a6d5700 1 -- 172.21.15.33:0/993314942 wait complete. 2024-05-08T20:04:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 Processor -- start 2024-05-08T20:04:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 -- start start 2024-05-08T20:04:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91740fff00 0x7f9174195f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9174101060 0x7f9174196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9174101a20 0x7f917419d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:30.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917419da80 con 0x7f91740fff00 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917419dbc0 con 0x7f9174101060 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.930+0000 7f917a6d5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917419dd50 con 0x7f9174101a20 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91740fff00 0x7f9174195f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91740fff00 0x7f9174195f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49672/0 (socket says 172.21.15.33:49672) 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 -- 172.21.15.33:0/3176970556 learned_addr learned my addr 172.21.15.33:0/3176970556 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f91737fe700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9174101060 0x7f9174196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9178c72700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9174101a20 0x7f917419d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 -- 172.21.15.33:0/3176970556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9174101a20 msgr2=0x7f917419d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9174101a20 0x7f917419d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 -- 172.21.15.33:0/3176970556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9174101060 msgr2=0x7f9174196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9174101060 0x7f9174196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 -- 172.21.15.33:0/3176970556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009d00 con 0x7f91740fff00 2024-05-08T20:04:30.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f9173fff700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91740fff00 0x7f9174195f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f91640099a0 tx=0x7f9164009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f91717fa700 1 -- 172.21.15.33:0/3176970556 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164012070 con 0x7f91740fff00 2024-05-08T20:04:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f91717fa700 1 -- 172.21.15.33:0/3176970556 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f916400d8f0 con 0x7f91740fff00 2024-05-08T20:04:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91740689b0 con 0x7f91740fff00 2024-05-08T20:04:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f91717fa700 1 -- 172.21.15.33:0/3176970556 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916400c990 con 0x7f91740fff00 2024-05-08T20:04:30.923 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.931+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9174068f00 con 0x7f91740fff00 2024-05-08T20:04:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.932+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917404ec60 con 0x7f91740fff00 2024-05-08T20:04:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.934+0000 7f91717fa700 1 -- 172.21.15.33:0/3176970556 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f9164007c20 con 0x7f91740fff00 2024-05-08T20:04:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.934+0000 7f91717fa700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f915c0a1230 0x7f915c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.934+0000 7f91737fe700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f915c0a1230 0x7f915c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.934+0000 7f91717fa700 1 -- 172.21.15.33:0/3176970556 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f91640cda30 con 0x7f91740fff00 2024-05-08T20:04:30.924 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.935+0000 7f91737fe700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f915c0a1230 0x7f915c0a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f916800ac50 tx=0x7f916800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:30.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:30.938+0000 7f91717fa700 1 -- 172.21.15.33:0/3176970556 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9164097040 con 0x7f91740fff00 2024-05-08T20:04:31.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.152+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f9174106c90 con 0x7f91740fff00 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.152+0000 7f91717fa700 1 -- 172.21.15.33:0/3176970556 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) v1 ==== 56+0+5308 (secure 0 0 0) 0x7f916409a660 con 0x7f91740fff00 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 82 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:created 2024-05-08T19:57:39.572383+0000 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:modified 2024-05-08T20:04:28.270191+0000 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:crush_version 26 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:full_ratio 0.95 2024-05-08T20:04:31.142 INFO:teuthology.orchestra.run.smithi033.stdout:backfillfull_ratio 0.9 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:nearfull_ratio 0.85 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:require_min_compat_client luminous 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:min_compat_client luminous 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:require_osd_release reef 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:stretch_mode_enabled false 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 79 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:max_osd 12 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6802/2726923319,v1:172.21.15.33:6803/2726923319] [v2:172.21.15.33:6804/2726923319,v1:172.21.15.33:6805/2726923319] exists,up 475543e7-9098-4d93-82e8-529f6ae4e779 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 up in weight 1 up_from 13 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6800/2641494895,v1:172.21.15.82:6801/2641494895] [v2:172.21.15.82:6802/2641494895,v1:172.21.15.82:6803/2641494895] exists,up 47267f72-b070-4a71-a9fd-8737a8e4ed6e 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 up in weight 1 up_from 18 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6800/1122791849,v1:172.21.15.132:6801/1122791849] [v2:172.21.15.132:6802/1122791849,v1:172.21.15.132:6803/1122791849] exists,up d4a04dc0-c34f-488e-b0e9-8826eb6a555c 2024-05-08T20:04:31.143 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 up in weight 1 up_from 24 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6810/3020184499,v1:172.21.15.33:6811/3020184499] [v2:172.21.15.33:6812/3020184499,v1:172.21.15.33:6813/3020184499] exists,up f6988c00-180e-459e-aabb-96b918684e46 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 up in weight 1 up_from 31 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6808/2673475836,v1:172.21.15.82:6809/2673475836] [v2:172.21.15.82:6810/2673475836,v1:172.21.15.82:6811/2673475836] exists,up 9922f2c4-b26d-42b1-94af-f8875d7b499b 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 up in weight 1 up_from 36 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6808/2308536934,v1:172.21.15.132:6809/2308536934] [v2:172.21.15.132:6810/2308536934,v1:172.21.15.132:6811/2308536934] exists,up f86a281b-beaa-426a-b519-f1585214fb67 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 up in weight 1 up_from 43 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6818/469932513,v1:172.21.15.33:6819/469932513] [v2:172.21.15.33:6820/469932513,v1:172.21.15.33:6821/469932513] exists,up 87f5ea9e-6467-4b4e-8aa4-8769b53650ac 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 up in weight 1 up_from 48 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6816/3754120069,v1:172.21.15.82:6817/3754120069] [v2:172.21.15.82:6818/3754120069,v1:172.21.15.82:6819/3754120069] exists,up 6700de25-138d-4cb4-bd2c-6935b873816a 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.8 up in weight 1 up_from 55 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6816/909790708,v1:172.21.15.132:6817/909790708] [v2:172.21.15.132:6818/909790708,v1:172.21.15.132:6819/909790708] exists,up af5ad8e0-189d-4f89-a802-a3cd2efd0428 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.33:6826/185298138,v1:172.21.15.33:6827/185298138] [v2:172.21.15.33:6828/185298138,v1:172.21.15.33:6829/185298138] exists,up b3c11e7d-ffde-4056-81df-8f6816c9c085 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.10 up in weight 1 up_from 67 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6824/3525934345,v1:172.21.15.82:6825/3525934345] [v2:172.21.15.82:6826/3525934345,v1:172.21.15.82:6827/3525934345] exists,up 39c38ffb-6a12-406e-a8ec-c0e2b3b51204 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:osd.11 up in weight 1 up_from 75 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.132:6824/77968886,v1:172.21.15.132:6825/77968886] [v2:172.21.15.132:6826/77968886,v1:172.21.15.132:6827/77968886] exists,up fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.a [2,11] 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.b [2,1] 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.f [8,11] 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 2.10 [2,4] 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.0 [5,9] 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.11 [4,8] 2024-05-08T20:04:31.144 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.14 [4,6] 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.23 [4,7] 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.28 [5,8] 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:pg_upmap_items 3.38 [3,9] 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/1749884602 expires 2024-05-09T19:58:27.048499+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/2502819545 expires 2024-05-09T19:58:27.048499+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/2605806424 expires 2024-05-09T19:58:27.048499+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/2102553152 expires 2024-05-09T19:58:27.048499+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6801/113789498 expires 2024-05-09T19:58:04.583134+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/3748938822 expires 2024-05-09T19:58:04.583134+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/113789498 expires 2024-05-09T19:58:04.583134+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/948350534 expires 2024-05-09T19:58:04.583134+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:0/3865397420 expires 2024-05-09T19:58:04.583134+0000 2024-05-08T20:04:31.145 INFO:teuthology.orchestra.run.smithi033.stdout:blocklist 172.21.15.33:6800/2102553152 expires 2024-05-09T19:58:27.048499+0000 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f915c0a1230 msgr2=0x7f915c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f915c0a1230 0x7f915c0a36f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f916800ac50 tx=0x7f916800a380 comp rx=0 tx=0).stop 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91740fff00 msgr2=0x7f9174195f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91740fff00 0x7f9174195f40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f91640099a0 tx=0x7f9164009cb0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 shutdown_connections 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f915c0a1230 0x7f915c0a36f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9174101a20 0x7f917419d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91740fff00 0x7f9174195f40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 --2- 172.21.15.33:0/3176970556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9174101060 0x7f9174196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 >> 172.21.15.33:0/3176970556 conn(0x7f91740fb4a0 msgr2=0x7f91741043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:31.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 shutdown_connections 2024-05-08T20:04:31.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.155+0000 7f917a6d5700 1 -- 172.21.15.33:0/3176970556 wait complete. 2024-05-08T20:04:31.439 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:31 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3176970556' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T20:04:31.522 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-08T20:04:31.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:04:31.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:31 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3176970556' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T20:04:31.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:31 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3176970556' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T20:04:31.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/3538896168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c08101970 msgr2=0x7f0c08103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/3538896168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c08101970 0x7f0c08103d60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009990 tx=0x7f0bf8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/3538896168 shutdown_connections 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/3538896168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c08106bd0 0x7f0c08108fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/3538896168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c08101970 0x7f0c08103d60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/3538896168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c081042a0 0x7f0c08106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/3538896168 >> 172.21.15.33:0/3538896168 conn(0x7f0c080fb300 msgr2=0x7f0c080fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/3538896168 shutdown_connections 2024-05-08T20:04:31.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.693+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/3538896168 wait complete. 2024-05-08T20:04:31.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 Processor -- start 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 -- start start 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c08101970 0x7f0c08196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c081042a0 0x7f0c08197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c08106bd0 0x7f0c0819e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0819e970 con 0x7f0c081042a0 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0819eab0 con 0x7f0c08101970 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0e6f4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0819ec40 con 0x7f0c08106bd0 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0bfffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c081042a0 0x7f0c08197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0bfffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c081042a0 0x7f0c08197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49698/0 (socket says 172.21.15.33:49698) 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0bfffff700 1 -- 172.21.15.33:0/1461051711 learned_addr learned my addr 172.21.15.33:0/1461051711 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c07fff700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c08101970 0x7f0c08196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:31.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.694+0000 7f0c0cc91700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c08106bd0 0x7f0c0819e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0bfffff700 1 -- 172.21.15.33:0/1461051711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c08106bd0 msgr2=0x7f0c0819e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0bfffff700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c08106bd0 0x7f0c0819e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0bfffff700 1 -- 172.21.15.33:0/1461051711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c08101970 msgr2=0x7f0c08196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0bfffff700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c08101970 0x7f0c08196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0bfffff700 1 -- 172.21.15.33:0/1461051711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80095f0 con 0x7f0c081042a0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0bfffff700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c081042a0 0x7f0c08197380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d980 tx=0x7f0bf000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0c05ffb700 1 -- 172.21.15.33:0/1461051711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000bb60 con 0x7f0c081042a0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0c05ffb700 1 -- 172.21.15.33:0/1461051711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bf0007640 con 0x7f0c081042a0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0819ef20 con 0x7f0c081042a0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0c05ffb700 1 -- 172.21.15.33:0/1461051711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0005020 con 0x7f0c081042a0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.695+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0819f3a0 con 0x7f0c081042a0 2024-05-08T20:04:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.696+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c080fce80 con 0x7f0c081042a0 2024-05-08T20:04:31.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.697+0000 7f0c05ffb700 1 -- 172.21.15.33:0/1461051711 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f0bf0004020 con 0x7f0c081042a0 2024-05-08T20:04:31.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.698+0000 7f0c05ffb700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0bf40a11b0 0x7f0bf40a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:31.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.698+0000 7f0c07fff700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0bf40a11b0 0x7f0bf40a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:31.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.698+0000 7f0c05ffb700 1 -- 172.21.15.33:0/1461051711 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f0bf00cce80 con 0x7f0c081042a0 2024-05-08T20:04:31.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.699+0000 7f0c07fff700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0bf40a11b0 0x7f0bf40a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b5c0 tx=0x7f0bf8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:31.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.702+0000 7f0c05ffb700 1 -- 172.21.15.33:0/1461051711 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0bf0096490 con 0x7f0c081042a0 2024-05-08T20:04:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.920+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c0810c7c0 con 0x7f0c081042a0 2024-05-08T20:04:31.912 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.923+0000 7f0c05ffb700 1 -- 172.21.15.33:0/1461051711 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22572 (secure 0 0 0) 0x7f0bf0016090 con 0x7f0c081042a0 2024-05-08T20:04:31.912 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:31.913 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":82,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:04:28.270191+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0bf40a11b0 msgr2=0x7f0bf40a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0bf40a11b0 0x7f0bf40a3670 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b5c0 tx=0x7f0bf8005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c081042a0 msgr2=0x7f0c08197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c081042a0 0x7f0c08197380 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d980 tx=0x7f0bf000dd40 comp rx=0 tx=0).stop 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 shutdown_connections 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f0bf40a11b0 0x7f0bf40a3670 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c08106bd0 0x7f0c0819e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c08101970 0x7f0c08196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 --2- 172.21.15.33:0/1461051711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c081042a0 0x7f0c08197380 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 >> 172.21.15.33:0/1461051711 conn(0x7f0c080fb300 msgr2=0x7f0c08102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 shutdown_connections 2024-05-08T20:04:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:31.925+0000 7f0c0e6f4700 1 -- 172.21.15.33:0/1461051711 wait complete. 2024-05-08T20:04:31.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:03:27.926660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:03:28.993433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:04:31.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:04:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 -- 172.21.15.33:0/2396566910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488106c80 msgr2=0x7fc4881090b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 --2- 172.21.15.33:0/2396566910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488106c80 0x7fc4881090b0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc48000b0a0 tx=0x7fc48000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 -- 172.21.15.33:0/2396566910 shutdown_connections 2024-05-08T20:04:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 --2- 172.21.15.33:0/2396566910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488106c80 0x7fc4881090b0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 --2- 172.21.15.33:0/2396566910 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc488101a20 0x7fc488103e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.073 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 --2- 172.21.15.33:0/2396566910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc488104350 0x7fc488106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 -- 172.21.15.33:0/2396566910 >> 172.21.15.33:0/2396566910 conn(0x7fc4880fb3f0 msgr2=0x7fc4880fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 -- 172.21.15.33:0/2396566910 shutdown_connections 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.081+0000 7fc48f681700 1 -- 172.21.15.33:0/2396566910 wait complete. 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 Processor -- start 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 -- start start 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc488101a20 0x7fc4881012f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488104350 0x7fc4880ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc488106c80 0x7fc4880fff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc488100610 con 0x7fc488104350 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc488100780 con 0x7fc488101a20 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48f681700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4881a1130 con 0x7fc488106c80 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48cc1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488104350 0x7fc4880ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.074 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48cc1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488104350 0x7fc4880ff9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49718/0 (socket says 172.21.15.33:49718) 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48cc1c700 1 -- 172.21.15.33:0/1463068916 learned_addr learned my addr 172.21.15.33:0/1463068916 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48d41d700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc488101a20 0x7fc4881012f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.082+0000 7fc48dc1e700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc488106c80 0x7fc4880fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48cc1c700 1 -- 172.21.15.33:0/1463068916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc488106c80 msgr2=0x7fc4880fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48cc1c700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc488106c80 0x7fc4880fff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48cc1c700 1 -- 172.21.15.33:0/1463068916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc488101a20 msgr2=0x7fc4881012f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48cc1c700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc488101a20 0x7fc4881012f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48cc1c700 1 -- 172.21.15.33:0/1463068916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480009d00 con 0x7fc488104350 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48d41d700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc488101a20 0x7fc4881012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48dc1e700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc488106c80 0x7fc4880fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48cc1c700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488104350 0x7fc4880ff9d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc47800d980 tx=0x7fc47800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc47e7fc700 1 -- 172.21.15.33:0/1463068916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800bb60 con 0x7fc488104350 2024-05-08T20:04:32.075 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4881a1390 con 0x7fc488104350 2024-05-08T20:04:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc47e7fc700 1 -- 172.21.15.33:0/1463068916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc478007640 con 0x7fc488104350 2024-05-08T20:04:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc47e7fc700 1 -- 172.21.15.33:0/1463068916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc478005020 con 0x7fc488104350 2024-05-08T20:04:32.076 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.083+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4881a18a0 con 0x7fc488104350 2024-05-08T20:04:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.084+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4880fcf70 con 0x7fc488104350 2024-05-08T20:04:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.085+0000 7fc47e7fc700 1 -- 172.21.15.33:0/1463068916 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fc47800bd50 con 0x7fc488104350 2024-05-08T20:04:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.086+0000 7fc47e7fc700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4740a11b0 0x7fc4740a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.086+0000 7fc48d41d700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4740a11b0 0x7fc4740a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.086+0000 7fc47e7fc700 1 -- 172.21.15.33:0/1463068916 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc4780cc9a0 con 0x7fc488104350 2024-05-08T20:04:32.077 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.086+0000 7fc48d41d700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4740a11b0 0x7fc4740a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc484009cb0 tx=0x7fc484009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:32.079 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.090+0000 7fc47e7fc700 1 -- 172.21.15.33:0/1463068916 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc478095f50 con 0x7fc488104350 2024-05-08T20:04:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.306+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4880fc950 con 0x7fc488104350 2024-05-08T20:04:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.307+0000 7fc47e7fc700 1 -- 172.21.15.33:0/1463068916 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc478016020 con 0x7fc488104350 2024-05-08T20:04:32.297 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:04:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4740a11b0 msgr2=0x7fc4740a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4740a11b0 0x7fc4740a3670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc484009cb0 tx=0x7fc484009260 comp rx=0 tx=0).stop 2024-05-08T20:04:32.299 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488104350 msgr2=0x7fc4880ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488104350 0x7fc4880ff9d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc47800d980 tx=0x7fc47800dd40 comp rx=0 tx=0).stop 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 shutdown_connections 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fc4740a11b0 0x7fc4740a3670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc488106c80 0x7fc4880fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc488101a20 0x7fc4881012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.309+0000 7fc48f681700 1 --2- 172.21.15.33:0/1463068916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc488104350 0x7fc4880ff9d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.310+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 >> 172.21.15.33:0/1463068916 conn(0x7fc4880fb3f0 msgr2=0x7fc488102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.310+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 shutdown_connections 2024-05-08T20:04:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.310+0000 7fc48f681700 1 -- 172.21.15.33:0/1463068916 wait complete. 2024-05-08T20:04:32.314 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:04:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4118054365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf640ffe60 msgr2=0x7fbf64100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4118054365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf640ffe60 0x7fbf64100280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009990 tx=0x7fbf54009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4118054365 shutdown_connections 2024-05-08T20:04:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4118054365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf64101970 0x7fbf64108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4118054365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf640ffe60 0x7fbf64100280 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.455 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4118054365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf64100fb0 0x7fbf64101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4118054365 >> 172.21.15.33:0/4118054365 conn(0x7fbf640fb3f0 msgr2=0x7fbf640fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4118054365 shutdown_connections 2024-05-08T20:04:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.465+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4118054365 wait complete. 2024-05-08T20:04:32.456 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.466+0000 7fbf69bdb700 1 Processor -- start 2024-05-08T20:04:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.466+0000 7fbf69bdb700 1 -- start start 2024-05-08T20:04:32.458 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf640ffe60 0x7fbf64068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf64100fb0 0x7fbf6419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf64101970 0x7fbf6419e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6419eaf0 con 0x7fbf64100fb0 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6419ec60 con 0x7fbf640ffe60 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6419ee20 con 0x7fbf64101970 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf64100fb0 0x7fbf6419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf64100fb0 0x7fbf6419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42234/0 (socket says 172.21.15.33:42234) 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 -- 172.21.15.33:0/4184174603 learned_addr learned my addr 172.21.15.33:0/4184174603 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf637fe700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf640ffe60 0x7fbf64068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf63fff700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf64101970 0x7fbf6419e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 -- 172.21.15.33:0/4184174603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf64101970 msgr2=0x7fbf6419e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf64101970 0x7fbf6419e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 -- 172.21.15.33:0/4184174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf640ffe60 msgr2=0x7fbf64068b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.459 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf640ffe60 0x7fbf64068b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 -- 172.21.15.33:0/4184174603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf540095f0 con 0x7fbf64100fb0 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf63fff700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf64101970 0x7fbf6419e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf62ffd700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf64100fb0 0x7fbf6419bd00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800e9a0 tx=0x7fbf5800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf60ff9700 1 -- 172.21.15.33:0/4184174603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58009790 con 0x7fbf64100fb0 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf60ff9700 1 -- 172.21.15.33:0/4184174603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbf5800cbd0 con 0x7fbf64100fb0 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6419f100 con 0x7fbf64100fb0 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf60ff9700 1 -- 172.21.15.33:0/4184174603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58018680 con 0x7fbf64100fb0 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.467+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6419f660 con 0x7fbf64100fb0 2024-05-08T20:04:32.460 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.469+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf641072d0 con 0x7fbf64100fb0 2024-05-08T20:04:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.470+0000 7fbf60ff9700 1 -- 172.21.15.33:0/4184174603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fbf580188a0 con 0x7fbf64100fb0 2024-05-08T20:04:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.470+0000 7fbf60ff9700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbf4c0a1230 0x7fbf4c0a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.470+0000 7fbf60ff9700 1 -- 172.21.15.33:0/4184174603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fbf58014070 con 0x7fbf64100fb0 2024-05-08T20:04:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.471+0000 7fbf637fe700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbf4c0a1230 0x7fbf4c0a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.471+0000 7fbf637fe700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbf4c0a1230 0x7fbf4c0a36f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b2e0 tx=0x7fbf54005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:32.463 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.474+0000 7fbf60ff9700 1 -- 172.21.15.33:0/4184174603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fbf58096790 con 0x7fbf64100fb0 2024-05-08T20:04:32.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:32 smithi033 ceph-mon[42490]: pgmap v254: 97 pgs: 1 peering, 96 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 13 B/s, 1 objects/s recovering 2024-05-08T20:04:32.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:32 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1461051711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:32.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:32 smithi082 ceph-mon[46774]: pgmap v254: 97 pgs: 1 peering, 96 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 13 B/s, 1 objects/s recovering 2024-05-08T20:04:32.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:32 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1461051711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:32 smithi132 ceph-mon[47484]: pgmap v254: 97 pgs: 1 peering, 96 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 13 B/s, 1 objects/s recovering 2024-05-08T20:04:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:32 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1461051711' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:32.679 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.690+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf6410b910 con 0x7fbf64100fb0 2024-05-08T20:04:32.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.690+0000 7fbf60ff9700 1 -- 172.21.15.33:0/4184174603 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf58099db0 con 0x7fbf64100fb0 2024-05-08T20:04:32.680 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-05-08T20:04:32.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbf4c0a1230 msgr2=0x7fbf4c0a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbf4c0a1230 0x7fbf4c0a36f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b2e0 tx=0x7fbf54005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.682 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf64100fb0 msgr2=0x7fbf6419bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf64100fb0 0x7fbf6419bd00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fbf5800e9a0 tx=0x7fbf5800ecb0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 shutdown_connections 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fbf4c0a1230 0x7fbf4c0a36f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf64101970 0x7fbf6419e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbf640ffe60 0x7fbf64068b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 --2- 172.21.15.33:0/4184174603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf64100fb0 0x7fbf6419bd00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 >> 172.21.15.33:0/4184174603 conn(0x7fbf640fb3f0 msgr2=0x7fbf64104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 shutdown_connections 2024-05-08T20:04:32.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.693+0000 7fbf69bdb700 1 -- 172.21.15.33:0/4184174603 wait complete. 2024-05-08T20:04:32.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:04:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 -- 172.21.15.33:0/1004264676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc01019e0 msgr2=0x7f2cc0103dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/1004264676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc01019e0 0x7f2cc0103dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009990 tx=0x7f2cbc009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 -- 172.21.15.33:0/1004264676 shutdown_connections 2024-05-08T20:04:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/1004264676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cc0106c40 0x7f2cc01090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/1004264676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc01019e0 0x7f2cc0103dd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/1004264676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc0104310 0x7f2cc0106700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.839 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 -- 172.21.15.33:0/1004264676 >> 172.21.15.33:0/1004264676 conn(0x7f2cc00fb3f0 msgr2=0x7f2cc00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 -- 172.21.15.33:0/1004264676 shutdown_connections 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.847+0000 7f2cc84f8700 1 -- 172.21.15.33:0/1004264676 wait complete. 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 Processor -- start 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 -- start start 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc01019e0 0x7f2cc0196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cc0104310 0x7f2cc0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc0106c40 0x7f2cc019e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc019eaf0 con 0x7f2cc0106c40 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc019ec30 con 0x7f2cc0104310 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc84f8700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc019edc0 con 0x7f2cc01019e0 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc6a95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc0106c40 0x7f2cc019e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc6a95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc0106c40 0x7f2cc019e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42256/0 (socket says 172.21.15.33:42256) 2024-05-08T20:04:32.840 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.848+0000 7f2cc6a95700 1 -- 172.21.15.33:0/3220358200 learned_addr learned my addr 172.21.15.33:0/3220358200 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6294700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc01019e0 0x7f2cc0196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc5a93700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cc0104310 0x7f2cc0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6a95700 1 -- 172.21.15.33:0/3220358200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc01019e0 msgr2=0x7f2cc0196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6a95700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc01019e0 0x7f2cc0196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6a95700 1 -- 172.21.15.33:0/3220358200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cc0104310 msgr2=0x7f2cc0197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6a95700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cc0104310 0x7f2cc0197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6a95700 1 -- 172.21.15.33:0/3220358200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc0095f0 con 0x7f2cc0106c40 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6294700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc01019e0 0x7f2cc0196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc6a95700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc0106c40 0x7f2cc019e520 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800ef30 tx=0x7f2cb800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cb77fe700 1 -- 172.21.15.33:0/3220358200 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8018070 con 0x7f2cc0106c40 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cb77fe700 1 -- 172.21.15.33:0/3220358200 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2cb800f040 con 0x7f2cc0106c40 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc019f040 con 0x7f2cc0106c40 2024-05-08T20:04:32.841 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cb77fe700 1 -- 172.21.15.33:0/3220358200 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8004020 con 0x7f2cc0106c40 2024-05-08T20:04:32.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.849+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc019f500 con 0x7f2cc0106c40 2024-05-08T20:04:32.842 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.851+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc00fcf70 con 0x7f2cc0106c40 2024-05-08T20:04:32.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.851+0000 7f2cb77fe700 1 -- 172.21.15.33:0/3220358200 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f2cb800caa0 con 0x7f2cc0106c40 2024-05-08T20:04:32.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.852+0000 7f2cb77fe700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2cac0a11b0 0x7f2cac0a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:32.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.852+0000 7f2cc6294700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2cac0a11b0 0x7f2cac0a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:32.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.852+0000 7f2cb77fe700 1 -- 172.21.15.33:0/3220358200 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f2cb80cc750 con 0x7f2cc0106c40 2024-05-08T20:04:32.843 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.852+0000 7f2cc6294700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2cac0a11b0 0x7f2cac0a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00b2e0 tx=0x7f2cbc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:32.846 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:32.856+0000 7f2cb77fe700 1 -- 172.21.15.33:0/3220358200 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f2cb8095d90 con 0x7f2cc0106c40 2024-05-08T20:04:33.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.074+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2cc010c8d0 con 0x7f2cc0106c40 2024-05-08T20:04:33.064 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.075+0000 7f2cb77fe700 1 -- 172.21.15.33:0/3220358200 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2cb80993b0 con 0x7f2cc0106c40 2024-05-08T20:04:33.065 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-05-08T20:04:33.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2cac0a11b0 msgr2=0x7f2cac0a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2cac0a11b0 0x7f2cac0a3670 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00b2e0 tx=0x7f2cbc005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc0106c40 msgr2=0x7f2cc019e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc0106c40 0x7f2cc019e520 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2cb800ef30 tx=0x7f2cb800c450 comp rx=0 tx=0).stop 2024-05-08T20:04:33.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 shutdown_connections 2024-05-08T20:04:33.067 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2cc0106c40 0x7f2cc019e520 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f2cac0a11b0 0x7f2cac0a3670 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cc01019e0 0x7f2cc0196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 --2- 172.21.15.33:0/3220358200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2cc0104310 0x7f2cc0197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.077+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 >> 172.21.15.33:0/3220358200 conn(0x7f2cc00fb3f0 msgr2=0x7f2cc0102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.078+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 shutdown_connections 2024-05-08T20:04:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.078+0000 7f2cc84f8700 1 -- 172.21.15.33:0/3220358200 wait complete. 2024-05-08T20:04:33.081 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:04:33.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 -- 172.21.15.33:0/4209860356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 msgr2=0x7f355c100510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 --2- 172.21.15.33:0/4209860356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c100510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f35500099c0 tx=0x7f3550009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 -- 172.21.15.33:0/4209860356 shutdown_connections 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 --2- 172.21.15.33:0/4209860356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f355c100a50 0x7f355c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 --2- 172.21.15.33:0/4209860356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c0ff730 0x7f355c0ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 --2- 172.21.15.33:0/4209860356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c100510 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 -- 172.21.15.33:0/4209860356 >> 172.21.15.33:0/4209860356 conn(0x7f355c0fb2f0 msgr2=0x7f355c0fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 -- 172.21.15.33:0/4209860356 shutdown_connections 2024-05-08T20:04:33.222 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.232+0000 7f3560a55700 1 -- 172.21.15.33:0/4209860356 wait complete. 2024-05-08T20:04:33.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 Processor -- start 2024-05-08T20:04:33.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 -- start start 2024-05-08T20:04:33.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f355c0ff730 0x7f355c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c100a50 0x7f355c1a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.225 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1a0be0 con 0x7f355c100090 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1a0d20 con 0x7f355c0ff730 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3560a55700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c1a0eb0 con 0x7f355c100a50 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3559d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3559d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c1995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42266/0 (socket says 172.21.15.33:42266) 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f3559d9b700 1 -- 172.21.15.33:0/2914988831 learned_addr learned my addr 172.21.15.33:0/2914988831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f355a59c700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f355c0ff730 0x7f355c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.233+0000 7f355ad9d700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c100a50 0x7f355c1a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3559d9b700 1 -- 172.21.15.33:0/2914988831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c100a50 msgr2=0x7f355c1a0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3559d9b700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c100a50 0x7f355c1a0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.226 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3559d9b700 1 -- 172.21.15.33:0/2914988831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f355c0ff730 msgr2=0x7f355c1990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3559d9b700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f355c0ff730 0x7f355c1990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3559d9b700 1 -- 172.21.15.33:0/2914988831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3554009c40 con 0x7f355c100090 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f355a59c700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f355c0ff730 0x7f355c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3559d9b700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c1995f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f355000c010 tx=0x7f3550009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f354b7fe700 1 -- 172.21.15.33:0/2914988831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355001d070 con 0x7f355c100090 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35500095f0 con 0x7f355c100090 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f354b7fe700 1 -- 172.21.15.33:0/2914988831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f355000fbf0 con 0x7f355c100090 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f354b7fe700 1 -- 172.21.15.33:0/2914988831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3550017650 con 0x7f355c100090 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.234+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c1a1420 con 0x7f355c100090 2024-05-08T20:04:33.227 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.235+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c10a6f0 con 0x7f355c100090 2024-05-08T20:04:33.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.237+0000 7f354b7fe700 1 -- 172.21.15.33:0/2914988831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f3550022470 con 0x7f355c100090 2024-05-08T20:04:33.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.237+0000 7f354b7fe700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f35440a11b0 0x7f35440a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.237+0000 7f355a59c700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f35440a11b0 0x7f35440a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.237+0000 7f354b7fe700 1 -- 172.21.15.33:0/2914988831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f35500ce5f0 con 0x7f355c100090 2024-05-08T20:04:33.228 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.238+0000 7f355a59c700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f35440a11b0 0x7f35440a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f354c005fd0 tx=0x7f354c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:33.232 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.242+0000 7f354b7fe700 1 -- 172.21.15.33:0/2914988831 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3550097c90 con 0x7f355c100090 2024-05-08T20:04:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.508+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f355c067c10 con 0x7f355c100090 2024-05-08T20:04:33.498 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.509+0000 7f354b7fe700 1 -- 172.21.15.33:0/2914988831 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10848 (secure 0 0 0) 0x7f355009b2b0 con 0x7f355c100090 2024-05-08T20:04:33.498 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:33.498 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:03:35.012471+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f35440a11b0 msgr2=0x7f35440a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f35440a11b0 0x7f35440a3670 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f354c005fd0 tx=0x7f354c005f60 comp rx=0 tx=0).stop 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 msgr2=0x7f355c1995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c1995f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f355000c010 tx=0x7f3550009580 comp rx=0 tx=0).stop 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 shutdown_connections 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f35440a11b0 0x7f35440a3670 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355c100a50 0x7f355c1a0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f355c0ff730 0x7f355c1990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 --2- 172.21.15.33:0/2914988831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f355c100090 0x7f355c1995f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 >> 172.21.15.33:0/2914988831 conn(0x7f355c0fb2f0 msgr2=0x7f355c0fca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 shutdown_connections 2024-05-08T20:04:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.511+0000 7f3560a55700 1 -- 172.21.15.33:0/2914988831 wait complete. 2024-05-08T20:04:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-05-08T20:04:33.513 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:33 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1463068916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.513 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:33 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/4184174603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.513 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:33 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3220358200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.515 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:04:33.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:33 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1463068916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:33 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/4184174603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:33 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3220358200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:33 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1463068916' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:33 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/4184174603' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:33 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3220358200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:33.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3153113700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 msgr2=0x7f07f4108fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3153113700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f4108fb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00b0a0 tx=0x7f07ec00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3153113700 shutdown_connections 2024-05-08T20:04:33.652 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3153113700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f4108fb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3153113700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f41018e0 0x7f07f4103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3153113700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f4104210 0x7f07f4106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3153113700 >> 172.21.15.33:0/3153113700 conn(0x7f07f40fb2f0 msgr2=0x7f07f40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:33.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3153113700 shutdown_connections 2024-05-08T20:04:33.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3153113700 wait complete. 2024-05-08T20:04:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 Processor -- start 2024-05-08T20:04:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.663+0000 7f07fbbd7700 1 -- start start 2024-05-08T20:04:33.655 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fbbd7700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f41018e0 0x7f07f4101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fbbd7700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4104210 0x7f07f40ff890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fbbd7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f40ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fbbd7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f4100570 con 0x7f07f4106b40 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fbbd7700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41006e0 con 0x7f07f41018e0 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fbbd7700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f41a0fc0 con 0x7f07f4104210 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f40ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f40ffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42284/0 (socket says 172.21.15.33:42284) 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 -- 172.21.15.33:0/3543391229 learned_addr learned my addr 172.21.15.33:0/3543391229 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07f9973700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f41018e0 0x7f07f4101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07f9172700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4104210 0x7f07f40ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.656 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 -- 172.21.15.33:0/3543391229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4104210 msgr2=0x7f07f40ff890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4104210 0x7f07f40ff890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 -- 172.21.15.33:0/3543391229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f41018e0 msgr2=0x7f07f4101200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f41018e0 0x7f07f4101200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 -- 172.21.15.33:0/3543391229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07ec009d00 con 0x7f07f4106b40 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07fa174700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f40ffdd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00bd60 tx=0x7f07ec00bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.664+0000 7f07eaffd700 1 -- 172.21.15.33:0/3543391229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec00e040 con 0x7f07f4106b40 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.665+0000 7f07eaffd700 1 -- 172.21.15.33:0/3543391229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f07ec004c60 con 0x7f07f4106b40 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.665+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f41a11f0 con 0x7f07f4106b40 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.665+0000 7f07eaffd700 1 -- 172.21.15.33:0/3543391229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0052a0 con 0x7f07f4106b40 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.665+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f41a1610 con 0x7f07f4106b40 2024-05-08T20:04:33.657 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.666+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f40fce70 con 0x7f07f4106b40 2024-05-08T20:04:33.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.667+0000 7f07eaffd700 1 -- 172.21.15.33:0/3543391229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f07ec005510 con 0x7f07f4106b40 2024-05-08T20:04:33.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.667+0000 7f07eaffd700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f07e00a11b0 0x7f07e00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:33.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.668+0000 7f07f9973700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f07e00a11b0 0x7f07e00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:33.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.668+0000 7f07eaffd700 1 -- 172.21.15.33:0/3543391229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f07ec0ce0d0 con 0x7f07f4106b40 2024-05-08T20:04:33.658 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.668+0000 7f07f9973700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f07e00a11b0 0x7f07e00a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07f0007c60 tx=0x7f07f00073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:33.661 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.672+0000 7f07eaffd700 1 -- 172.21.15.33:0/3543391229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f07ec097710 con 0x7f07f4106b40 2024-05-08T20:04:33.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.896+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07f4067c10 con 0x7f07f4106b40 2024-05-08T20:04:33.887 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.897+0000 7f07eaffd700 1 -- 172.21.15.33:0/3543391229 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22572 (secure 0 0 0) 0x7f07ec09ad30 con 0x7f07f4106b40 2024-05-08T20:04:33.887 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:33.887 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":82,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:04:28.270191+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:04:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f07e00a11b0 msgr2=0x7f07e00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f07e00a11b0 0x7f07e00a3670 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f07f0007c60 tx=0x7f07f00073d0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 msgr2=0x7f07f40ffdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f40ffdd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07ec00bd60 tx=0x7f07ec00bd90 comp rx=0 tx=0).stop 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 shutdown_connections 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07f4106b40 0x7f07f40ffdd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f07f41018e0 0x7f07f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f07e00a11b0 0x7f07e00a3670 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 --2- 172.21.15.33:0/3543391229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07f4104210 0x7f07f40ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 >> 172.21.15.33:0/3543391229 conn(0x7f07f40fb2f0 msgr2=0x7f07f41021e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 shutdown_connections 2024-05-08T20:04:33.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:33.900+0000 7f07fbbd7700 1 -- 172.21.15.33:0/3543391229 wait complete. 2024-05-08T20:04:33.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:03:27.926660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:03:28.993433+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:04:33.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:04:34.047 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 -- 172.21.15.33:0/3016188378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 msgr2=0x7f79b0100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 --2- 172.21.15.33:0/3016188378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b0100280 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f79a0009990 tx=0x7f79a0009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 -- 172.21.15.33:0/3016188378 shutdown_connections 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 --2- 172.21.15.33:0/3016188378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b0101970 0x7f79b0108290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 --2- 172.21.15.33:0/3016188378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b0100280 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 --2- 172.21.15.33:0/3016188378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79b0100fb0 0x7f79b0101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 -- 172.21.15.33:0/3016188378 >> 172.21.15.33:0/3016188378 conn(0x7f79b00fb3f0 msgr2=0x7f79b00fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 -- 172.21.15.33:0/3016188378 shutdown_connections 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.055+0000 7f79b6649700 1 -- 172.21.15.33:0/3016188378 wait complete. 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 Processor -- start 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 -- start start 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b01991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b0100fb0 0x7f79b01996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.048 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79b0101970 0x7f79b01a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01a0cd0 con 0x7f79b00ffe60 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01a0e10 con 0x7f79b0100fb0 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b6649700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b01a0fa0 con 0x7f79b0101970 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79affff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b01991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79affff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b01991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42300/0 (socket says 172.21.15.33:42300) 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79affff700 1 -- 172.21.15.33:0/2864913326 learned_addr learned my addr 172.21.15.33:0/2864913326 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79af7fe700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b0100fb0 0x7f79b01996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.056+0000 7f79b4be6700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79b0101970 0x7f79b01a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79affff700 1 -- 172.21.15.33:0/2864913326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79b0101970 msgr2=0x7f79b01a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79affff700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79b0101970 0x7f79b01a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79affff700 1 -- 172.21.15.33:0/2864913326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b0100fb0 msgr2=0x7f79b01996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79affff700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b0100fb0 0x7f79b01996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79affff700 1 -- 172.21.15.33:0/2864913326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00095f0 con 0x7f79b00ffe60 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79af7fe700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b0100fb0 0x7f79b01996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79affff700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b01991a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f79a000e670 tx=0x7f79a0005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79ad7fa700 1 -- 172.21.15.33:0/2864913326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a0004d70 con 0x7f79b00ffe60 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79ad7fa700 1 -- 172.21.15.33:0/2864913326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f79a000b970 con 0x7f79b00ffe60 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b01a1220 con 0x7f79b00ffe60 2024-05-08T20:04:34.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79ad7fa700 1 -- 172.21.15.33:0/2864913326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79a001f750 con 0x7f79b00ffe60 2024-05-08T20:04:34.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.057+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b01a1640 con 0x7f79b00ffe60 2024-05-08T20:04:34.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.058+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b0107280 con 0x7f79b00ffe60 2024-05-08T20:04:34.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.059+0000 7f79ad7fa700 1 -- 172.21.15.33:0/2864913326 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f79a000bae0 con 0x7f79b00ffe60 2024-05-08T20:04:34.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.060+0000 7f79ad7fa700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f79980a11b0 0x7f79980a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.060+0000 7f79ad7fa700 1 -- 172.21.15.33:0/2864913326 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f79a00ce740 con 0x7f79b00ffe60 2024-05-08T20:04:34.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.060+0000 7f79af7fe700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f79980a11b0 0x7f79980a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.060+0000 7f79af7fe700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f79980a11b0 0x7f79980a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79a4010420 tx=0x7f79a40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:34.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.064+0000 7f79ad7fa700 1 -- 172.21.15.33:0/2864913326 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f79a0097ef0 con 0x7f79b00ffe60 2024-05-08T20:04:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.280+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79b0106c60 con 0x7f79b00ffe60 2024-05-08T20:04:34.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.281+0000 7f79ad7fa700 1 -- 172.21.15.33:0/2864913326 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79a009b510 con 0x7f79b00ffe60 2024-05-08T20:04:34.271 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:04:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.283+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f79980a11b0 msgr2=0x7f79980a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.283+0000 7f79b6649700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f79980a11b0 0x7f79980a3670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f79a4010420 tx=0x7f79a40073d0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.283+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 msgr2=0x7f79b01991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.283+0000 7f79b6649700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b01991a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f79a000e670 tx=0x7f79a0005660 comp rx=0 tx=0).stop 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 shutdown_connections 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f79980a11b0 0x7f79980a3670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79b0101970 0x7f79b01a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b00ffe60 0x7f79b01991a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 --2- 172.21.15.33:0/2864913326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79b0100fb0 0x7f79b01996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 >> 172.21.15.33:0/2864913326 conn(0x7f79b00fb3f0 msgr2=0x7f79b01043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 shutdown_connections 2024-05-08T20:04:34.274 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.284+0000 7f79b6649700 1 -- 172.21.15.33:0/2864913326 wait complete. 2024-05-08T20:04:34.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 -- 172.21.15.33:0/1028336010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc102ab0 msgr2=0x7f8ecc1093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 --2- 172.21.15.33:0/1028336010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc102ab0 0x7f8ecc1093d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8ec400b0a0 tx=0x7f8ec400b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 -- 172.21.15.33:0/1028336010 shutdown_connections 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 --2- 172.21.15.33:0/1028336010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc102ab0 0x7f8ecc1093d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 --2- 172.21.15.33:0/1028336010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc100f20 0x7f8ecc101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 --2- 172.21.15.33:0/1028336010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ecc1020f0 0x7f8ecc102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 -- 172.21.15.33:0/1028336010 >> 172.21.15.33:0/1028336010 conn(0x7f8ecc0fc4e0 msgr2=0x7f8ecc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:34.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 -- 172.21.15.33:0/1028336010 shutdown_connections 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.438+0000 7f8ed403e700 1 -- 172.21.15.33:0/1028336010 wait complete. 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 Processor -- start 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 -- start start 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc100f20 0x7f8ecc074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1020f0 0x7f8ecc073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ecc102ab0 0x7f8ecc0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc074070 con 0x7f8ecc100f20 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0741e0 con 0x7f8ecc1020f0 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed403e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc1a1190 con 0x7f8ecc102ab0 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc100f20 0x7f8ecc074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc100f20 0x7f8ecc074d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42316/0 (socket says 172.21.15.33:42316) 2024-05-08T20:04:34.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 -- 172.21.15.33:0/2921344437 learned_addr learned my addr 172.21.15.33:0/2921344437 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed15d9700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1020f0 0x7f8ecc073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed25db700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ecc102ab0 0x7f8ecc0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 -- 172.21.15.33:0/2921344437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ecc102ab0 msgr2=0x7f8ecc0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ecc102ab0 0x7f8ecc0738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 -- 172.21.15.33:0/2921344437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1020f0 msgr2=0x7f8ecc073390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1020f0 0x7f8ecc073390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed1dda700 1 -- 172.21.15.33:0/2921344437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4009d00 con 0x7f8ecc100f20 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.439+0000 7f8ed25db700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ecc102ab0 0x7f8ecc0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.440+0000 7f8ed1dda700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc100f20 0x7f8ecc074d00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800d980 tx=0x7f8ec800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.440+0000 7f8ec2ffd700 1 -- 172.21.15.33:0/2921344437 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8004020 con 0x7f8ecc100f20 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.440+0000 7f8ec2ffd700 1 -- 172.21.15.33:0/2921344437 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8ec80096d0 con 0x7f8ecc100f20 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.440+0000 7f8ec2ffd700 1 -- 172.21.15.33:0/2921344437 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8003b20 con 0x7f8ecc100f20 2024-05-08T20:04:34.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.440+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc1a1420 con 0x7f8ecc100f20 2024-05-08T20:04:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.440+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc1a18e0 con 0x7f8ecc100f20 2024-05-08T20:04:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.441+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc1082e0 con 0x7f8ecc100f20 2024-05-08T20:04:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.442+0000 7f8ec2ffd700 1 -- 172.21.15.33:0/2921344437 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f8ec8009b40 con 0x7f8ecc100f20 2024-05-08T20:04:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.443+0000 7f8ec2ffd700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eb80a11b0 0x7f8eb80a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.443+0000 7f8ed15d9700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eb80a11b0 0x7f8eb80a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.443+0000 7f8ec2ffd700 1 -- 172.21.15.33:0/2921344437 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8ec80cc6d0 con 0x7f8ecc100f20 2024-05-08T20:04:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.443+0000 7f8ed15d9700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eb80a11b0 0x7f8eb80a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009c60 tx=0x7f8ebc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:34.436 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.447+0000 7f8ec2ffd700 1 -- 172.21.15.33:0/2921344437 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8ec8095ce0 con 0x7f8ecc100f20 2024-05-08T20:04:34.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:34 smithi033 ceph-mon[42490]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 16 B/s, 1 objects/s recovering 2024-05-08T20:04:34.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:34 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2914988831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:34.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:34 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3543391229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:34.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:34 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2864913326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:34.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:34 smithi082 ceph-mon[46774]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 16 B/s, 1 objects/s recovering 2024-05-08T20:04:34.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:34 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2914988831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:34.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:34 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3543391229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:34.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:34 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2864913326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:34 smithi132 ceph-mon[47484]: pgmap v255: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 3 op/s; 16 B/s, 1 objects/s recovering 2024-05-08T20:04:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:34 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2914988831' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:34 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3543391229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:34 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2864913326' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:04:34.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.661+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ecc10cb70 con 0x7f8ecc100f20 2024-05-08T20:04:34.650 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.661+0000 7f8ec2ffd700 1 -- 172.21.15.33:0/2921344437 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ec8099300 con 0x7f8ecc100f20 2024-05-08T20:04:34.651 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-05-08T20:04:34.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.663+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eb80a11b0 msgr2=0x7f8eb80a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.663+0000 7f8ed403e700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eb80a11b0 0x7f8eb80a3670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009c60 tx=0x7f8ebc009260 comp rx=0 tx=0).stop 2024-05-08T20:04:34.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc100f20 msgr2=0x7f8ecc074d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.653 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc100f20 0x7f8ecc074d00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800d980 tx=0x7f8ec800dc90 comp rx=0 tx=0).stop 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 shutdown_connections 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f8eb80a11b0 0x7f8eb80a3670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ecc102ab0 0x7f8ecc0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ecc100f20 0x7f8ecc074d00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 --2- 172.21.15.33:0/2921344437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ecc1020f0 0x7f8ecc073390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 >> 172.21.15.33:0/2921344437 conn(0x7f8ecc0fc4e0 msgr2=0x7f8ecc105420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 shutdown_connections 2024-05-08T20:04:34.654 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.664+0000 7f8ed403e700 1 -- 172.21.15.33:0/2921344437 wait complete. 2024-05-08T20:04:34.667 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:04:34.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 -- 172.21.15.33:0/1287192770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102ab0 msgr2=0x7f22a81093d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 --2- 172.21.15.33:0/1287192770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102ab0 0x7f22a81093d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f22a000b0a0 tx=0x7f22a000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 -- 172.21.15.33:0/1287192770 shutdown_connections 2024-05-08T20:04:34.808 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 --2- 172.21.15.33:0/1287192770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a8102ab0 0x7f22a81093d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 --2- 172.21.15.33:0/1287192770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22a8100f20 0x7f22a8101360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 --2- 172.21.15.33:0/1287192770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a81020f0 0x7f22a8102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 -- 172.21.15.33:0/1287192770 >> 172.21.15.33:0/1287192770 conn(0x7f22a80fc500 msgr2=0x7f22a80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 -- 172.21.15.33:0/1287192770 shutdown_connections 2024-05-08T20:04:34.809 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.818+0000 7f22ac998700 1 -- 172.21.15.33:0/1287192770 wait complete. 2024-05-08T20:04:34.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 Processor -- start 2024-05-08T20:04:34.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 -- start start 2024-05-08T20:04:34.812 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22a8100f20 0x7f22a8074d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a81020f0 0x7f22a8073390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a8102ab0 0x7f22a80738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8074070 con 0x7f22a81020f0 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80741e0 con 0x7f22a8102ab0 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.819+0000 7f22ac998700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81a1100 con 0x7f22a8100f20 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a81020f0 0x7f22a8073390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a81020f0 0x7f22a8073390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42332/0 (socket says 172.21.15.33:42332) 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 -- 172.21.15.33:0/3084111514 learned_addr learned my addr 172.21.15.33:0/3084111514 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a659c700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22a8100f20 0x7f22a8074d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a6d9d700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a8102ab0 0x7f22a80738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 -- 172.21.15.33:0/3084111514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22a8100f20 msgr2=0x7f22a8074d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22a8100f20 0x7f22a8074d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.813 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 -- 172.21.15.33:0/3084111514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a8102ab0 msgr2=0x7f22a80738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a8102ab0 0x7f22a80738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 -- 172.21.15.33:0/3084111514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a0009d00 con 0x7f22a81020f0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22a5d9b700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a81020f0 0x7f22a8073390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9a0 tx=0x7f229c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22977fe700 1 -- 172.21.15.33:0/3084111514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c009790 con 0x7f22a81020f0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a81a1390 con 0x7f22a81020f0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22977fe700 1 -- 172.21.15.33:0/3084111514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f229c00cb70 con 0x7f22a81020f0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22977fe700 1 -- 172.21.15.33:0/3084111514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229c018680 con 0x7f22a81020f0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.820+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a81a18a0 con 0x7f22a81020f0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.821+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a8108340 con 0x7f22a81020f0 2024-05-08T20:04:34.814 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.823+0000 7f22977fe700 1 -- 172.21.15.33:0/3084111514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f229c00cce0 con 0x7f22a81020f0 2024-05-08T20:04:34.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.823+0000 7f22977fe700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f22900a11b0 0x7f22900a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:34.815 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.824+0000 7f22a659c700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f22900a11b0 0x7f22900a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:34.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.824+0000 7f22977fe700 1 -- 172.21.15.33:0/3084111514 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f229c014070 con 0x7f22a81020f0 2024-05-08T20:04:34.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.824+0000 7f22a659c700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f22900a11b0 0x7f22900a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22a8100c40 tx=0x7f2298009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:34.816 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:34.827+0000 7f22977fe700 1 -- 172.21.15.33:0/3084111514 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f229c0967a0 con 0x7f22a81020f0 2024-05-08T20:04:35.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.042+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22a810c8c0 con 0x7f22a81020f0 2024-05-08T20:04:35.032 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.043+0000 7f22977fe700 1 -- 172.21.15.33:0/3084111514 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f229c026020 con 0x7f22a81020f0 2024-05-08T20:04:35.032 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.045+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f22900a11b0 msgr2=0x7f22900a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.045+0000 7f22ac998700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f22900a11b0 0x7f22900a3670 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f22a8100c40 tx=0x7f2298009260 comp rx=0 tx=0).stop 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.045+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a81020f0 msgr2=0x7f22a8073390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.045+0000 7f22ac998700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a81020f0 0x7f22a8073390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f229c00e9a0 tx=0x7f229c00ecb0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 shutdown_connections 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f22a8102ab0 0x7f22a80738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f22900a11b0 0x7f22900a3670 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.035 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22a8100f20 0x7f22a8074d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 --2- 172.21.15.33:0/3084111514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f22a81020f0 0x7f22a8073390 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 >> 172.21.15.33:0/3084111514 conn(0x7f22a80fc500 msgr2=0x7f22a8105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:35.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 shutdown_connections 2024-05-08T20:04:35.036 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.046+0000 7f22ac998700 1 -- 172.21.15.33:0/3084111514 wait complete. 2024-05-08T20:04:35.049 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:04:35.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 -- 172.21.15.33:0/1956411452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee4100f50 msgr2=0x7feee41013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 --2- 172.21.15.33:0/1956411452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee4100f50 0x7feee41013b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feecc0099c0 tx=0x7feecc009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 -- 172.21.15.33:0/1956411452 shutdown_connections 2024-05-08T20:04:35.190 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 --2- 172.21.15.33:0/1956411452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee41018f0 0x7feee41081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 --2- 172.21.15.33:0/1956411452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee40ffd60 0x7feee4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 --2- 172.21.15.33:0/1956411452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee4100f50 0x7feee41013b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 -- 172.21.15.33:0/1956411452 >> 172.21.15.33:0/1956411452 conn(0x7feee40fb2f0 msgr2=0x7feee40fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 -- 172.21.15.33:0/1956411452 shutdown_connections 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 -- 172.21.15.33:0/1956411452 wait complete. 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.197+0000 7feeea111700 1 Processor -- start 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feeea111700 1 -- start start 2024-05-08T20:04:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feeea111700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee40ffd60 0x7feee4195dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feeea111700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4100f50 0x7feee4196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feeea111700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee41018f0 0x7feee419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feeea111700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee419d8f0 con 0x7feee41018f0 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feeea111700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee419da30 con 0x7feee4100f50 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feeea111700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee419dbc0 con 0x7feee40ffd60 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feee3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee41018f0 0x7feee419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feee37fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee40ffd60 0x7feee4195dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feee3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee41018f0 0x7feee419d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42352/0 (socket says 172.21.15.33:42352) 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feee3fff700 1 -- 172.21.15.33:0/574874546 learned_addr learned my addr 172.21.15.33:0/574874546 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.198+0000 7feee2ffd700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4100f50 0x7feee4196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee37fe700 1 -- 172.21.15.33:0/574874546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4100f50 msgr2=0x7feee4196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee37fe700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4100f50 0x7feee4196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee37fe700 1 -- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee41018f0 msgr2=0x7feee419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee37fe700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee41018f0 0x7feee419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee37fe700 1 -- 172.21.15.33:0/574874546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0095f0 con 0x7feee40ffd60 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee3fff700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee41018f0 0x7feee419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee37fe700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee40ffd60 0x7feee4195dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feed400e9c0 tx=0x7feed400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee0ff9700 1 -- 172.21.15.33:0/574874546 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4004220 con 0x7feee40ffd60 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee4068050 con 0x7feee40ffd60 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee0ff9700 1 -- 172.21.15.33:0/574874546 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feed400cca0 con 0x7feee40ffd60 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feee0ff9700 1 -- 172.21.15.33:0/574874546 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4003c50 con 0x7feee40ffd60 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.199+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee40685b0 con 0x7feee40ffd60 2024-05-08T20:04:35.193 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.200+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee4067c10 con 0x7feee40ffd60 2024-05-08T20:04:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.201+0000 7feee0ff9700 1 -- 172.21.15.33:0/574874546 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7feed4004380 con 0x7feee40ffd60 2024-05-08T20:04:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.202+0000 7feee0ff9700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feed00a11b0 0x7feed00a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.194 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.202+0000 7feee2ffd700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feed00a11b0 0x7feed00a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.202+0000 7feee0ff9700 1 -- 172.21.15.33:0/574874546 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7feed4014070 con 0x7feee40ffd60 2024-05-08T20:04:35.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.203+0000 7feee2ffd700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feed00a11b0 0x7feed00a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feecc000c00 tx=0x7feecc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:35.195 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.206+0000 7feee0ff9700 1 -- 172.21.15.33:0/574874546 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7feed4096430 con 0x7feee40ffd60 2024-05-08T20:04:35.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:35 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2921344437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:35.320 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:35 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3084111514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:35.468 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.479+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feee410b700 con 0x7feee40ffd60 2024-05-08T20:04:35.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.480+0000 7feee0ff9700 1 -- 172.21.15.33:0/574874546 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10848 (secure 0 0 0) 0x7feed4099a50 con 0x7feee40ffd60 2024-05-08T20:04:35.470 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:35.470 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:03:35.012471+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24527":{"gid":24527,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/84840757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":84840757},{"type":"v1","addr":"172.21.15.82:6837","nonce":84840757}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feed00a11b0 msgr2=0x7feed00a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feed00a11b0 0x7feed00a3670 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7feecc000c00 tx=0x7feecc005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee40ffd60 msgr2=0x7feee4195dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee40ffd60 0x7feee4195dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7feed400e9c0 tx=0x7feed400ecd0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 shutdown_connections 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee41018f0 0x7feee419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7feed00a11b0 0x7feed00a3670 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee40ffd60 0x7feee4195dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 --2- 172.21.15.33:0/574874546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feee4100f50 0x7feee4196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 >> 172.21.15.33:0/574874546 conn(0x7feee40fb2f0 msgr2=0x7feee41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 shutdown_connections 2024-05-08T20:04:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.483+0000 7feeea111700 1 -- 172.21.15.33:0/574874546 wait complete. 2024-05-08T20:04:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 23 2024-05-08T20:04:35.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:04:35.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:35 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2921344437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:35.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:35 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3084111514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:35.625 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 -- 172.21.15.33:0/2514878189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6418100f50 msgr2=0x7f64181013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 --2- 172.21.15.33:0/2514878189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6418100f50 0x7f64181013b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f64140099c0 tx=0x7f6414009cd0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 -- 172.21.15.33:0/2514878189 shutdown_connections 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 --2- 172.21.15.33:0/2514878189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64181018f0 0x7f64181081a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 --2- 172.21.15.33:0/2514878189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64180ffd60 0x7f6418100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 --2- 172.21.15.33:0/2514878189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6418100f50 0x7f64181013b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 -- 172.21.15.33:0/2514878189 >> 172.21.15.33:0/2514878189 conn(0x7f64180fb2f0 msgr2=0x7f64180fd710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 -- 172.21.15.33:0/2514878189 shutdown_connections 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.634+0000 7f641f315700 1 -- 172.21.15.33:0/2514878189 wait complete. 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 Processor -- start 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 -- start start 2024-05-08T20:04:35.626 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64180ffd60 0x7f6418195da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6418100f50 0x7f64181962e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64181018f0 0x7f641819d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641819d890 con 0x7f64180ffd60 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641819da00 con 0x7f64181018f0 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641f315700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641819dbc0 con 0x7f6418100f50 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d0b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64180ffd60 0x7f6418195da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d0b1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64180ffd60 0x7f6418195da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42366/0 (socket says 172.21.15.33:42366) 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d0b1700 1 -- 172.21.15.33:0/29615317 learned_addr learned my addr 172.21.15.33:0/29615317 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641c8b0700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6418100f50 0x7f64181962e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d8b2700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64181018f0 0x7f641819d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d0b1700 1 -- 172.21.15.33:0/29615317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6418100f50 msgr2=0x7f64181962e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d0b1700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6418100f50 0x7f64181962e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.627 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d0b1700 1 -- 172.21.15.33:0/29615317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64181018f0 msgr2=0x7f641819d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.635+0000 7f641d0b1700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64181018f0 0x7f641819d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.636+0000 7f641d0b1700 1 -- 172.21.15.33:0/29615317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64140095f0 con 0x7f64180ffd60 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.636+0000 7f641d0b1700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64180ffd60 0x7f6418195da0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f640c00ea80 tx=0x7f640c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.636+0000 7f640a7fc700 1 -- 172.21.15.33:0/29615317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c013070 con 0x7f64180ffd60 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.636+0000 7f640a7fc700 1 -- 172.21.15.33:0/29615317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f640c004020 con 0x7f64180ffd60 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.636+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6418068050 con 0x7f64180ffd60 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.636+0000 7f640a7fc700 1 -- 172.21.15.33:0/29615317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c003b20 con 0x7f64180ffd60 2024-05-08T20:04:35.628 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.636+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64180685b0 con 0x7f64180ffd60 2024-05-08T20:04:35.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:35 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2921344437' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:04:35.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:35 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3084111514' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:04:35.629 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.637+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6418067c10 con 0x7f64180ffd60 2024-05-08T20:04:35.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.638+0000 7f640a7fc700 1 -- 172.21.15.33:0/29615317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f640c004190 con 0x7f64180ffd60 2024-05-08T20:04:35.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.639+0000 7f640a7fc700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f64040a1230 0x7f64040a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:35.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.639+0000 7f641c8b0700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f64040a1230 0x7f64040a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:35.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.639+0000 7f640a7fc700 1 -- 172.21.15.33:0/29615317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f640c0ce880 con 0x7f64180ffd60 2024-05-08T20:04:35.630 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.640+0000 7f641c8b0700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f64040a1230 0x7f64040a36f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6414000c00 tx=0x7f6414005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:35.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.643+0000 7f640a7fc700 1 -- 172.21.15.33:0/29615317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f640c097e90 con 0x7f64180ffd60 2024-05-08T20:04:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.864+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f641810b6b0 con 0x7f64180ffd60 2024-05-08T20:04:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.866+0000 7f640a7fc700 1 -- 172.21.15.33:0/29615317 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22572 (secure 0 0 0) 0x7f640c09b4b0 con 0x7f64180ffd60 2024-05-08T20:04:35.856 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:04:35.856 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":82,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:04:28.270191+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:04:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f64040a1230 msgr2=0x7f64040a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f64040a1230 0x7f64040a36f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6414000c00 tx=0x7f6414005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64180ffd60 msgr2=0x7f6418195da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64180ffd60 0x7f6418195da0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f640c00ea80 tx=0x7f640c00ed90 comp rx=0 tx=0).stop 2024-05-08T20:04:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 shutdown_connections 2024-05-08T20:04:35.858 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64181018f0 0x7f641819d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f64180ffd60 0x7f6418195da0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f64040a1230 0x7f64040a36f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 --2- 172.21.15.33:0/29615317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6418100f50 0x7f64181962e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 >> 172.21.15.33:0/29615317 conn(0x7f64180fb2f0 msgr2=0x7f64181042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 shutdown_connections 2024-05-08T20:04:35.859 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:35.869+0000 7f641f315700 1 -- 172.21.15.33:0/29615317 wait complete. 2024-05-08T20:04:35.873 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T20:03:29.655534+0000', 'modified': '2024-05-08T20:03:35.012471+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24566, 'mds_1': 24535, 'mds_2': 24508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24503': {'gid': 24503, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6835/120986217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6834', 'nonce': 120986217}, {'type': 'v1', 'addr': '172.21.15.82:6835', 'nonce': 120986217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24508': {'gid': 24508, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.132:6837/852069157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 852069157}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 852069157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24523': {'gid': 24523, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.132:6839/3830178924', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6838', 'nonce': 3830178924}, {'type': 'v1', 'addr': '172.21.15.132:6839', 'nonce': 3830178924}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24527': {'gid': 24527, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6837/84840757', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6836', 'nonce': 84840757}, {'type': 'v1', 'addr': '172.21.15.82:6837', 'nonce': 84840757}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24535': {'gid': 24535, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.33:6839/151321489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6838', 'nonce': 151321489}, {'type': 'v1', 'addr': '172.21.15.33:6839', 'nonce': 151321489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24566': {'gid': 24566, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.82:6839/3735435957', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 3735435957}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 3735435957}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-08T20:04:35.873 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-08T20:04:35.873 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-05-08T20:04:36.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 -- 172.21.15.33:0/106974003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 msgr2=0x7f5f7c108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 --2- 172.21.15.33:0/106974003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c108290 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400b0a0 tx=0x7f5f7400b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 -- 172.21.15.33:0/106974003 shutdown_connections 2024-05-08T20:04:36.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 --2- 172.21.15.33:0/106974003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c108290 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 --2- 172.21.15.33:0/106974003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f7c0ffe60 0x7f5f7c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.013 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 --2- 172.21.15.33:0/106974003 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7c100fb0 0x7f5f7c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 -- 172.21.15.33:0/106974003 >> 172.21.15.33:0/106974003 conn(0x7f5f7c0fb3f0 msgr2=0x7f5f7c0fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 -- 172.21.15.33:0/106974003 shutdown_connections 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.021+0000 7f5f82036700 1 -- 172.21.15.33:0/106974003 wait complete. 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 Processor -- start 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 -- start start 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f7c0ffe60 0x7f5f7c068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7c100fb0 0x7f5f7c19e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c1a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1a0da0 con 0x7f5f7c101970 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1a0f10 con 0x7f5f7c100fb0 2024-05-08T20:04:36.014 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f82036700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c1a10d0 con 0x7f5f7c0ffe60 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.022+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c1a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c1a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42394/0 (socket says 172.21.15.33:42394) 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 -- 172.21.15.33:0/435637571 learned_addr learned my addr 172.21.15.33:0/435637571 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7affd700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7c100fb0 0x7f5f7c19e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f7c0ffe60 0x7f5f7c068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 -- 172.21.15.33:0/435637571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f7c0ffe60 msgr2=0x7f5f7c068b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f7c0ffe60 0x7f5f7c068b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 -- 172.21.15.33:0/435637571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7c100fb0 msgr2=0x7f5f7c19e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7c100fb0 0x7f5f7c19e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 -- 172.21.15.33:0/435637571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74009d00 con 0x7f5f7c101970 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f7c0ffe60 0x7f5f7c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c1a0740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5f74004d00 tx=0x7f5f74004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f78ff9700 1 -- 172.21.15.33:0/435637571 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7400e040 con 0x7f5f7c101970 2024-05-08T20:04:36.015 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c1a1350 con 0x7f5f7c101970 2024-05-08T20:04:36.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f78ff9700 1 -- 172.21.15.33:0/435637571 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f7401db70 con 0x7f5f7c101970 2024-05-08T20:04:36.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f78ff9700 1 -- 172.21.15.33:0/435637571 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7401bb00 con 0x7f5f7c101970 2024-05-08T20:04:36.016 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.023+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c1a17d0 con 0x7f5f7c101970 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.026+0000 7f5f78ff9700 1 -- 172.21.15.33:0/435637571 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5f7401dce0 con 0x7f5f7c101970 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.027+0000 7f5f78ff9700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5f680a11b0 0x7f5f680a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.027+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5f680a11b0 0x7f5f680a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.027+0000 7f5f78ff9700 1 -- 172.21.15.33:0/435637571 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5f740ce880 con 0x7f5f7c101970 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.027+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5f680a11b0 0x7f5f680a3670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005fd0 tx=0x7f5f6c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 Processor -- start 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 -- start start 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddb12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb1810 0x55bb3ddb1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dd07100 con 0x55bb3ddb04f0 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dd04ac0 con 0x55bb3ddb0e50 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dd003b0 con 0x55bb3ddb1810 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42402/0 (socket says 172.21.15.33:42402) 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/1661543507 learned_addr learned my addr 172.21.15.33:0/1661543507 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7affd700 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddb12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb1810 0x55bb3ddb1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/1661543507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb1810 msgr2=0x55bb3ddb1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb1810 0x55bb3ddb1c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/1661543507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb0e50 msgr2=0x55bb3ddb12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.025 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddb12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/1661543507 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb3db81360 con 0x55bb3ddb04f0 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7affd700 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddb12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.028+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb0910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00ff30 tx=0x7f5f6c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80c82bb9a86c86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f71ffb700 1 -- 172.21.15.33:0/1661543507 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c011c60 con 0x55bb3ddb04f0 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f71ffb700 1 -- 172.21.15.33:0/1661543507 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f6c011dc0 con 0x55bb3ddb04f0 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f71ffb700 1 -- 172.21.15.33:0/1661543507 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c01d810 con 0x55bb3ddb04f0 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1661543507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 msgr2=0x55bb3ddb0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb0910 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00ff30 tx=0x7f5f6c012000 comp rx=0 tx=0).stop 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1661543507 shutdown_connections 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb1810 0x55bb3ddb1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.026 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb0910 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.029+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1661543507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddb12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.030+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1661543507 >> 172.21.15.33:0/1661543507 conn(0x55bb3dd0e1c0 msgr2=0x55bb3ddaad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.030+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1661543507 shutdown_connections 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.030+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1661543507 wait complete. 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.030+0000 7f5f8e1f0b80 1 -- start start 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.030+0000 7f5f8e1f0b80 1 Processor -- start 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.030+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dc9c510 con 0x55bb3ddb04f0 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dc9c1b0 con 0x55bb3ddb1810 2024-05-08T20:04:36.027 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3db83650 con 0x55bb3ddb0e50 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f8e1f0b80 10 client.0 _ll_register_callbacks cb 0x55bb3dca5ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42404/0 (socket says 172.21.15.33:42404) 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/3036903768 learned_addr learned my addr 172.21.15.33:0/3036903768 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7affd700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 msgr2=0x55bb3ddba2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddba2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/3036903768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 msgr2=0x55bb3ddc12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 -- 172.21.15.33:0/3036903768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c00fbe0 con 0x55bb3ddb04f0 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:36.028 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7affd700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb9d70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005250 tx=0x7f5f6c005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9ea3d4ffb51d5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f5affd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f5affd700 1 -- 172.21.15.33:0/3036903768 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c02e070 con 0x55bb3ddb04f0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f5affd700 1 -- 172.21.15.33:0/3036903768 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5f6c00bdd0 con 0x55bb3ddb04f0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.031+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bb3dc59220 con 0x55bb3ddb04f0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f5affd700 1 -- 172.21.15.33:0/3036903768 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f6c00ba40 con 0x55bb3ddb04f0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 10 client.15198 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bb3db2db10 con 0x55bb3ddb04f0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f5affd700 1 -- 172.21.15.33:0/3036903768 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f6c041080 con 0x55bb3ddb04f0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f5affd700 1 -- 172.21.15.33:0/3036903768 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5f6c03b030 con 0x55bb3ddb04f0 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 10 client.15198 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 10 client.15198 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T20:04:36.029 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 20 client.15198 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3ddc4ea0 0x55bb3ddca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 4 client.15198 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 --> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bb3dd7f7c0 con 0x55bb3ddc4ea0 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.032+0000 7f5f7affd700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3ddc4ea0 0x55bb3ddca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.033+0000 7f5f5affd700 10 client.15198 ms_handle_connect on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.033+0000 7f5f7affd700 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3ddc4ea0 0x55bb3ddca160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e837c81dab8ab15c server_cookie=beb3da2628a1936f in_seq=0 out_seq=0 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.033+0000 7f5f5affd700 1 -- 172.21.15.33:0/3036903768 <== mds.2 v2:172.21.15.132:6836/852069157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bb3dd7f7c0 con 0x55bb3ddc4ea0 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.033+0000 7f5f5affd700 10 client.15198 handle_command_reply: tid=0 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.033+0000 7f5f8e1f0b80 1 client.15198 shutdown 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 msgr2=0x55bb3ddb9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb9d70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005250 tx=0x7f5f6c005330 comp rx=0 tx=0).stop 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 shutdown_connections 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.030 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3ddc4ea0 0x55bb3ddca160 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb9d70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f5affd700 0 client.15198 ms_handle_reset on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:36.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/3036903768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 >> 172.21.15.33:0/3036903768 conn(0x55bb3dd0e1c0 msgr2=0x55bb3ddaa550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 shutdown_connections 2024-05-08T20:04:36.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/3036903768 wait complete. 2024-05-08T20:04:36.031 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.034+0000 7f5f8e1f0b80 20 client.15198 trim_cache size 0 max 16384 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 Processor -- start 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 -- start start 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb1810 0x55bb3ddaad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dcbe2b0 con 0x55bb3ddb1810 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dcf9150 con 0x55bb3ddb04f0 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3dc9f5a0 con 0x55bb3ddb0e50 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb1810 0x55bb3ddaad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.049 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb1810 0x55bb3ddaad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42406/0 (socket says 172.21.15.33:42406) 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 -- 172.21.15.33:0/2206940122 learned_addr learned my addr 172.21.15.33:0/2206940122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7affd700 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 -- 172.21.15.33:0/2206940122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 msgr2=0x55bb3ddc12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 -- 172.21.15.33:0/2206940122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb04f0 msgr2=0x55bb3ddb08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7bfff700 1 -- 172.21.15.33:0/2206940122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb3dcc6510 con 0x55bb3ddb1810 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.053+0000 7f5f7affd700 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb1810 0x55bb3ddaad60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5f74098650 tx=0x7f5f7409bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ba092328763f2c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f727fc700 1 -- 172.21.15.33:0/2206940122 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7409bbe0 con 0x55bb3ddb1810 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f727fc700 1 -- 172.21.15.33:0/2206940122 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f740bb040 con 0x55bb3ddb1810 2024-05-08T20:04:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f727fc700 1 -- 172.21.15.33:0/2206940122 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74011390 con 0x55bb3ddb1810 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/2206940122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb1810 msgr2=0x55bb3ddaad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb1810 0x55bb3ddaad60 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5f74098650 tx=0x7f5f7409bac0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/2206940122 shutdown_connections 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb1810 0x55bb3ddaad60 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddb08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/2206940122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/2206940122 >> 172.21.15.33:0/2206940122 conn(0x55bb3dd0e1c0 msgr2=0x55bb3ddb1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.054+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/2206940122 shutdown_connections 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/2206940122 wait complete. 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 -- start start 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 Processor -- start 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddbe2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3ddc1340 con 0x55bb3ddb0e50 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3ddc14b0 con 0x55bb3ddb1810 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb3ddc1670 con 0x55bb3ddb04f0 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f8e1f0b80 10 client.0 _ll_register_callbacks cb 0x55bb3dca5ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f7affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f7affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42416/0 (socket says 172.21.15.33:42416) 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f7affd700 1 -- 172.21.15.33:0/1016349002 learned_addr learned my addr 172.21.15.33:0/1016349002 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.055+0000 7f5f7bfff700 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddbe2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f7affd700 1 -- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb04f0 msgr2=0x55bb3ddbe2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f7affd700 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddbe2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f7affd700 1 -- 172.21.15.33:0/1016349002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 msgr2=0x55bb3ddc0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f7affd700 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f7affd700 1 -- 172.21.15.33:0/1016349002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c1a17d0 con 0x55bb3ddb0e50 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f7affd700 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc0830 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55bb3ddc5280 tx=0x7f5f6400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3accca23cacc1e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f5affd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f5affd700 1 -- 172.21.15.33:0/1016349002 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f64017040 con 0x55bb3ddb0e50 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f5affd700 1 -- 172.21.15.33:0/1016349002 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5f6401c7c0 con 0x55bb3ddb0e50 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f6c011dc0 con 0x55bb3ddb0e50 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f5affd700 1 -- 172.21.15.33:0/1016349002 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f64003960 con 0x55bb3ddb0e50 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f8e1f0b80 10 client.15204 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bb3db85c80 con 0x55bb3ddb0e50 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.056+0000 7f5f5affd700 1 -- 172.21.15.33:0/1016349002 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f6402b020 con 0x55bb3ddb0e50 2024-05-08T20:04:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f5affd700 1 -- 172.21.15.33:0/1016349002 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5f64005020 con 0x55bb3ddb0e50 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f8e1f0b80 10 client.15204 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f8e1f0b80 10 client.15204 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f8e1f0b80 20 client.15204 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3de20a60 0x55bb3de1d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f8e1f0b80 4 client.15204 mds_command: new command op to 24508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 --> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bb3dcf8e70 con 0x55bb3de20a60 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3de20a60 0x55bb3de1d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f7b7fe700 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3de20a60 0x55bb3de1d410 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7908d8b983775684 server_cookie=f18286471a74ef63 in_seq=0 out_seq=0 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.057+0000 7f5f5affd700 10 client.15204 ms_handle_connect on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f5affd700 1 -- 172.21.15.33:0/1016349002 <== mds.2 v2:172.21.15.132:6836/852069157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55bb3dcf8e70 con 0x55bb3de20a60 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f5affd700 10 client.15204 handle_command_reply: tid=0 2024-05-08T20:04:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 client.15204 shutdown 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb0e50 msgr2=0x55bb3ddc0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc0830 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x55bb3ddc5280 tx=0x7f5f6400bcb0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 shutdown_connections 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bb3ddb1810 0x55bb3ddc0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bb3ddb04f0 0x55bb3ddbe2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.132:6836/852069157,v1:172.21.15.132:6837/852069157] conn(0x55bb3de20a60 0x55bb3de1d410 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 --2- 172.21.15.33:0/1016349002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55bb3ddb0e50 0x55bb3ddc0830 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f5affd700 0 client.15204 ms_handle_reset on v2:172.21.15.132:6836/852069157 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 >> 172.21.15.33:0/1016349002 conn(0x55bb3dd0e1c0 msgr2=0x55bb3ddb8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 shutdown_connections 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 1 -- 172.21.15.33:0/1016349002 wait complete. 2024-05-08T20:04:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f8e1f0b80 20 client.15204 trim_cache size 0 max 16384 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 2, 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24508, 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 62.050518201000003, 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 23, 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 82, 2024-05-08T20:04:36.056 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T20:04:36.057 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 81.726861432999996 2024-05-08T20:04:36.057 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:04:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5f680a11b0 msgr2=0x7f5f680a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f82036700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5f680a11b0 0x7f5f680a3670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005fd0 tx=0x7f5f6c005f60 comp rx=0 tx=0).stop 2024-05-08T20:04:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 msgr2=0x7f5f7c1a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.058+0000 7f5f82036700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c1a0740 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5f74004d00 tx=0x7f5f74004d30 comp rx=0 tx=0).stop 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 shutdown_connections 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f7c101970 0x7f5f7c1a0740 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5f680a11b0 0x7f5f680a3670 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5f7c0ffe60 0x7f5f7c068b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 --2- 172.21.15.33:0/435637571 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f7c100fb0 0x7f5f7c19e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 >> 172.21.15.33:0/435637571 conn(0x7f5f7c0fb3f0 msgr2=0x7f5f7c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 shutdown_connections 2024-05-08T20:04:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.059+0000 7f5f82036700 1 -- 172.21.15.33:0/435637571 wait complete. 2024-05-08T20:04:36.062 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 -- 172.21.15.33:0/2798928339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18101970 msgr2=0x7f5b18108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/2798928339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18101970 0x7f5b18108290 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000b0a0 tx=0x7f5b1000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 -- 172.21.15.33:0/2798928339 shutdown_connections 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/2798928339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18101970 0x7f5b18108290 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/2798928339 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b180ffe60 0x7f5b18100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/2798928339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b18100fb0 0x7f5b18101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 -- 172.21.15.33:0/2798928339 >> 172.21.15.33:0/2798928339 conn(0x7f5b180fb3f0 msgr2=0x7f5b180fd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 -- 172.21.15.33:0/2798928339 shutdown_connections 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 -- 172.21.15.33:0/2798928339 wait complete. 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 Processor -- start 2024-05-08T20:04:36.204 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.214+0000 7f5b1f46d700 1 -- start start 2024-05-08T20:04:36.206 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1f46d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b180ffe60 0x7f5b18068b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1f46d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18100fb0 0x7f5b1819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1f46d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b18101970 0x7f5b1819e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1f46d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1819ec00 con 0x7f5b18100fb0 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1f46d700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1819ed70 con 0x7f5b180ffe60 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1f46d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1819ef30 con 0x7f5b18101970 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18100fb0 0x7f5b1819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18100fb0 0x7f5b1819bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42436/0 (socket says 172.21.15.33:42436) 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 -- 172.21.15.33:0/1889127498 learned_addr learned my addr 172.21.15.33:0/1889127498 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1d209700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b180ffe60 0x7f5b18068b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b18101970 0x7f5b1819e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 -- 172.21.15.33:0/1889127498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b18101970 msgr2=0x7f5b1819e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.207 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b18101970 0x7f5b1819e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 -- 172.21.15.33:0/1889127498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b180ffe60 msgr2=0x7f5b18068b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b180ffe60 0x7f5b18068b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 -- 172.21.15.33:0/1889127498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10009d00 con 0x7f5b18100fb0 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1d209700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b180ffe60 0x7f5b18068b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.215+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18100fb0 0x7f5b1819bdf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800d950 tx=0x7f5b0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.216+0000 7f5b0e7fc700 1 -- 172.21.15.33:0/1889127498 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800f890 con 0x7f5b18100fb0 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.216+0000 7f5b0e7fc700 1 -- 172.21.15.33:0/1889127498 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b08010460 con 0x7f5b18100fb0 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.216+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b1819f1b0 con 0x7f5b18100fb0 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.216+0000 7f5b0e7fc700 1 -- 172.21.15.33:0/1889127498 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800e610 con 0x7f5b18100fb0 2024-05-08T20:04:36.208 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.216+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1819f710 con 0x7f5b18100fb0 2024-05-08T20:04:36.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.218+0000 7f5b0e7fc700 1 -- 172.21.15.33:0/1889127498 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7f5b08010960 con 0x7f5b18100fb0 2024-05-08T20:04:36.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.218+0000 7f5b0e7fc700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5b040a1230 0x7f5b040a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.219+0000 7f5b0e7fc700 1 -- 172.21.15.33:0/1889127498 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5b080cc7b0 con 0x7f5b18100fb0 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.219+0000 7f5b1d209700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5b040a1230 0x7f5b040a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.219+0000 7f5b1d209700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5b040a1230 0x7f5b040a36f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b14011490 tx=0x7f5b14009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 Processor -- start 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 -- start start 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2178900 0x560bf2178d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179260 0x560bf21796e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf217a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf20cb100 con 0x560bf2179260 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf20c8ac0 con 0x560bf2178900 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf20c43b0 con 0x560bf2179c20 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b1ca08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179260 0x560bf21796e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b1ca08700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179260 0x560bf21796e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42452/0 (socket says 172.21.15.33:42452) 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b1ca08700 1 -- 172.21.15.33:0/580213424 learned_addr learned my addr 172.21.15.33:0/580213424 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.212 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b1d209700 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2178900 0x560bf2178d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf217a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b1ca08700 1 -- 172.21.15.33:0/580213424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 msgr2=0x560bf217a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.220+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf217a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b1ca08700 1 -- 172.21.15.33:0/580213424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2178900 msgr2=0x560bf2178d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2178900 0x560bf2178d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b1ca08700 1 -- 172.21.15.33:0/580213424 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bf1f45360 con 0x560bf2179260 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf217a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179260 0x560bf21796e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5b080a19d0 tx=0x7f5b080996f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de109188ab63598 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b037fe700 1 -- 172.21.15.33:0/580213424 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0809d8b0 con 0x560bf2179260 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b037fe700 1 -- 172.21.15.33:0/580213424 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b080a1f00 con 0x560bf2179260 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.221+0000 7f5b037fe700 1 -- 172.21.15.33:0/580213424 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08099200 con 0x560bf2179260 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 -- 172.21.15.33:0/580213424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179260 msgr2=0x560bf21796e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179260 0x560bf21796e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5b080a19d0 tx=0x7f5b080996f0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 -- 172.21.15.33:0/580213424 shutdown_connections 2024-05-08T20:04:36.213 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf217a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2178900 0x560bf2178d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/580213424 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179260 0x560bf21796e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 -- 172.21.15.33:0/580213424 >> 172.21.15.33:0/580213424 conn(0x560bf20d21c0 msgr2=0x560bf216ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 -- 172.21.15.33:0/580213424 shutdown_connections 2024-05-08T20:04:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 -- 172.21.15.33:0/580213424 wait complete. 2024-05-08T20:04:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 -- start start 2024-05-08T20:04:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.222+0000 7f5b2b627b80 1 Processor -- start 2024-05-08T20:04:36.217 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf21821d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2182710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf2189750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf2060510 con 0x560bf2178900 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf20601b0 con 0x560bf2179260 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf1f47650 con 0x560bf2179c20 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b2b627b80 10 client.0 _ll_register_callbacks cb 0x560bf2069ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf21821d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf21821d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42458/0 (socket says 172.21.15.33:42458) 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 -- 172.21.15.33:0/774241382 learned_addr learned my addr 172.21.15.33:0/774241382 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf2189750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2182710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 -- 172.21.15.33:0/774241382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 msgr2=0x560bf2189750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.218 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf2189750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 -- 172.21.15.33:0/774241382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 msgr2=0x560bf2182710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2182710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 -- 172.21.15.33:0/774241382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1819f710 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b1d209700 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf21821d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b140039f0 tx=0x7f5b140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa98c750fe2acc98 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.223+0000 7f5b00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b00ff9700 1 -- 172.21.15.33:0/774241382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1401fca0 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b00ff9700 1 -- 172.21.15.33:0/774241382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5b1401fe00 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bf201d220 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b00ff9700 1 -- 172.21.15.33:0/774241382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b14003e60 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 10 client.15216 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560bf1ef1b10 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b00ff9700 1 -- 172.21.15.33:0/774241382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x560bf201d220 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b00ff9700 1 -- 172.21.15.33:0/774241382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5b14030020 con 0x560bf2178900 2024-05-08T20:04:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 10 client.15216 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 10 client.15216 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 20 client.15216 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf218c8c0 0x560bf21926e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 4 client.15216 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 --> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bf21437c0 con 0x560bf218c8c0 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.224+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf218c8c0 0x560bf21926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.225+0000 7f5b00ff9700 10 client.15216 ms_handle_connect on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.225+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf218c8c0 0x560bf21926e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97a51ad6d2782e3e server_cookie=89a0d8e1977c6e66 in_seq=0 out_seq=0 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.225+0000 7f5b00ff9700 1 -- 172.21.15.33:0/774241382 <== mds.1 v2:172.21.15.33:6838/151321489 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560bf21437c0 con 0x560bf218c8c0 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.225+0000 7f5b00ff9700 10 client.15216 handle_command_reply: tid=0 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.225+0000 7f5b2b627b80 1 client.15216 shutdown 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.225+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 msgr2=0x560bf21821d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf21821d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b140039f0 tx=0x7f5b140047c0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.220 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 shutdown_connections 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf218c8c0 0x560bf21926e0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179c20 0x560bf2189750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf21821d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b00ff9700 0 client.15216 ms_handle_reset on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/774241382 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2182710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 >> 172.21.15.33:0/774241382 conn(0x560bf20d21c0 msgr2=0x560bf216e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 shutdown_connections 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 1 -- 172.21.15.33:0/774241382 wait complete. 2024-05-08T20:04:36.221 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.226+0000 7f5b2b627b80 20 client.15216 trim_cache size 0 max 16384 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 Processor -- start 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 -- start start 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2178900 0x560bf218a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2178ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179c20 0x560bf2189710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf20bd150 con 0x560bf2179c20 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf20c1010 con 0x560bf2179260 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.245+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf20635a0 con 0x560bf2178900 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179c20 0x560bf2189710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179c20 0x560bf2189710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42464/0 (socket says 172.21.15.33:42464) 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 -- 172.21.15.33:0/792863569 learned_addr learned my addr 172.21.15.33:0/792863569 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1d209700 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2178900 0x560bf218a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2178ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 -- 172.21.15.33:0/792863569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2178900 msgr2=0x560bf218a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2178900 0x560bf218a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 -- 172.21.15.33:0/792863569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 msgr2=0x560bf2178ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2178ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 -- 172.21.15.33:0/792863569 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bf208a510 con 0x560bf2179c20 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2178ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179c20 0x560bf2189710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000b0a0 tx=0x7f5b100092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2ba11dae1050ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b03fff700 1 -- 172.21.15.33:0/792863569 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000e040 con 0x560bf2179c20 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b03fff700 1 -- 172.21.15.33:0/792863569 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b10020070 con 0x560bf2179c20 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.246+0000 7f5b03fff700 1 -- 172.21.15.33:0/792863569 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100052a0 con 0x560bf2179c20 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 -- 172.21.15.33:0/792863569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179c20 msgr2=0x560bf2189710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.242 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179c20 0x560bf2189710 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000b0a0 tx=0x7f5b100092e0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 -- 172.21.15.33:0/792863569 shutdown_connections 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2179c20 0x560bf2189710 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2178900 0x560bf218a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/792863569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179260 0x560bf2178ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 -- 172.21.15.33:0/792863569 >> 172.21.15.33:0/792863569 conn(0x560bf20d21c0 msgr2=0x560bf217a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 -- 172.21.15.33:0/792863569 shutdown_connections 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 -- 172.21.15.33:0/792863569 wait complete. 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 -- start start 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.247+0000 7f5b2b627b80 1 Processor -- start 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf2183900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179260 0x560bf2183e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b2b627b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179c20 0x560bf2188c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf21891d0 con 0x560bf2178900 2024-05-08T20:04:36.243 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf2189340 con 0x560bf2179c20 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b2b627b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bf2189500 con 0x560bf2179260 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b2b627b80 10 client.0 _ll_register_callbacks cb 0x560bf2069ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf2183900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf2183900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42466/0 (socket says 172.21.15.33:42466) 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 -- 172.21.15.33:0/1525789416 learned_addr learned my addr 172.21.15.33:0/1525789416 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179260 0x560bf2183e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1da0a700 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179c20 0x560bf2188c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 -- 172.21.15.33:0/1525789416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179260 msgr2=0x560bf2183e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179260 0x560bf2183e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 -- 172.21.15.33:0/1525789416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179c20 msgr2=0x560bf2188c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179c20 0x560bf2188c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 -- 172.21.15.33:0/1525789416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b18108bc0 con 0x560bf2178900 2024-05-08T20:04:36.244 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b1d209700 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf2183900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5b14032770 tx=0x7f5b14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b370abe4868a62cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.248+0000 7f5b00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b00ff9700 1 -- 172.21.15.33:0/1525789416 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b140092d0 con 0x560bf2178900 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b00ff9700 1 -- 172.21.15.33:0/1525789416 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5b14032a60 con 0x560bf2178900 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b080a1f00 con 0x560bf2178900 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b00ff9700 1 -- 172.21.15.33:0/1525789416 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b14003e60 con 0x560bf2178900 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 10 client.15222 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x560bf1f49c80 con 0x560bf2178900 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b00ff9700 1 -- 172.21.15.33:0/1525789416 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b080a1f00 con 0x560bf2178900 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b00ff9700 1 -- 172.21.15.33:0/1525789416 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5b14003ad0 con 0x560bf2178900 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 10 client.15222 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 10 client.15222 resolve_mds: resolved name 'g' to daemon mds.g 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 20 client.15222 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf21e8a80 0x560bf21e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 4 client.15222 mds_command: new command op to 24535 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 --> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560bf20bce70 con 0x560bf21e8a80 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.249+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf21e8a80 0x560bf21e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b1ca08700 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf21e8a80 0x560bf21e53b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a2e4882007c3a8e server_cookie=cec2d6927822626c in_seq=0 out_seq=0 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b00ff9700 10 client.15222 ms_handle_connect on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b00ff9700 1 -- 172.21.15.33:0/1525789416 <== mds.1 v2:172.21.15.33:6838/151321489 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x560bf20bce70 con 0x560bf21e8a80 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b00ff9700 10 client.15222 handle_command_reply: tid=0 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 client.15222 shutdown 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 msgr2=0x560bf2183900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf2183900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5b14032770 tx=0x7f5b14014000 comp rx=0 tx=0).stop 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 shutdown_connections 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:6838/151321489,v1:172.21.15.33:6839/151321489] conn(0x560bf21e8a80 0x560bf21e53b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560bf2179c20 0x560bf2188c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560bf2178900 0x560bf2183900 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b00ff9700 0 client.15222 ms_handle_reset on v2:172.21.15.33:6838/151321489 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 --2- 172.21.15.33:0/1525789416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x560bf2179260 0x560bf2183e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 >> 172.21.15.33:0/1525789416 conn(0x560bf20d21c0 msgr2=0x560bf217cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 shutdown_connections 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 1 -- 172.21.15.33:0/1525789416 wait complete. 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.250+0000 7f5b2b627b80 20 client.15222 trim_cache size 0 max 16384 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 1, 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24535, 2024-05-08T20:04:36.247 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 63.211799788, 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 23, 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 82, 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 76.505804565000005 2024-05-08T20:04:36.248 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5b040a1230 msgr2=0x7f5b040a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5b040a1230 0x7f5b040a36f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b14011490 tx=0x7f5b14009260 comp rx=0 tx=0).stop 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18100fb0 msgr2=0x7f5b1819bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18100fb0 0x7f5b1819bdf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800d950 tx=0x7f5b0800dc60 comp rx=0 tx=0).stop 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 shutdown_connections 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f5b040a1230 0x7f5b040a36f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b18101970 0x7f5b1819e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b180ffe60 0x7f5b18068b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 --2- 172.21.15.33:0/1889127498 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b18100fb0 0x7f5b1819bdf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.249 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 >> 172.21.15.33:0/1889127498 conn(0x7f5b180fb3f0 msgr2=0x7f5b18104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 shutdown_connections 2024-05-08T20:04:36.250 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.251+0000 7f5b1f46d700 1 -- 172.21.15.33:0/1889127498 wait complete. 2024-05-08T20:04:36.254 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 -- 172.21.15.33:0/2200917592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c0ffe80 msgr2=0x7ff34c1002a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 --2- 172.21.15.33:0/2200917592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c0ffe80 0x7ff34c1002a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff340009990 tx=0x7ff340009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 -- 172.21.15.33:0/2200917592 shutdown_connections 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 --2- 172.21.15.33:0/2200917592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34c101990 0x7ff34c1082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 --2- 172.21.15.33:0/2200917592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c0ffe80 0x7ff34c1002a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 --2- 172.21.15.33:0/2200917592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c100fd0 0x7ff34c101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 -- 172.21.15.33:0/2200917592 >> 172.21.15.33:0/2200917592 conn(0x7ff34c0fb3f0 msgr2=0x7ff34c0fd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 -- 172.21.15.33:0/2200917592 shutdown_connections 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.403+0000 7ff3547e6700 1 -- 172.21.15.33:0/2200917592 wait complete. 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 Processor -- start 2024-05-08T20:04:36.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 -- start start 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34c0ffe80 0x7ff34c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c100fd0 0x7ff34c197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c101990 0x7ff34c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c19eb50 con 0x7ff34c101990 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c19ec90 con 0x7ff34c0ffe80 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff3547e6700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c19ee20 con 0x7ff34c100fd0 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff352d83700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c101990 0x7ff34c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff352d83700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c101990 0x7ff34c19e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42484/0 (socket says 172.21.15.33:42484) 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff352d83700 1 -- 172.21.15.33:0/3686512261 learned_addr learned my addr 172.21.15.33:0/3686512261 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff351d81700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c100fd0 0x7ff34c197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.404+0000 7ff352582700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34c0ffe80 0x7ff34c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff352d83700 1 -- 172.21.15.33:0/3686512261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c100fd0 msgr2=0x7ff34c197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff352d83700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c100fd0 0x7ff34c197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff352d83700 1 -- 172.21.15.33:0/3686512261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34c0ffe80 msgr2=0x7ff34c197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff352d83700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34c0ffe80 0x7ff34c197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff352d83700 1 -- 172.21.15.33:0/3686512261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3400095f0 con 0x7ff34c101990 2024-05-08T20:04:36.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff352d83700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c101990 0x7ff34c19e580 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff34400ef30 tx=0x7ff34400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff33f7fe700 1 -- 172.21.15.33:0/3686512261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344018070 con 0x7ff34c101990 2024-05-08T20:04:36.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff33f7fe700 1 -- 172.21.15.33:0/3686512261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff34400f040 con 0x7ff34c101990 2024-05-08T20:04:36.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c19f0a0 con 0x7ff34c101990 2024-05-08T20:04:36.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff33f7fe700 1 -- 172.21.15.33:0/3686512261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34400cd50 con 0x7ff34c101990 2024-05-08T20:04:36.397 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.405+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c19f5b0 con 0x7ff34c101990 2024-05-08T20:04:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.407+0000 7ff33f7fe700 1 -- 172.21.15.33:0/3686512261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7ff344003a00 con 0x7ff34c101990 2024-05-08T20:04:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.408+0000 7ff33f7fe700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff3380a1230 0x7ff3380a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.408+0000 7ff33f7fe700 1 -- 172.21.15.33:0/3686512261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff3440cc550 con 0x7ff34c101990 2024-05-08T20:04:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.408+0000 7ff352582700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff3380a1230 0x7ff3380a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff352582700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff3380a1230 0x7ff3380a36f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff34000b2e0 tx=0x7ff34000b7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 Processor -- start 2024-05-08T20:04:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 -- start start 2024-05-08T20:04:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e8900 0x55fba01e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01e96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba013b100 con 0x55fba01e9260 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba0138ac0 con 0x55fba01e9c20 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba01343b0 con 0x55fba01e8900 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff351d81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01e96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff351d81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01e96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42496/0 (socket says 172.21.15.33:42496) 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.409+0000 7ff351d81700 1 -- 172.21.15.33:0/1911636263 learned_addr learned my addr 172.21.15.33:0/1911636263 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff352d83700 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff352582700 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e8900 0x55fba01e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff351d81700 1 -- 172.21.15.33:0/1911636263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e8900 msgr2=0x55fba01e8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff351d81700 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e8900 0x55fba01e8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff351d81700 1 -- 172.21.15.33:0/1911636263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 msgr2=0x55fba01ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff351d81700 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01ea0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff351d81700 1 -- 172.21.15.33:0/1911636263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb9ffb5360 con 0x55fba01e9260 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff351d81700 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01e96e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff34800bd70 tx=0x7ff3480106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c4c46b07642feb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff33cff9700 1 -- 172.21.15.33:0/1911636263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348010ec0 con 0x55fba01e9260 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff33cff9700 1 -- 172.21.15.33:0/1911636263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff348015070 con 0x55fba01e9260 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.410+0000 7ff33cff9700 1 -- 172.21.15.33:0/1911636263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348011830 con 0x55fba01e9260 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 -- 172.21.15.33:0/1911636263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 msgr2=0x55fba01e96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01e96e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff34800bd70 tx=0x7ff3480106b0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 -- 172.21.15.33:0/1911636263 shutdown_connections 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e8900 0x55fba01e8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/1911636263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01e96e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 -- 172.21.15.33:0/1911636263 >> 172.21.15.33:0/1911636263 conn(0x55fba01421c0 msgr2=0x55fba01ded90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 -- 172.21.15.33:0/1911636263 shutdown_connections 2024-05-08T20:04:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 -- 172.21.15.33:0/1911636263 wait complete. 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 -- start start 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.411+0000 7ff3609a0b80 1 Processor -- start 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba00d0510 con 0x55fba01e9260 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba00d01b0 con 0x55fba01e8900 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9ffb7650 con 0x55fba01e9c20 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff3609a0b80 10 client.0 _ll_register_callbacks cb 0x55fba00d9ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42506/0 (socket says 172.21.15.33:42506) 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff352d83700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 -- 172.21.15.33:0/680090122 learned_addr learned my addr 172.21.15.33:0/680090122 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff352582700 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 -- 172.21.15.33:0/680090122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 msgr2=0x55fba01f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 -- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 msgr2=0x55fba01f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 -- 172.21.15.33:0/680090122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34800b9a0 con 0x55fba01e9260 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff352d83700 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff351d81700 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f2700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff348000c00 tx=0x7ff3480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd06e3eb2aa33a41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff335ffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.412+0000 7ff335ffb700 1 -- 172.21.15.33:0/680090122 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34801c990 con 0x55fba01e9260 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff335ffb700 1 -- 172.21.15.33:0/680090122 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff348022070 con 0x55fba01e9260 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fba008d220 con 0x55fba01e9260 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff335ffb700 1 -- 172.21.15.33:0/680090122 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff34801caf0 con 0x55fba01e9260 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 10 client.15234 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:36.408 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55fb9ff61b10 con 0x55fba01e9260 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff335ffb700 1 -- 172.21.15.33:0/680090122 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55fba008d220 con 0x55fba01e9260 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff335ffb700 1 -- 172.21.15.33:0/680090122 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff348003c50 con 0x55fba01e9260 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 20 client.15234 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba01fd240 0x55fba0202540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 4 client.15234 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fba01b37c0 con 0x55fba01fd240 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.413+0000 7ff352582700 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba01fd240 0x55fba0202540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.414+0000 7ff335ffb700 10 client.15234 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.414+0000 7ff352582700 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba01fd240 0x55fba0202540 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a93ee05f19003341 server_cookie=d06922168ad8c445 in_seq=0 out_seq=0 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.414+0000 7ff335ffb700 1 -- 172.21.15.33:0/680090122 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fba01b37c0 con 0x55fba01fd240 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff335ffb700 10 client.15234 handle_command_reply: tid=0 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 client.15234 shutdown 2024-05-08T20:04:36.409 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 msgr2=0x55fba01f2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f2700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff348000c00 tx=0x7ff3480057f0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 shutdown_connections 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba01fd240 0x55fba0202540 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff335ffb700 0 client.15234 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/680090122 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f2700 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 >> 172.21.15.33:0/680090122 conn(0x55fba01421c0 msgr2=0x55fba01de550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 shutdown_connections 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 1 -- 172.21.15.33:0/680090122 wait complete. 2024-05-08T20:04:36.410 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.415+0000 7ff3609a0b80 20 client.15234 trim_cache size 0 max 16384 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 Processor -- start 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 -- start start 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e8900 0x55fba01f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9260 0x55fba01f9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01f0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba012d150 con 0x55fba01e8900 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba0131010 con 0x55fba01e9c20 2024-05-08T20:04:36.429 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba00d35a0 con 0x55fba01e9260 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e8900 0x55fba01f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e8900 0x55fba01f16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42518/0 (socket says 172.21.15.33:42518) 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 -- 172.21.15.33:0/4150227485 learned_addr learned my addr 172.21.15.33:0/4150227485 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352d83700 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01f0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff351d81700 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9260 0x55fba01f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 -- 172.21.15.33:0/4150227485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9260 msgr2=0x55fba01f9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9260 0x55fba01f9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 -- 172.21.15.33:0/4150227485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 msgr2=0x55fba01f0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01f0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 -- 172.21.15.33:0/4150227485 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fba00fa510 con 0x55fba01e8900 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff351d81700 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9260 0x55fba01f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352d83700 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.434+0000 7ff352582700 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e8900 0x55fba01f16d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff340009990 tx=0x7ff340020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfba33aa5446945a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.430 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff33d7fa700 1 -- 172.21.15.33:0/4150227485 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000bd20 con 0x55fba01e8900 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff33d7fa700 1 -- 172.21.15.33:0/4150227485 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff34002c040 con 0x55fba01e8900 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff33d7fa700 1 -- 172.21.15.33:0/4150227485 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34000f460 con 0x55fba01e8900 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4150227485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e8900 msgr2=0x55fba01f16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e8900 0x55fba01f16d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff340009990 tx=0x7ff340020000 comp rx=0 tx=0).stop 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4150227485 shutdown_connections 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e9c20 0x55fba01f0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e8900 0x55fba01f16d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4150227485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9260 0x55fba01f9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4150227485 >> 172.21.15.33:0/4150227485 conn(0x55fba01421c0 msgr2=0x55fba01f01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4150227485 shutdown_connections 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.435+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4150227485 wait complete. 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 -- start start 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 Processor -- start 2024-05-08T20:04:36.431 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba01f1d50 con 0x55fba01e9260 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba01f9660 con 0x55fba01e8900 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fba01f9820 con 0x55fba01e9c20 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff3609a0b80 10 client.0 _ll_register_callbacks cb 0x55fba00d9ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42528/0 (socket says 172.21.15.33:42528) 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 -- 172.21.15.33:0/4072535827 learned_addr learned my addr 172.21.15.33:0/4072535827 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff352d83700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff352582700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 -- 172.21.15.33:0/4072535827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 msgr2=0x55fba01f9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.432 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 -- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 msgr2=0x55fba01f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff351d81700 1 -- 172.21.15.33:0/4072535827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c108be0 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.436+0000 7ff352582700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff351d81700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f8be0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff3480106f0 tx=0x7ff34802f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedf4e76d1b75a8f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff335ffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff335ffb700 1 -- 172.21.15.33:0/4072535827 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34801c990 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff348015070 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff335ffb700 1 -- 172.21.15.33:0/4072535827 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff348000e40 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff335ffb700 1 -- 172.21.15.33:0/4072535827 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff348011440 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 10 client.15240 fetch_fsmap learned FSMap version 23 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55fb9ffb9c80 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff335ffb700 1 -- 172.21.15.33:0/4072535827 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff348015070 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff335ffb700 1 -- 172.21.15.33:0/4072535827 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff34802f880 con 0x55fba01e9260 2024-05-08T20:04:36.433 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 23 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 20 client.15240 populate_metadata read hostname 'smithi033' 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba0258620 0x55fba0254fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 4 client.15240 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.437+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fba012ce70 con 0x55fba0258620 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff352582700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba0258620 0x55fba0254fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff352582700 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba0258620 0x55fba0254fb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef9f5403cc0f583 server_cookie=9b2acc9dc1166a61 in_seq=0 out_seq=0 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff335ffb700 10 client.15240 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff335ffb700 1 -- 172.21.15.33:0/4072535827 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55fba012ce70 con 0x55fba0258620 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff335ffb700 10 client.15240 handle_command_reply: tid=0 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 client.15240 shutdown 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 msgr2=0x55fba01f8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f8be0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff3480106f0 tx=0x7ff34802f5b0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.434 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 shutdown_connections 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55fba0258620 0x55fba0254fb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55fba01e9c20 0x55fba01f9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fba01e8900 0x55fba01f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff335ffb700 0 client.15240 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.438+0000 7ff3609a0b80 1 --2- 172.21.15.33:0/4072535827 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fba01e9260 0x55fba01f8be0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 >> 172.21.15.33:0/4072535827 conn(0x55fba01421c0 msgr2=0x55fba01ded40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 shutdown_connections 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3609a0b80 1 -- 172.21.15.33:0/4072535827 wait complete. 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3609a0b80 20 client.15240 trim_cache size 0 max 16384 2024-05-08T20:04:36.435 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "0ee61dd4-0d75-11ef-bc97-c7b262605968", 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 24566, 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 66.781162417000004, 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 23, 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 82, 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 73.247136746999999 2024-05-08T20:04:36.436 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff3380a1230 msgr2=0x7ff3380a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff3380a1230 0x7ff3380a36f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff34000b2e0 tx=0x7ff34000b7f0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c101990 msgr2=0x7ff34c19e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c101990 0x7ff34c19e580 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff34400ef30 tx=0x7ff34400c3a0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 shutdown_connections 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff34c101990 0x7ff34c19e580 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff34c0ffe80 0x7ff34c197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7ff3380a1230 0x7ff3380a36f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.437 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 --2- 172.21.15.33:0/3686512261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff34c100fd0 0x7ff34c197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 >> 172.21.15.33:0/3686512261 conn(0x7ff34c0fb3f0 msgr2=0x7ff34c0fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 shutdown_connections 2024-05-08T20:04:36.438 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.439+0000 7ff3547e6700 1 -- 172.21.15.33:0/3686512261 wait complete. 2024-05-08T20:04:36.442 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T20:04:36.452 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T20:04:36.452 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T20:04:36.452 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T20:04:36.452 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-05-08T20:04:36.453 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T20:04:36.453 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:04:36.453 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-05-08T20:04:36.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:36 smithi033 ceph-mon[42490]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 16 B/s, 1 objects/s recovering 2024-05-08T20:04:36.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:36 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/574874546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:36.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:36 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/29615317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:36.590 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 -- 172.21.15.33:0/1519871268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 msgr2=0x7fa2281012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/1519871268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa2281012d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa224009990 tx=0x7fa224009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 -- 172.21.15.33:0/1519871268 shutdown_connections 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/1519871268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa228102a50 0x7fa228109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/1519871268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa2281012d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/1519871268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa228102090 0x7fa228102510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 -- 172.21.15.33:0/1519871268 >> 172.21.15.33:0/1519871268 conn(0x7fa2280fc470 msgr2=0x7fa2280fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 -- 172.21.15.33:0/1519871268 shutdown_connections 2024-05-08T20:04:36.591 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.601+0000 7fa22ecd1700 1 -- 172.21.15.33:0/1519871268 wait complete. 2024-05-08T20:04:36.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 Processor -- start 2024-05-08T20:04:36.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 -- start start 2024-05-08T20:04:36.593 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa228196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa228102090 0x7fa228197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa228102a50 0x7fa22819e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22819ea50 con 0x7fa228100eb0 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22819eb90 con 0x7fa228102a50 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ecd1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22819ed20 con 0x7fa228102090 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ca6d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa228196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ca6d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa228196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42540/0 (socket says 172.21.15.33:42540) 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22ca6d700 1 -- 172.21.15.33:0/3904197999 learned_addr learned my addr 172.21.15.33:0/3904197999 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa21ffff700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa228102090 0x7fa228197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.602+0000 7fa22d26e700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa228102a50 0x7fa22819e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ca6d700 1 -- 172.21.15.33:0/3904197999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa228102090 msgr2=0x7fa228197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ca6d700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa228102090 0x7fa228197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.594 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ca6d700 1 -- 172.21.15.33:0/3904197999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa228102a50 msgr2=0x7fa22819e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ca6d700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa228102a50 0x7fa22819e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ca6d700 1 -- 172.21.15.33:0/3904197999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2240095f0 con 0x7fa228100eb0 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ca6d700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa228196f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa224000c00 tx=0x7fa22400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22401d070 con 0x7fa228100eb0 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa22400fdb0 con 0x7fa228100eb0 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22819efa0 con 0x7fa228100eb0 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224017650 con 0x7fa228100eb0 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.603+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22819f310 con 0x7fa228100eb0 2024-05-08T20:04:36.595 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.604+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228108360 con 0x7fa228100eb0 2024-05-08T20:04:36.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.605+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 17) v1 ==== 135924+0+0 (secure 0 0 0) 0x7fa224021410 con 0x7fa228100eb0 2024-05-08T20:04:36.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.606+0000 7fa21dffb700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2100a11b0 0x7fa2100a3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:36.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.606+0000 7fa21ffff700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2100a11b0 0x7fa2100a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:36.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.606+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa224021e40 con 0x7fa228100eb0 2024-05-08T20:04:36.596 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.607+0000 7fa21ffff700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2100a11b0 0x7fa2100a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa228100bd0 tx=0x7fa218009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:36.599 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.610+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fa224097d40 con 0x7fa228100eb0 2024-05-08T20:04:36.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:36 smithi082 ceph-mon[46774]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 16 B/s, 1 objects/s recovering 2024-05-08T20:04:36.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:36 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/574874546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:36.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:36 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/29615317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:36 smithi132 ceph-mon[47484]: pgmap v256: 97 pgs: 97 active+clean; 636 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s; 16 B/s, 1 objects/s recovering 2024-05-08T20:04:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:36 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/574874546' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:04:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:36 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/29615317' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:04:36.879 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:36.889+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa22810c860 con 0x7fa228100eb0 2024-05-08T20:04:37.317 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.327+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7fa224098110 con 0x7fa228100eb0 2024-05-08T20:04:37.318 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.329+0000 7fa21dffb700 1 -- 172.21.15.33:0/3904197999 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa22409b7d0 con 0x7fa228100eb0 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2100a11b0 msgr2=0x7fa2100a3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2100a11b0 0x7fa2100a3670 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa228100bd0 tx=0x7fa218009260 comp rx=0 tx=0).stop 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 msgr2=0x7fa228196f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa228196f20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa224000c00 tx=0x7fa22400f690 comp rx=0 tx=0).stop 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 shutdown_connections 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa228102a50 0x7fa22819e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa228100eb0 0x7fa228196f20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.322 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7fa2100a11b0 0x7fa2100a3670 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 --2- 172.21.15.33:0/3904197999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa228102090 0x7fa228197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.332+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 >> 172.21.15.33:0/3904197999 conn(0x7fa2280fc470 msgr2=0x7fa2281054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.333+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 shutdown_connections 2024-05-08T20:04:37.323 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.333+0000 7fa22ecd1700 1 -- 172.21.15.33:0/3904197999 wait complete. 2024-05-08T20:04:37.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-05-08T20:04:37.483 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 -- 172.21.15.33:0/1933318555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030101990 msgr2=0x7f6030108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 --2- 172.21.15.33:0/1933318555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030101990 0x7f6030108240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6028009920 tx=0x7f6028009c30 comp rx=0 tx=0).stop 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 -- 172.21.15.33:0/1933318555 shutdown_connections 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 --2- 172.21.15.33:0/1933318555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030101990 0x7f6030108240 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 --2- 172.21.15.33:0/1933318555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60300ffe00 0x7f6030100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 --2- 172.21.15.33:0/1933318555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6030100ff0 0x7f6030101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 -- 172.21.15.33:0/1933318555 >> 172.21.15.33:0/1933318555 conn(0x7f60300fb390 msgr2=0x7f60300fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 -- 172.21.15.33:0/1933318555 shutdown_connections 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 -- 172.21.15.33:0/1933318555 wait complete. 2024-05-08T20:04:37.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.494+0000 7f603528a700 1 Processor -- start 2024-05-08T20:04:37.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f603528a700 1 -- start start 2024-05-08T20:04:37.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f603528a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60300ffe00 0x7f6030196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f603528a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030100ff0 0x7f6030197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f603528a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6030101990 0x7f603019e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f603528a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603019eb10 con 0x7f60300ffe00 2024-05-08T20:04:37.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f603528a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603019ec50 con 0x7f6030100ff0 2024-05-08T20:04:37.487 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f603528a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603019ede0 con 0x7f6030101990 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60300ffe00 0x7f6030196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60300ffe00 0x7f6030196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42584/0 (socket says 172.21.15.33:42584) 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602effd700 1 -- 172.21.15.33:0/2411149840 learned_addr learned my addr 172.21.15.33:0/2411149840 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602e7fc700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030100ff0 0x7f6030197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602f7fe700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6030101990 0x7f603019e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602e7fc700 1 -- 172.21.15.33:0/2411149840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6030101990 msgr2=0x7f603019e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602e7fc700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6030101990 0x7f603019e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602e7fc700 1 -- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60300ffe00 msgr2=0x7f6030196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602e7fc700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60300ffe00 0x7f6030196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.495+0000 7f602e7fc700 1 -- 172.21.15.33:0/2411149840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6028009520 con 0x7f6030100ff0 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.496+0000 7f602e7fc700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030100ff0 0x7f6030197520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f602400e9f0 tx=0x7f602400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.496+0000 7f6017fff700 1 -- 172.21.15.33:0/2411149840 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400c9c0 con 0x7f6030100ff0 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.496+0000 7f6017fff700 1 -- 172.21.15.33:0/2411149840 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6024010430 con 0x7f6030100ff0 2024-05-08T20:04:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.496+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603019f0c0 con 0x7f6030100ff0 2024-05-08T20:04:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.496+0000 7f6017fff700 1 -- 172.21.15.33:0/2411149840 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024018680 con 0x7f6030100ff0 2024-05-08T20:04:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.496+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603019f620 con 0x7f6030100ff0 2024-05-08T20:04:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.497+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6030067e30 con 0x7f6030100ff0 2024-05-08T20:04:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.498+0000 7f6017fff700 1 -- 172.21.15.33:0/2411149840 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7f6024010910 con 0x7f6030100ff0 2024-05-08T20:04:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.498+0000 7f6017fff700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 0x7f60180a3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.499+0000 7f602effd700 1 -- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 msgr2=0x7f60180a3740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3089330166 2024-05-08T20:04:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.499+0000 7f6017fff700 1 -- 172.21.15.33:0/2411149840 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6024014070 con 0x7f6030100ff0 2024-05-08T20:04:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.499+0000 7f602effd700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 0x7f60180a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:04:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.502+0000 7f6017fff700 1 -- 172.21.15.33:0/2411149840 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f60240961b0 con 0x7f6030100ff0 2024-05-08T20:04:37.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:37 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3904197999' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-08T20:04:37.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:37 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: ignoring --setuser ceph since I am not root 2024-05-08T20:04:37.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:37 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: ignoring --setgroup ceph since I am not root 2024-05-08T20:04:37.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:37 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3904197999' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-08T20:04:37.622 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: ignoring --setuser ceph since I am not root 2024-05-08T20:04:37.622 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: ignoring --setgroup ceph since I am not root 2024-05-08T20:04:37.622 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:37 smithi082 ceph-mgr[48276]: -- 172.21.15.82:0/3713586280 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fa198a21a0 con 0x55fa19878800 2024-05-08T20:04:37.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:37 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3904197999' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-08T20:04:37.625 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: ignoring --setuser ceph since I am not root 2024-05-08T20:04:37.625 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: ignoring --setgroup ceph since I am not root 2024-05-08T20:04:37.625 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:37 smithi132 ceph-mgr[49372]: -- 172.21.15.132:0/715195162 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5625afb8a1a0 con 0x5625afb61000 2024-05-08T20:04:37.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.700+0000 7f602effd700 1 -- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 msgr2=0x7f60180a3740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3089330166 2024-05-08T20:04:37.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.700+0000 7f602effd700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 0x7f60180a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:04:37.710 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.721+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f603010b7b0 con 0x7f6030100ff0 2024-05-08T20:04:37.718 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.729+0000 7f6017fff700 1 -- 172.21.15.33:0/2411149840 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v28)=0 v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f60240105a0 con 0x7f6030100ff0 2024-05-08T20:04:37.720 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 msgr2=0x7f60180a3740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 0x7f60180a3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030100ff0 msgr2=0x7f6030197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030100ff0 0x7f6030197520 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f602400e9f0 tx=0x7f602400ed00 comp rx=0 tx=0).stop 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 shutdown_connections 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f60180a1280 0x7f60180a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6030101990 0x7f603019e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60300ffe00 0x7f6030196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 --2- 172.21.15.33:0/2411149840 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6030100ff0 0x7f6030197520 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 >> 172.21.15.33:0/2411149840 conn(0x7f60300fb390 msgr2=0x7f60300fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 shutdown_connections 2024-05-08T20:04:37.721 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.731+0000 7f603528a700 1 -- 172.21.15.33:0/2411149840 wait complete. 2024-05-08T20:04:37.735 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-05-08T20:04:37.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 -- 172.21.15.33:0/501920535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334101890 msgr2=0x7f4334103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.877 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 --2- 172.21.15.33:0/501920535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334101890 0x7f4334103c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f43240098f0 tx=0x7f4324009c00 comp rx=0 tx=0).stop 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 -- 172.21.15.33:0/501920535 shutdown_connections 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 --2- 172.21.15.33:0/501920535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4334106af0 0x7f4334108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 --2- 172.21.15.33:0/501920535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334101890 0x7f4334103c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 --2- 172.21.15.33:0/501920535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43341041c0 0x7f43341065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 -- 172.21.15.33:0/501920535 >> 172.21.15.33:0/501920535 conn(0x7f43340fb2a0 msgr2=0x7f43340fd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 -- 172.21.15.33:0/501920535 shutdown_connections 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.887+0000 7f433a14e700 1 -- 172.21.15.33:0/501920535 wait complete. 2024-05-08T20:04:37.878 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.888+0000 7f433a14e700 1 Processor -- start 2024-05-08T20:04:37.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.888+0000 7f433a14e700 1 -- start start 2024-05-08T20:04:37.880 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f433a14e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4334101890 0x7f4334196e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f433a14e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43341041c0 0x7f4334197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f433a14e700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334106af0 0x7f433419e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f433a14e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433419e940 con 0x7f43341041c0 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f433a14e700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433419ea80 con 0x7f4334106af0 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f433a14e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433419ec10 con 0x7f4334101890 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43341041c0 0x7f4334197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f43337fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4334101890 0x7f4334196e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43341041c0 0x7f4334197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42600/0 (socket says 172.21.15.33:42600) 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 -- 172.21.15.33:0/3741151157 learned_addr learned my addr 172.21.15.33:0/3741151157 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4333fff700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334106af0 0x7f433419e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 -- 172.21.15.33:0/3741151157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4334101890 msgr2=0x7f4334196e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4334101890 0x7f4334196e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 -- 172.21.15.33:0/3741151157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334106af0 msgr2=0x7f433419e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:37.881 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334106af0 0x7f433419e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 -- 172.21.15.33:0/3741151157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009d00 con 0x7f43341041c0 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4332ffd700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43341041c0 0x7f4334197350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f432800e9a0 tx=0x7f432800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.889+0000 7f4330ff9700 1 -- 172.21.15.33:0/3741151157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328009790 con 0x7f43341041c0 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.890+0000 7f4330ff9700 1 -- 172.21.15.33:0/3741151157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4328010430 con 0x7f43341041c0 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.890+0000 7f4330ff9700 1 -- 172.21.15.33:0/3741151157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4328018680 con 0x7f43341041c0 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.890+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4324009520 con 0x7f43341041c0 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.890+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433419f210 con 0x7f43341041c0 2024-05-08T20:04:37.882 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.891+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43340fce20 con 0x7f43341041c0 2024-05-08T20:04:37.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.892+0000 7f4330ff9700 1 -- 172.21.15.33:0/3741151157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7f4328010910 con 0x7f43341041c0 2024-05-08T20:04:37.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.892+0000 7f4330ff9700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 0x7f431c0a3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:37.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.892+0000 7f43337fe700 1 -- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 msgr2=0x7f431c0a3730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3089330166 2024-05-08T20:04:37.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.893+0000 7f4330ff9700 1 -- 172.21.15.33:0/3741151157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4328014070 con 0x7f43341041c0 2024-05-08T20:04:37.883 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.893+0000 7f43337fe700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 0x7f431c0a3730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:04:37.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:37.897+0000 7f4330ff9700 1 -- 172.21.15.33:0/3741151157 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4328052d60 con 0x7f43341041c0 2024-05-08T20:04:38.020 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:37.765+0000 7fe2d95f9200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:04:38.020 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:37.857+0000 7fe2d95f9200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:04:38.020 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:37.945+0000 7fe2d95f9200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:04:38.020 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:38.030+0000 7fe2d95f9200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:04:38.023 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:37.767+0000 7f299e8dc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:04:38.024 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:37.860+0000 7f299e8dc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:04:38.024 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:37.948+0000 7f299e8dc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:04:38.024 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:38.034+0000 7f299e8dc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:04:38.027 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:37 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:37.829+0000 7f7e82234200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T20:04:38.027 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:37 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:37.937+0000 7f7e82234200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T20:04:38.028 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:38 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:38.038+0000 7f7e82234200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T20:04:38.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.094+0000 7f43337fe700 1 -- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 msgr2=0x7f431c0a3730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3089330166 2024-05-08T20:04:38.083 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.094+0000 7f43337fe700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 0x7f431c0a3730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:04:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.117+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f433410c7c0 con 0x7f43341041c0 2024-05-08T20:04:38.113 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.122+0000 7f4330ff9700 1 -- 172.21.15.33:0/3741151157 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v29)=0 v29) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4328099d50 con 0x7f43341041c0 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 msgr2=0x7f431c0a3730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 0x7f431c0a3730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43341041c0 msgr2=0x7f4334197350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43341041c0 0x7f4334197350 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f432800e9a0 tx=0x7f432800ecb0 comp rx=0 tx=0).stop 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 shutdown_connections 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4334106af0 0x7f433419e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f431c0a1270 0x7f431c0a3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4334101890 0x7f4334196e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 --2- 172.21.15.33:0/3741151157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f43341041c0 0x7f4334197350 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.124+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 >> 172.21.15.33:0/3741151157 conn(0x7f43340fb2a0 msgr2=0x7f4334102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.125+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 shutdown_connections 2024-05-08T20:04:38.115 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:38.125+0000 7f433a14e700 1 -- 172.21.15.33:0/3741151157 wait complete. 2024-05-08T20:04:38.128 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T20:04:38.151 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T20:04:38.151 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-08T20:04:38.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:38.151 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T20:04:38.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:38.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-05-08T20:04:38.247 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2024-05-08T20:04:38.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:04:38.249 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-05-08T20:04:38.249 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T20:04:38.249 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:38.249 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-08T20:04:38.310 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:38 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:38.135+0000 7f7e82234200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T20:04:38.549 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:04:38.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:38 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3904197999' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-08T20:04:38.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:38 smithi033 ceph-mon[42490]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-05-08T20:04:38.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:38 smithi033 ceph-mon[42490]: from='client.? ' entity='client.admin' 2024-05-08T20:04:38.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:38 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3741151157' entity='client.admin' 2024-05-08T20:04:38.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:38 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3904197999' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-08T20:04:38.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:38 smithi082 ceph-mon[46774]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-05-08T20:04:38.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:38 smithi082 ceph-mon[46774]: from='client.? ' entity='client.admin' 2024-05-08T20:04:38.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:38 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3741151157' entity='client.admin' 2024-05-08T20:04:38.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:38 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3904197999' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-08T20:04:38.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:38 smithi132 ceph-mon[47484]: mgrmap e18: x(active, since 6m), standbys: z, y 2024-05-08T20:04:38.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:38 smithi132 ceph-mon[47484]: from='client.? ' entity='client.admin' 2024-05-08T20:04:38.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:38 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3741151157' entity='client.admin' 2024-05-08T20:04:38.903 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:38.662+0000 7f299e8dc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:04:38.904 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:38.662+0000 7fe2d95f9200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:04:38.983 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:38 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:38.897+0000 7f7e82234200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:04:39.257 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:38.914+0000 7f299e8dc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:04:39.257 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:39.000+0000 7f299e8dc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:04:39.258 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:39.111+0000 7f299e8dc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:04:39.258 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:39.268+0000 7f299e8dc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:04:39.260 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:38.914+0000 7fe2d95f9200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:04:39.260 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:39.001+0000 7fe2d95f9200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:04:39.260 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:39.112+0000 7fe2d95f9200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:04:39.260 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:39.271+0000 7fe2d95f9200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:04:39.289 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:39 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:39.188+0000 7f7e82234200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 -- 172.21.15.33:0/2596389317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b780692f0 msgr2=0x7f7b7810de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 --2- 172.21.15.33:0/2596389317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b780692f0 0x7f7b7810de60 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000b0a0 tx=0x7f7b7000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 -- 172.21.15.33:0/2596389317 shutdown_connections 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 --2- 172.21.15.33:0/2596389317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b780692f0 0x7f7b7810de60 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 --2- 172.21.15.33:0/2596389317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78107020 0x7f7b78107400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 --2- 172.21.15.33:0/2596389317 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 0x7f7b78068db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 -- 172.21.15.33:0/2596389317 >> 172.21.15.33:0/2596389317 conn(0x7f7b78075f80 msgr2=0x7f7b78076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 -- 172.21.15.33:0/2596389317 shutdown_connections 2024-05-08T20:04:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.561+0000 7f7b806f4700 1 -- 172.21.15.33:0/2596389317 wait complete. 2024-05-08T20:04:39.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.562+0000 7f7b806f4700 1 Processor -- start 2024-05-08T20:04:39.553 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.562+0000 7f7b806f4700 1 -- start start 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b806f4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 0x7f7b781975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b806f4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b780692f0 0x7f7b78197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b806f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b78107020 0x7f7b7819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b806f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7819c4a0 con 0x7f7b78107020 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b806f4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7819c610 con 0x7f7b78068950 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b806f4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7819c7d0 con 0x7f7b780692f0 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7e490700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 0x7f7b781975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b78107020 0x7f7b7819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7dc8f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b780692f0 0x7f7b78197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7e490700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 0x7f7b781975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:46226/0 (socket says 172.21.15.33:46226) 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b78107020 0x7f7b7819be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42626/0 (socket says 172.21.15.33:42626) 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7e490700 1 -- 172.21.15.33:0/3690269914 learned_addr learned my addr 172.21.15.33:0/3690269914 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 -- 172.21.15.33:0/3690269914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b780692f0 msgr2=0x7f7b78197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b780692f0 0x7f7b78197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 -- 172.21.15.33:0/3690269914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 msgr2=0x7f7b781975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 0x7f7b781975a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 -- 172.21.15.33:0/3690269914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b70009d00 con 0x7f7b78107020 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7e490700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 0x7f7b781975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7dc8f700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b780692f0 0x7f7b78197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.563+0000 7f7b7ec91700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b78107020 0x7f7b7819be90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000b0a0 tx=0x7f7b7000bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.564+0000 7f7b6f7fe700 1 -- 172.21.15.33:0/3690269914 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7000e040 con 0x7f7b78107020 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.564+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7819ca50 con 0x7f7b78107020 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.564+0000 7f7b6f7fe700 1 -- 172.21.15.33:0/3690269914 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7b70004e60 con 0x7f7b78107020 2024-05-08T20:04:39.555 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.564+0000 7f7b6f7fe700 1 -- 172.21.15.33:0/3690269914 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70005040 con 0x7f7b78107020 2024-05-08T20:04:39.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.564+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b781a4310 con 0x7f7b78107020 2024-05-08T20:04:39.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.565+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b78109540 con 0x7f7b78107020 2024-05-08T20:04:39.556 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.567+0000 7f7b6f7fe700 1 -- 172.21.15.33:0/3690269914 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 18) v1 ==== 135941+0+0 (secure 0 0 0) 0x7f7b7001d600 con 0x7f7b78107020 2024-05-08T20:04:39.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.568+0000 7f7b6f7fe700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 0x7f7b640a36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:39.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.568+0000 7f7b7e490700 1 -- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 msgr2=0x7f7b640a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3089330166 2024-05-08T20:04:39.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.568+0000 7f7b6f7fe700 1 -- 172.21.15.33:0/3690269914 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7b700ce340 con 0x7f7b78107020 2024-05-08T20:04:39.557 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.568+0000 7f7b7e490700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 0x7f7b640a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T20:04:39.560 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.571+0000 7f7b6f7fe700 1 -- 172.21.15.33:0/3690269914 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f7b700979e0 con 0x7f7b78107020 2024-05-08T20:04:39.570 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:39 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:39.299+0000 7f7e82234200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T20:04:39.571 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:39 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:39.432+0000 7f7e82234200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T20:04:39.621 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:39.396+0000 7f299e8dc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:04:39.621 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:39.481+0000 7f299e8dc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:04:39.623 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:39.399+0000 7fe2d95f9200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:04:39.624 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:39.484+0000 7fe2d95f9200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:04:39.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.769+0000 7f7b7e490700 1 -- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 msgr2=0x7f7b640a36c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.33:6800/3089330166 2024-05-08T20:04:39.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.769+0000 7f7b7e490700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 0x7f7b640a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T20:04:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.834+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b781026d0 con 0x7f7b78107020 2024-05-08T20:04:39.824 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.834+0000 7f7b6f7fe700 1 -- 172.21.15.33:0/3690269914 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7b700074e0 con 0x7f7b78107020 2024-05-08T20:04:39.825 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T20:04:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 msgr2=0x7f7b640a36c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T20:04:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 0x7f7b640a36c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b78107020 msgr2=0x7f7b7819be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:39.827 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b78107020 0x7f7b7819be90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000b0a0 tx=0x7f7b7000bdb0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 shutdown_connections 2024-05-08T20:04:39.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b78107020 0x7f7b7819be90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b78068950 0x7f7b781975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.828 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.33:6800/3089330166,v1:172.21.15.33:6801/3089330166] conn(0x7f7b640a1200 0x7f7b640a36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 --2- 172.21.15.33:0/3690269914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b780692f0 0x7f7b78197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 >> 172.21.15.33:0/3690269914 conn(0x7f7b78075f80 msgr2=0x7f7b780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 shutdown_connections 2024-05-08T20:04:39.829 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:39.837+0000 7f7b806f4700 1 -- 172.21.15.33:0/3690269914 wait complete. 2024-05-08T20:04:39.875 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:39 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:39.619+0000 7f7e82234200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T20:04:39.876 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:39 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:39.766+0000 7f7e82234200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T20:04:39.876 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:39 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:39.865+0000 7f7e82234200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T20:04:40.121 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:39 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3690269914' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T20:04:40.122 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:39.849+0000 7f299e8dc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:04:40.123 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:39 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3690269914' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T20:04:40.124 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:39.856+0000 7fe2d95f9200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:04:40.153 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:39 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3690269914' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T20:04:40.199 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T20:04:40.199 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T20:04:40.200 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2024-05-08T20:04:40.200 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T20:04:40.200 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:40.200 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T20:04:40.200 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T20:04:40.200 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T20:04:40.200 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:04:40.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.200 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2024-05-08T20:04:40.260 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2024-05-08T20:04:40.261 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 41793sec preferred_lft 41793sec 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2024-05-08T20:04:40.262 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2024-05-08T20:04:40.262 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T20:04:40.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.263 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-05-08T20:04:40.263 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T20:04:40.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2024-05-08T20:04:40.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2024-05-08T20:04:40.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2024-05-08T20:04:40.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T20:04:40.263 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T20:04:40.406 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:40 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:40.302+0000 7f7e82234200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T20:04:40.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.439 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T20:04:40.475 INFO:teuthology.orchestra.run.smithi033.stdout:1 2024-05-08T20:04:40.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.477 DEBUG:teuthology.orchestra.run.smithi033:> route 2024-05-08T20:04:40.519 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:40.240+0000 7f299e8dc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:04:40.520 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:40.437+0000 7f299e8dc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T20:04:40.520 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:40.530+0000 7f299e8dc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:04:40.528 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:40.249+0000 7fe2d95f9200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:04:40.529 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:40.445+0000 7fe2d95f9200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T20:04:40.529 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:40.539+0000 7fe2d95f9200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:04:40.559 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2024-05-08T20:04:40.559 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T20:04:40.559 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-08T20:04:40.559 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-08T20:04:40.559 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T20:04:40.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.560 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-05-08T20:04:40.560 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T20:04:40.560 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-08T20:04:40.560 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-08T20:04:40.560 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-08T20:04:40.560 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T20:04:40.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.804 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T20:04:40.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.824 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2024-05-08T20:04:40.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.883 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-05-08T20:04:40.883 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T20:04:40.883 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T20:04:40.883 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-08T20:04:40.883 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T20:04:40.971 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:40 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:40.772+0000 7f7e82234200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T20:04:40.990 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-08T20:04:40.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-08T20:04:40.991 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T20:04:41.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:41.217 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2024-05-08T20:04:41.217 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2024-05-08T20:04:41.217 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2024-05-08T20:04:41.217 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T20:04:41.218 DEBUG:teuthology.orchestra.run.smithi033:> ') 2024-05-08T20:04:41.260 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:41 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:41.018+0000 7f7e82234200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T20:04:41.261 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:41 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:41.136+0000 7f7e82234200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T20:04:41.324 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:04:41.324 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:41.382 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-08T20:04:41.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T20:04:41.383 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:41.442 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-08T20:04:41.443 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-08T20:04:41.443 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/a3c000e4-52ed-41ab-926f-9c8c87e10ba4 2024-05-08T20:04:41.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:41.443 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/a3c000e4-52ed-41ab-926f-9c8c87e10ba4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-08T20:04:41.535 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-08T20:04:41.535 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-08T20:04:41.535 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-05-08T20:04:41.621 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:41.295+0000 7f299e8dc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:04:41.621 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:41.391+0000 7f299e8dc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:04:41.621 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:41.539+0000 7f299e8dc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:04:41.623 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2024-05-08T20:04:41.623 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2024-05-08T20:04:41.624 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2024-05-08T20:04:41.624 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.82:3300,172.21.15.132:3300" 2024-05-08T20:04:41.624 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:3300,172.21.15.82:3300,172.21.15.132:3300:/volumes/qa/sv_1/a3c000e4-52ed-41ab-926f-9c8c87e10ba4 2024-05-08T20:04:41.624 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=0ee61dd4-0d75-11ef-bc97-c7b262605968" will pass to kernel 2024-05-08T20:04:41.624 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:41.307+0000 7fe2d95f9200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:04:41.624 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:41.404+0000 7fe2d95f9200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:04:41.624 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:41.552+0000 7fe2d95f9200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:04:41.628 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T20:04:41.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:41.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:42.300 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:42 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:42.030+0000 7f7e82234200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T20:04:42.300 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:42 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:42.140+0000 7f7e82234200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T20:04:42.536 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:42 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:42.169+0000 7f299e8dc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T20:04:42.536 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:42 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:42.352+0000 7f299e8dc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:04:42.536 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:42 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:42.546+0000 7f299e8dc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:04:42.556 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:42.189+0000 7fe2d95f9200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T20:04:42.556 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:42.372+0000 7fe2d95f9200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:04:42.556 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:42.566+0000 7fe2d95f9200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:04:42.570 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:42 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:42.310+0000 7f7e82234200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T20:04:43.320 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:43 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:43.035+0000 7f7e82234200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T20:04:43.321 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:43 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:43.245+0000 7f7e82234200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T20:04:43.751 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:43 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:43.476+0000 7f299e8dc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:04:43.773 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:43.499+0000 7fe2d95f9200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:04:43.820 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:43 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:43.469+0000 7f7e82234200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T20:04:44.029 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:43 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:43.762+0000 7f299e8dc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:04:44.029 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:43 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:43.850+0000 7f299e8dc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:04:44.052 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:43.784+0000 7fe2d95f9200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:04:44.052 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:43.873+0000 7fe2d95f9200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:04:44.052 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:04:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z[49349]: 2024-05-08T20:04:44.063+0000 7fe2d95f9200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:04:44.371 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:04:44 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y[48253]: 2024-05-08T20:04:44.039+0000 7f299e8dc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: Standby manager daemon y restarted 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: Standby manager daemon y started 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: Standby manager daemon z restarted 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: Standby manager daemon z started 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T20:04:44.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:44 smithi082 ceph-mon[46774]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: Standby manager daemon y restarted 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: Standby manager daemon y started 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: Standby manager daemon z restarted 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: Standby manager daemon z started 2024-05-08T20:04:44.374 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T20:04:44.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T20:04:44.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T20:04:44.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:44 smithi132 ceph-mon[47484]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T20:04:44.530 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: Standby manager daemon y restarted 2024-05-08T20:04:44.530 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: Standby manager daemon y started 2024-05-08T20:04:44.530 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T20:04:44.530 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.82:0/2782764647' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: Standby manager daemon z restarted 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: Standby manager daemon z started 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T20:04:44.531 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:44 smithi033 ceph-mon[42490]: from='mgr.? 172.21.15.132:0/2752444947' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T20:04:44.820 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:44 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:44.540+0000 7f7e82234200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T20:04:45.187 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:45 smithi033 ceph-mon[42490]: mgrmap e19: x(active, since 6m), standbys: z, y 2024-05-08T20:04:45.188 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:44 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:44.873+0000 7f7e82234200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T20:04:45.188 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:44 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:44.975+0000 7f7e82234200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T20:04:45.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:45.269 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T20:04:45.307 INFO:teuthology.orchestra.run.smithi033.stdout:client25114 2024-05-08T20:04:45.308 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T20:04:45.308 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:04:45.371 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:45 smithi082 ceph-mon[46774]: mgrmap e19: x(active, since 6m), standbys: z, y 2024-05-08T20:04:45.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:45.374 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T20:04:45.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:45 smithi132 ceph-mon[47484]: mgrmap e19: x(active, since 6m), standbys: z, y 2024-05-08T20:04:45.460 INFO:teuthology.orchestra.run.smithi033.stdout:client25114 2024-05-08T20:04:45.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:45.461 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T20:04:45.508 INFO:teuthology.orchestra.run.smithi033.stdout:client25114 2024-05-08T20:04:45.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:04:45.508 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968.client25114/status') 2024-05-08T20:04:45.528 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.199+0000 7f7e82234200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T20:04:45.570 INFO:teuthology.orchestra.run.smithi033.stdout:instance: client.25114 (3)172.21.15.33:0/3740326350 2024-05-08T20:04:45.570 INFO:teuthology.orchestra.run.smithi033.stdout:blocklisted: false 2024-05-08T20:04:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records in 2024-05-08T20:04:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:0+1 records out 2024-05-08T20:04:45.570 INFO:teuthology.orchestra.run.smithi033.stderr:71 bytes copied, 2.5361e-05 s, 2.8 MB/s 2024-05-08T20:04:45.572 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T20:04:45.586 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T20:04:45.586 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:04:45.587 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 -- 172.21.15.33:0/1663287679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a8101980 msgr2=0x7f44a8103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1663287679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a8101980 0x7f44a8103d70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4498009990 tx=0x7f4498009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 -- 172.21.15.33:0/1663287679 shutdown_connections 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1663287679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8106be0 0x7f44a8109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1663287679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a8101980 0x7f44a8103d70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1663287679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a81042b0 0x7f44a81066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 -- 172.21.15.33:0/1663287679 >> 172.21.15.33:0/1663287679 conn(0x7f44a80fb390 msgr2=0x7f44a80fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 -- 172.21.15.33:0/1663287679 shutdown_connections 2024-05-08T20:04:45.756 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.767+0000 7f44ae92a700 1 -- 172.21.15.33:0/1663287679 wait complete. 2024-05-08T20:04:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 Processor -- start 2024-05-08T20:04:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 -- start start 2024-05-08T20:04:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8101980 0x7f44a8101250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:45.758 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a81042b0 0x7f44a80ff930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a8106be0 0x7f44a80ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a8100570 con 0x7f44a81042b0 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a81006e0 con 0x7f44a8101980 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.768+0000 7f44ae92a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a81a1040 con 0x7f44a8106be0 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8101980 0x7f44a8101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8101980 0x7f44a8101250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:36756/0 (socket says 172.21.15.33:36756) 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 -- 172.21.15.33:0/1800060909 learned_addr learned my addr 172.21.15.33:0/1800060909 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a77fe700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a81042b0 0x7f44a80ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44acec7700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a8106be0 0x7f44a80ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 -- 172.21.15.33:0/1800060909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a8106be0 msgr2=0x7f44a80ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a8106be0 0x7f44a80ffe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 -- 172.21.15.33:0/1800060909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a81042b0 msgr2=0x7f44a80ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:45.759 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a81042b0 0x7f44a80ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 -- 172.21.15.33:0/1800060909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44980095f0 con 0x7f44a8101980 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44acec7700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a8106be0 0x7f44a80ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a7fff700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8101980 0x7f44a8101250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44980047e0 tx=0x7f4498005e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a57fa700 1 -- 172.21.15.33:0/1800060909 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449801d070 con 0x7f44a8101980 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.769+0000 7f44a57fa700 1 -- 172.21.15.33:0/1800060909 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4498004810 con 0x7f44a8101980 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.770+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a81a1240 con 0x7f44a8101980 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.770+0000 7f44a57fa700 1 -- 172.21.15.33:0/1800060909 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44980055b0 con 0x7f44a8101980 2024-05-08T20:04:45.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.770+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a81a1690 con 0x7f44a8101980 2024-05-08T20:04:45.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.771+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a80fcf10 con 0x7f44a8101980 2024-05-08T20:04:45.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.773+0000 7f44a57fa700 1 -- 172.21.15.33:0/1800060909 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) v1 ==== 135558+0+0 (secure 0 0 0) 0x7f4498004980 con 0x7f44a8101980 2024-05-08T20:04:45.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.774+0000 7f44a57fa700 1 -- 172.21.15.33:0/1800060909 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f44980cd5d0 con 0x7f44a8101980 2024-05-08T20:04:45.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:45.778+0000 7f44a57fa700 1 -- 172.21.15.33:0/1800060909 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f44980970a0 con 0x7f44a8101980 2024-05-08T20:04:45.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.546+0000 7f7de1d43700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.546+0000 7f7de1d43700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.546+0000 7f7de1d43700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.546+0000 7f7de1d43700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.821 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.546+0000 7f7de1d43700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.552+0000 7f7de4d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.552+0000 7f7de4d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.552+0000 7f7de4d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.552+0000 7f7de4d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:45.822 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:45 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:45.552+0000 7f7de4d49700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:46.070 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.082+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) v1 -- 0x7f44a8067e30 con 0x7f44a8101980 2024-05-08T20:04:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.222+0000 7f44a57fa700 1 -- 172.21.15.33:0/1800060909 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7f449809a6c0 con 0x7f44a8101980 2024-05-08T20:04:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.226+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8101980 msgr2=0x7f44a8101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.226+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8101980 0x7f44a8101250 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44980047e0 tx=0x7f4498005e30 comp rx=0 tx=0).stop 2024-05-08T20:04:46.215 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.227+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 shutdown_connections 2024-05-08T20:04:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.227+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a8106be0 0x7f44a80ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.227+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a8101980 0x7f44a8101250 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.227+0000 7f44ae92a700 1 --2- 172.21.15.33:0/1800060909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a81042b0 0x7f44a80ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.227+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 >> 172.21.15.33:0/1800060909 conn(0x7f44a80fb390 msgr2=0x7f44a8102220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.227+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 shutdown_connections 2024-05-08T20:04:46.216 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.227+0000 7f44ae92a700 1 -- 172.21.15.33:0/1800060909 wait complete. 2024-05-08T20:04:46.242 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: Active manager daemon x restarted 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: Activating manager daemon x 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: mgrmap e20: x(active, starting, since 0.0147136s), standbys: z, y 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T20:04:46.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T20:04:46.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:04:46.374 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:04:46.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:04:46.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:04:46.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:04:46.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:04:46.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T20:04:46.375 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T20:04:46.376 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T20:04:46.376 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: Manager daemon x is now available 2024-05-08T20:04:46.376 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:46.376 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T20:04:46.376 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T20:04:46.377 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1800060909' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T20:04:46.377 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:46 smithi082 ceph-mon[46774]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T20:04:46.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: Active manager daemon x restarted 2024-05-08T20:04:46.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: Activating manager daemon x 2024-05-08T20:04:46.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T20:04:46.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: mgrmap e20: x(active, starting, since 0.0147136s), standbys: z, y 2024-05-08T20:04:46.378 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:04:46.379 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:04:46.379 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:04:46.379 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T20:04:46.379 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T20:04:46.379 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T20:04:46.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T20:04:46.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T20:04:46.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T20:04:46.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:04:46.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:04:46.380 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:04:46.381 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:04:46.381 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:04:46.381 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:04:46.381 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T20:04:46.381 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T20:04:46.381 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T20:04:46.382 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T20:04:46.382 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:04:46.382 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:04:46.382 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:04:46.382 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:04:46.382 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:04:46.382 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: Manager daemon x is now available 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T20:04:46.383 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T20:04:46.384 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1800060909' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T20:04:46.384 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:46 smithi132 ceph-mon[47484]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T20:04:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 -- 172.21.15.33:0/4191493070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194101980 msgr2=0x7f6194103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 --2- 172.21.15.33:0/4191493070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194101980 0x7f6194103d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6190009990 tx=0x7f6190009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 -- 172.21.15.33:0/4191493070 shutdown_connections 2024-05-08T20:04:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 --2- 172.21.15.33:0/4191493070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194106be0 0x7f6194109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 --2- 172.21.15.33:0/4191493070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194101980 0x7f6194103d70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 --2- 172.21.15.33:0/4191493070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61941042b0 0x7f61941066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 -- 172.21.15.33:0/4191493070 >> 172.21.15.33:0/4191493070 conn(0x7f61940fb390 msgr2=0x7f61940fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 -- 172.21.15.33:0/4191493070 shutdown_connections 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.398+0000 7f619bb2a700 1 -- 172.21.15.33:0/4191493070 wait complete. 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 Processor -- start 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 -- start start 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194101980 0x7f6194196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61941042b0 0x7f6194197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194106be0 0x7f619419e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619419ea20 con 0x7f6194106be0 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619419eb60 con 0x7f61941042b0 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619bb2a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619419ecf0 con 0x7f6194101980 2024-05-08T20:04:46.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619a0c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194106be0 0x7f619419e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f61990c5700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61941042b0 0x7f6194197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619a0c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194106be0 0x7f619419e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57744/0 (socket says 172.21.15.33:57744) 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f619a0c7700 1 -- 172.21.15.33:0/2794991053 learned_addr learned my addr 172.21.15.33:0/2794991053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.399+0000 7f61998c6700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194101980 0x7f6194196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619a0c7700 1 -- 172.21.15.33:0/2794991053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194101980 msgr2=0x7f6194196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619a0c7700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194101980 0x7f6194196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619a0c7700 1 -- 172.21.15.33:0/2794991053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61941042b0 msgr2=0x7f6194197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619a0c7700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61941042b0 0x7f6194197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.392 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619a0c7700 1 -- 172.21.15.33:0/2794991053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61900095f0 con 0x7f6194106be0 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f61990c5700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61941042b0 0x7f6194197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619a0c7700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194106be0 0x7f619419e450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f618c00ef30 tx=0x7f618c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f618affd700 1 -- 172.21.15.33:0/2794991053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c018070 con 0x7f6194106be0 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619419ef70 con 0x7f6194106be0 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f618affd700 1 -- 172.21.15.33:0/2794991053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f618c00f040 con 0x7f6194106be0 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f618affd700 1 -- 172.21.15.33:0/2794991053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618c00cd00 con 0x7f6194106be0 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.400+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619419f3f0 con 0x7f6194106be0 2024-05-08T20:04:46.393 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.401+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61940fcf10 con 0x7f6194106be0 2024-05-08T20:04:46.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.402+0000 7f618affd700 1 -- 172.21.15.33:0/2794991053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7f618c003a00 con 0x7f6194106be0 2024-05-08T20:04:46.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.403+0000 7f618affd700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f61800a0f20 0x7f61800a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.395 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.403+0000 7f618affd700 1 -- 172.21.15.33:0/2794991053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f618c0cc160 con 0x7f6194106be0 2024-05-08T20:04:46.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.403+0000 7f61998c6700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f61800a0f20 0x7f61800a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.404+0000 7f61998c6700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f61800a0f20 0x7f61800a33e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f619000b2e0 tx=0x7f6190005fb0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:46.396 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.408+0000 7f618affd700 1 -- 172.21.15.33:0/2794991053 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f618c095b20 con 0x7f6194106be0 2024-05-08T20:04:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: Active manager daemon x restarted 2024-05-08T20:04:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: Activating manager daemon x 2024-05-08T20:04:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T20:04:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: mgrmap e20: x(active, starting, since 0.0147136s), standbys: z, y 2024-05-08T20:04:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T20:04:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T20:04:46.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T20:04:46.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T20:04:46.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: Manager daemon x is now available 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1800060909' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T20:04:46.574 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:46 smithi033 ceph-mon[42490]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T20:04:46.665 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.677+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 --> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) v1 -- 0x7f619402cf50 con 0x7f61800a0f20 2024-05-08T20:04:46.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.697+0000 7f618affd700 1 -- 172.21.15.33:0/2794991053 <== mgr.15264 v2:172.21.15.33:6800/1417363085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3 (secure 0 0 0) 0x7f619402cf50 con 0x7f61800a0f20 2024-05-08T20:04:46.685 INFO:teuthology.orchestra.run.smithi033.stdout:{} 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f61800a0f20 msgr2=0x7f61800a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f61800a0f20 0x7f61800a33e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f619000b2e0 tx=0x7f6190005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194106be0 msgr2=0x7f619419e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194106be0 0x7f619419e450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f618c00ef30 tx=0x7f618c00c3a0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 shutdown_connections 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f61800a0f20 0x7f61800a33e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6194106be0 0x7f619419e450 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194101980 0x7f6194196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 --2- 172.21.15.33:0/2794991053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61941042b0 0x7f6194197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 >> 172.21.15.33:0/2794991053 conn(0x7f61940fb390 msgr2=0x7f6194102440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:46.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 shutdown_connections 2024-05-08T20:04:46.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.700+0000 7f619bb2a700 1 -- 172.21.15.33:0/2794991053 wait complete. 2024-05-08T20:04:46.708 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-08T20:04:46.720 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T20:04:46.730 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T20:04:46.730 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:04:46.731 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-05-08T20:04:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 -- 172.21.15.33:0/992676013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00104350 msgr2=0x7f3e00106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 --2- 172.21.15.33:0/992676013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00104350 0x7f3e00106740 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009990 tx=0x7f3df4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 -- 172.21.15.33:0/992676013 shutdown_connections 2024-05-08T20:04:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 --2- 172.21.15.33:0/992676013 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e00106c80 0x7f3e00109070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 --2- 172.21.15.33:0/992676013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e00101a20 0x7f3e00103e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 --2- 172.21.15.33:0/992676013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00104350 0x7f3e00106740 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 -- 172.21.15.33:0/992676013 >> 172.21.15.33:0/992676013 conn(0x7f3e000fb390 msgr2=0x7f3e000fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 -- 172.21.15.33:0/992676013 shutdown_connections 2024-05-08T20:04:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.896+0000 7f3e05838700 1 -- 172.21.15.33:0/992676013 wait complete. 2024-05-08T20:04:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.897+0000 7f3e05838700 1 Processor -- start 2024-05-08T20:04:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.897+0000 7f3e05838700 1 -- start start 2024-05-08T20:04:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3e05838700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00101a20 0x7f3e00101340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3e05838700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e00104350 0x7f3e000ff9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3e05838700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e00106c80 0x7f3e000fff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3e05838700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e001006b0 con 0x7f3e00101a20 2024-05-08T20:04:46.888 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3e05838700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00100820 con 0x7f3e00104350 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3e05838700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e001a1000 con 0x7f3e00106c80 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00101a20 0x7f3e00101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dff7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e00106c80 0x7f3e000fff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00101a20 0x7f3e00101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57778/0 (socket says 172.21.15.33:57778) 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 -- 172.21.15.33:0/272591593 learned_addr learned my addr 172.21.15.33:0/272591593 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfe7fc700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e00104350 0x7f3e000ff9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 -- 172.21.15.33:0/272591593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e00106c80 msgr2=0x7f3e000fff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e00106c80 0x7f3e000fff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 -- 172.21.15.33:0/272591593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e00104350 msgr2=0x7f3e000ff9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e00104350 0x7f3e000ff9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 -- 172.21.15.33:0/272591593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8009c40 con 0x7f3e00101a20 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfe7fc700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e00104350 0x7f3e000ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:46.889 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dff7fe700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e00106c80 0x7f3e000fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.898+0000 7f3dfeffd700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00101a20 0x7f3e00101340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3df000e9a0 tx=0x7f3df000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.899+0000 7f3e04836700 1 -- 172.21.15.33:0/272591593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0009790 con 0x7f3e00101a20 2024-05-08T20:04:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.899+0000 7f3e04836700 1 -- 172.21.15.33:0/272591593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3df000ce40 con 0x7f3e00101a20 2024-05-08T20:04:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.899+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df40095f0 con 0x7f3e00101a20 2024-05-08T20:04:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.899+0000 7f3e04836700 1 -- 172.21.15.33:0/272591593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0018680 con 0x7f3e00101a20 2024-05-08T20:04:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.899+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e001a1660 con 0x7f3e00101a20 2024-05-08T20:04:46.890 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.900+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e000fcf10 con 0x7f3e00101a20 2024-05-08T20:04:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.901+0000 7f3e04836700 1 -- 172.21.15.33:0/272591593 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7f3df00107a0 con 0x7f3e00101a20 2024-05-08T20:04:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.902+0000 7f3e04836700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f3de80a0fa0 0x7f3de80a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.902+0000 7f3e04836700 1 -- 172.21.15.33:0/272591593 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f3df0014070 con 0x7f3e00101a20 2024-05-08T20:04:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.902+0000 7f3dfe7fc700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f3de80a0fa0 0x7f3de80a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:46.891 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.903+0000 7f3dfe7fc700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f3de80a0fa0 0x7f3de80a3460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3df400b2e0 tx=0x7f3df4005fb0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:46.894 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:46.906+0000 7f3e04836700 1 -- 172.21.15.33:0/272591593 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f3df0096260 con 0x7f3e00101a20 2024-05-08T20:04:47.070 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:46.683+0000 7f7dded3d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:47.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:46.683+0000 7f7dded3d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:47.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:46.683+0000 7f7dded3d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:47.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:46.683+0000 7f7dded3d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:47.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:04:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:04:46.683+0000 7f7dded3d700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:04:47.196 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.208+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 --> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e000613e0 con 0x7f3de80a0fa0 2024-05-08T20:04:47.266 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.278+0000 7f3e04836700 1 -- 172.21.15.33:0/272591593 <== mgr.15264 v2:172.21.15.33:6800/1417363085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3e000613e0 con 0x7f3de80a0fa0 2024-05-08T20:04:47.267 INFO:teuthology.orchestra.run.smithi033.stdout:Schedule set for path / 2024-05-08T20:04:47.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f3de80a0fa0 msgr2=0x7f3de80a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f3de80a0fa0 0x7f3de80a3460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3df400b2e0 tx=0x7f3df4005fb0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00101a20 msgr2=0x7f3e00101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00101a20 0x7f3e00101340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3df000e9a0 tx=0x7f3df000ecb0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 shutdown_connections 2024-05-08T20:04:47.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e00106c80 0x7f3e000fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.269 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f3de80a0fa0 0x7f3de80a3460 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e00101a20 0x7f3e00101340 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 --2- 172.21.15.33:0/272591593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e00104350 0x7f3e000ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.280+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 >> 172.21.15.33:0/272591593 conn(0x7f3e000fb390 msgr2=0x7f3e00102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:47.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.281+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 shutdown_connections 2024-05-08T20:04:47.270 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.281+0000 7f3e05838700 1 -- 172.21.15.33:0/272591593 wait complete. 2024-05-08T20:04:47.283 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-05-08T20:04:47.440 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.451+0000 7efd79ac0700 1 -- 172.21.15.33:0/3535796254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102a30 msgr2=0x7efd74109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.451+0000 7efd79ac0700 1 --2- 172.21.15.33:0/3535796254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102a30 0x7efd74109350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009f90 tx=0x7efd6c00b330 comp rx=0 tx=0).stop 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 -- 172.21.15.33:0/3535796254 shutdown_connections 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 --2- 172.21.15.33:0/3535796254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102a30 0x7efd74109350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 --2- 172.21.15.33:0/3535796254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd74100f20 0x7efd74101340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 --2- 172.21.15.33:0/3535796254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102070 0x7efd741024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 -- 172.21.15.33:0/3535796254 >> 172.21.15.33:0/3535796254 conn(0x7efd740fc490 msgr2=0x7efd740fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 -- 172.21.15.33:0/3535796254 shutdown_connections 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 -- 172.21.15.33:0/3535796254 wait complete. 2024-05-08T20:04:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.452+0000 7efd79ac0700 1 Processor -- start 2024-05-08T20:04:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd79ac0700 1 -- start start 2024-05-08T20:04:47.443 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd79ac0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd74100f20 0x7efd74196dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd79ac0700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102070 0x7efd74197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd79ac0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102a30 0x7efd7419e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd79ac0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7419e8f0 con 0x7efd74102a30 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd79ac0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7419ea30 con 0x7efd74100f20 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd79ac0700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd7419ebc0 con 0x7efd74102070 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102a30 0x7efd7419e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102a30 0x7efd7419e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57826/0 (socket says 172.21.15.33:57826) 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd73fff700 1 -- 172.21.15.33:0/876179775 learned_addr learned my addr 172.21.15.33:0/876179775 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd737fe700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd74100f20 0x7efd74196dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.453+0000 7efd72ffd700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102070 0x7efd74197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd73fff700 1 -- 172.21.15.33:0/876179775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102070 msgr2=0x7efd74197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd73fff700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102070 0x7efd74197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd73fff700 1 -- 172.21.15.33:0/876179775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd74100f20 msgr2=0x7efd74196dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd73fff700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd74100f20 0x7efd74196dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd73fff700 1 -- 172.21.15.33:0/876179775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6c009c40 con 0x7efd74102a30 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd737fe700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd74100f20 0x7efd74196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd73fff700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102a30 0x7efd7419e320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009c10 tx=0x7efd6c004ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd70ff9700 1 -- 172.21.15.33:0/876179775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00e040 con 0x7efd74102a30 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd70ff9700 1 -- 172.21.15.33:0/876179775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efd6c00be00 con 0x7efd74102a30 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd7419ee40 con 0x7efd74102a30 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd70ff9700 1 -- 172.21.15.33:0/876179775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0052a0 con 0x7efd74102a30 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.454+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd7419f260 con 0x7efd74102a30 2024-05-08T20:04:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.455+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd741082c0 con 0x7efd74102a30 2024-05-08T20:04:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.457+0000 7efd70ff9700 1 -- 172.21.15.33:0/876179775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7efd6c0054c0 con 0x7efd74102a30 2024-05-08T20:04:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.458+0000 7efd70ff9700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7efd5c0a0f20 0x7efd5c0a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.458+0000 7efd737fe700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7efd5c0a0f20 0x7efd5c0a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.458+0000 7efd70ff9700 1 -- 172.21.15.33:0/876179775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7efd6c0cdfb0 con 0x7efd74102a30 2024-05-08T20:04:47.447 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.458+0000 7efd737fe700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7efd5c0a0f20 0x7efd5c0a33e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd64011490 tx=0x7efd64009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:47.450 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.461+0000 7efd70ff9700 1 -- 172.21.15.33:0/876179775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7efd6c097970 con 0x7efd74102a30 2024-05-08T20:04:47.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: [08/May/2024:20:04:46] ENGINE Bus STARTING 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: [08/May/2024:20:04:46] ENGINE Serving on https://172.21.15.33:7150 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: mgrmap e21: x(active, since 1.02136s), standbys: z, y 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: [08/May/2024:20:04:46] ENGINE Serving on http://172.21.15.33:8765 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: [08/May/2024:20:04:46] ENGINE Bus STARTED 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:47 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: [08/May/2024:20:04:46] ENGINE Bus STARTING 2024-05-08T20:04:47.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: [08/May/2024:20:04:46] ENGINE Serving on https://172.21.15.33:7150 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: mgrmap e21: x(active, since 1.02136s), standbys: z, y 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: [08/May/2024:20:04:46] ENGINE Serving on http://172.21.15.33:8765 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: [08/May/2024:20:04:46] ENGINE Bus STARTED 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:47 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: [08/May/2024:20:04:46] ENGINE Bus STARTING 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: [08/May/2024:20:04:46] ENGINE Serving on https://172.21.15.33:7150 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: mgrmap e21: x(active, since 1.02136s), standbys: z, y 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: [08/May/2024:20:04:46] ENGINE Serving on http://172.21.15.33:8765 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: [08/May/2024:20:04:46] ENGINE Bus STARTED 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:47 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:47.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.718+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 --> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7efd7402ceb0 con 0x7efd5c0a0f20 2024-05-08T20:04:47.777 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.789+0000 7efd70ff9700 1 -- 172.21.15.33:0/876179775 <== mgr.15264 v2:172.21.15.33:6800/1417363085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7efd7402ceb0 con 0x7efd5c0a0f20 2024-05-08T20:04:47.777 INFO:teuthology.orchestra.run.smithi033.stdout:Retention added to path / 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7efd5c0a0f20 msgr2=0x7efd5c0a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7efd5c0a0f20 0x7efd5c0a33e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd64011490 tx=0x7efd64009260 comp rx=0 tx=0).stop 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102a30 msgr2=0x7efd7419e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102a30 0x7efd7419e320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd6c009c10 tx=0x7efd6c004ce0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 shutdown_connections 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7efd5c0a0f20 0x7efd5c0a33e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efd74102a30 0x7efd7419e320 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd74100f20 0x7efd74196dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 --2- 172.21.15.33:0/876179775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd74102070 0x7efd74197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.793+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 >> 172.21.15.33:0/876179775 conn(0x7efd740fc490 msgr2=0x7efd74105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:47.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.794+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 shutdown_connections 2024-05-08T20:04:47.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.794+0000 7efd79ac0700 1 -- 172.21.15.33:0/876179775 wait complete. 2024-05-08T20:04:47.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-08T20:04:47.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.958+0000 7fc6f812b700 1 -- 172.21.15.33:0/1615308482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 msgr2=0x7fc6f0103d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 --2- 172.21.15.33:0/1615308482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0103d70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009990 tx=0x7fc6ec009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.949 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 -- 172.21.15.33:0/1615308482 shutdown_connections 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 --2- 172.21.15.33:0/1615308482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f0106be0 0x7fc6f0109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 --2- 172.21.15.33:0/1615308482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0103d70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 --2- 172.21.15.33:0/1615308482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f01042b0 0x7fc6f01066a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 -- 172.21.15.33:0/1615308482 >> 172.21.15.33:0/1615308482 conn(0x7fc6f00fb390 msgr2=0x7fc6f00fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 -- 172.21.15.33:0/1615308482 shutdown_connections 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 -- 172.21.15.33:0/1615308482 wait complete. 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 Processor -- start 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.959+0000 7fc6f812b700 1 -- start start 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f812b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0101250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f812b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f01042b0 0x7fc6f00ff930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f812b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f0106be0 0x7fc6f00ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.950 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f812b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0100570 con 0x7fc6f0101980 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f812b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01006e0 con 0x7fc6f0106be0 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f812b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01a0fa0 con 0x7fc6f01042b0 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0101250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57832/0 (socket says 172.21.15.33:57832) 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 -- 172.21.15.33:0/3167043150 learned_addr learned my addr 172.21.15.33:0/3167043150 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f56c6700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f01042b0 0x7fc6f00ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f66c8700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f0106be0 0x7fc6f00ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 -- 172.21.15.33:0/3167043150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f01042b0 msgr2=0x7fc6f00ff930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f01042b0 0x7fc6f00ff930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 -- 172.21.15.33:0/3167043150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f0106be0 msgr2=0x7fc6f00ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f0106be0 0x7fc6f00ffe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.960+0000 7fc6f5ec7700 1 -- 172.21.15.33:0/3167043150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e0009520 con 0x7fc6f0101980 2024-05-08T20:04:47.951 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.961+0000 7fc6f5ec7700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0101250 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0098e0 tx=0x7fc6ec005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:47.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.961+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec01d070 con 0x7fc6f0101980 2024-05-08T20:04:47.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.961+0000 7fc6f812b700 1 -- 172.21.15.33:0/3167043150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec0095f0 con 0x7fc6f0101980 2024-05-08T20:04:47.952 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.961+0000 7fc6f812b700 1 -- 172.21.15.33:0/3167043150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f01a1490 con 0x7fc6f0101980 2024-05-08T20:04:47.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.962+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc6ec022470 con 0x7fc6f0101980 2024-05-08T20:04:47.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.962+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec017650 con 0x7fc6f0101980 2024-05-08T20:04:47.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.963+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d80052f0 con 0x7fc6f0101980 2024-05-08T20:04:47.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.964+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 21) v1 ==== 135685+0+0 (secure 0 0 0) 0x7fc6ec0177b0 con 0x7fc6f0101980 2024-05-08T20:04:47.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.964+0000 7fc6e6ffd700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc6dc0a0fa0 0x7fc6dc0a3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:47.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.965+0000 7fc6f56c6700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc6dc0a0fa0 0x7fc6dc0a3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:47.953 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.965+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7fc6ec0cd8c0 con 0x7fc6f0101980 2024-05-08T20:04:47.954 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.965+0000 7fc6f56c6700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc6dc0a0fa0 0x7fc6dc0a3460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009df0 tx=0x7fc6e0009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:47.959 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:47.971+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc6ec05dd60 con 0x7fc6f0101980 2024-05-08T20:04:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.236+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 22) v1 ==== 136044+0+0 (secure 0 0 0) 0x7fc6ec097650 con 0x7fc6f0101980 2024-05-08T20:04:48.231 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.242+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 --> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6d8000bc0 con 0x7fc6dc0a0fa0 2024-05-08T20:04:48.241 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.252+0000 7fc6e6ffd700 1 -- 172.21.15.33:0/3167043150 <== mgr.15264 v2:172.21.15.33:6800/1417363085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+298 (secure 0 0 0) 0x7fc6d8000bc0 con 0x7fc6dc0a0fa0 2024-05-08T20:04:48.241 INFO:teuthology.orchestra.run.smithi033.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-08T00:00:00", "created": "2024-05-08T20:04:47", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-05-08T20:04:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc6dc0a0fa0 msgr2=0x7fc6dc0a3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc6dc0a0fa0 0x7fc6dc0a3460 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009df0 tx=0x7fc6e0009260 comp rx=0 tx=0).stop 2024-05-08T20:04:48.245 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 msgr2=0x7fc6f0101250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0101250 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0098e0 tx=0x7fc6ec005740 comp rx=0 tx=0).stop 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 shutdown_connections 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc6f0106be0 0x7fc6f00ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc6dc0a0fa0 0x7fc6dc0a3460 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc6f0101980 0x7fc6f0101250 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 --2- 172.21.15.33:0/3167043150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6f01042b0 0x7fc6f00ff930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 >> 172.21.15.33:0/3167043150 conn(0x7fc6f00fb390 msgr2=0x7fc6f0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 shutdown_connections 2024-05-08T20:04:48.246 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.257+0000 7fc6e4ff9700 1 -- 172.21.15.33:0/3167043150 wait complete. 2024-05-08T20:04:48.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-08T20:04:48.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.424+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/2405550874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 msgr2=0x7f9b28103e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:48.413 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.424+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/2405550874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28103e10 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009990 tx=0x7f9b18009ca0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.425+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/2405550874 shutdown_connections 2024-05-08T20:04:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.425+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/2405550874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b28106c80 0x7f9b28109090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.425+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/2405550874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28103e10 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.425+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/2405550874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b28104350 0x7f9b28106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.425+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/2405550874 >> 172.21.15.33:0/2405550874 conn(0x7f9b280fb3b0 msgr2=0x7f9b280fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.425+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/2405550874 shutdown_connections 2024-05-08T20:04:48.414 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.425+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/2405550874 wait complete. 2024-05-08T20:04:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 Processor -- start 2024-05-08T20:04:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 -- start start 2024-05-08T20:04:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:48.416 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b28104350 0x7f9b28197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b28106c80 0x7f9b2819e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2819ea20 con 0x7f9b28101a20 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2819eb60 con 0x7f9b28104350 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b2dbbd700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2819ecf0 con 0x7f9b28106c80 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57850/0 (socket says 172.21.15.33:57850) 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b277fe700 1 -- 172.21.15.33:0/4162892365 learned_addr learned my addr 172.21.15.33:0/4162892365 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b27fff700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b28106c80 0x7f9b2819e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.426+0000 7f9b26ffd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b28104350 0x7f9b28197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b277fe700 1 -- 172.21.15.33:0/4162892365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b28106c80 msgr2=0x7f9b2819e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b277fe700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b28106c80 0x7f9b2819e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b277fe700 1 -- 172.21.15.33:0/4162892365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b28104350 msgr2=0x7f9b28197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:48.417 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b277fe700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b28104350 0x7f9b28197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b277fe700 1 -- 172.21.15.33:0/4162892365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180095f0 con 0x7f9b28101a20 2024-05-08T20:04:48.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b277fe700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28196ef0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9b180098e0 tx=0x7f9b1800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:48.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b24ff9700 1 -- 172.21.15.33:0/4162892365 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1801d070 con 0x7f9b28101a20 2024-05-08T20:04:48.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b24ff9700 1 -- 172.21.15.33:0/4162892365 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9b1800be50 con 0x7f9b28101a20 2024-05-08T20:04:48.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b2819ef70 con 0x7f9b28101a20 2024-05-08T20:04:48.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b24ff9700 1 -- 172.21.15.33:0/4162892365 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18017650 con 0x7f9b28101a20 2024-05-08T20:04:48.418 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.427+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2819f2e0 con 0x7f9b28101a20 2024-05-08T20:04:48.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.429+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b280fcf30 con 0x7f9b28101a20 2024-05-08T20:04:48.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.429+0000 7f9b24ff9700 1 -- 172.21.15.33:0/4162892365 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 22) v1 ==== 136044+0+0 (secure 0 0 0) 0x7f9b18022470 con 0x7f9b28101a20 2024-05-08T20:04:48.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.430+0000 7f9b24ff9700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9b100a1320 0x7f9b100a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:04:48.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.430+0000 7f9b24ff9700 1 -- 172.21.15.33:0/4162892365 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f9b180ce4e0 con 0x7f9b28101a20 2024-05-08T20:04:48.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.430+0000 7f9b26ffd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9b100a1320 0x7f9b100a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:04:48.419 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.431+0000 7f9b26ffd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9b100a1320 0x7f9b100a37e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009c60 tx=0x7f9b1c009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:04:48.423 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.435+0000 7f9b24ff9700 1 -- 172.21.15.33:0/4162892365 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9b180978e0 con 0x7f9b28101a20 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:48.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:48 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:48.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:48 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='client.15321 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:48.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:48 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:48.676 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.688+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 --> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9b2802ce10 con 0x7f9b100a1320 2024-05-08T20:04:48.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.696+0000 7f9b24ff9700 1 -- 172.21.15.33:0/4162892365 <== mgr.15264 v2:172.21.15.33:6800/1417363085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f9b2802ce10 con 0x7f9b100a1320 2024-05-08T20:04:48.685 INFO:teuthology.orchestra.run.smithi033.stdout:/ 1m 6m3h 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9b100a1320 msgr2=0x7f9b100a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9b100a1320 0x7f9b100a37e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009c60 tx=0x7f9b1c009260 comp rx=0 tx=0).stop 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 msgr2=0x7f9b28196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28196ef0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9b180098e0 tx=0x7f9b1800f690 comp rx=0 tx=0).stop 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 shutdown_connections 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b28106c80 0x7f9b2819e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9b100a1320 0x7f9b100a37e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b28101a20 0x7f9b28196ef0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 --2- 172.21.15.33:0/4162892365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b28104350 0x7f9b28197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.698+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 >> 172.21.15.33:0/4162892365 conn(0x7f9b280fb3b0 msgr2=0x7f9b281024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:04:48.687 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.699+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 shutdown_connections 2024-05-08T20:04:48.688 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:04:48.699+0000 7f9b2dbbd700 1 -- 172.21.15.33:0/4162892365 wait complete. 2024-05-08T20:04:48.702 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-05-08T20:04:48.736 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-08T20:04:48.752 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-08T20:04:48.787 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:04:48.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-08T20:04:48.790 INFO:teuthology.run_tasks:Running task workunit... 2024-05-08T20:04:48.804 INFO:tasks.workunit:Pulling workunits from ref d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:04:48.804 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-08T20:04:48.804 INFO:tasks.workunit:timeout=3h 2024-05-08T20:04:48.805 INFO:tasks.workunit:cleanup=True 2024-05-08T20:04:48.805 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:48.826 INFO:teuthology.orchestra.run.smithi033.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:48.826 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-08T20:04:48.827 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2024-05-08T20:04:48.827 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T20:04:48.827 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-08T20:04:48.827 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2024-05-08 20:03:36.780154472 +0000 2024-05-08T20:04:48.827 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2024-05-08 20:03:36.780154472 +0000 2024-05-08T20:04:48.827 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2024-05-08 20:04:45.245133291 +0000 2024-05-08T20:04:48.827 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: 2024-05-08 20:03:36.780154472 +0000 2024-05-08T20:04:48.827 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-08T20:04:48.827 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-08T20:04:48.907 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d21e4f961318b56f0d915caa2490c3711bf13c34 2024-05-08T20:04:48.967 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-08T20:04:49.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi082 to 182.4M 2024-05-08T20:04:49.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Unable to set osd_memory_target on smithi082 to 191350476: error parsing value: Value '191350476' is below minimum 939524096 2024-05-08T20:04:49.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi132 to 182.5M 2024-05-08T20:04:49.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Unable to set osd_memory_target on smithi132 to 191379148: error parsing value: Value '191379148' is below minimum 939524096 2024-05-08T20:04:49.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:49.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi033 to 183.5M 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Unable to set osd_memory_target on smithi033 to 192483020: error parsing value: Value '192483020' is below minimum 939524096 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi033:/etc/ceph/ceph.conf 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:49.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:49 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi082 to 182.4M 2024-05-08T20:04:49.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Unable to set osd_memory_target on smithi082 to 191350476: error parsing value: Value '191350476' is below minimum 939524096 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi132 to 182.5M 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Unable to set osd_memory_target on smithi132 to 191379148: error parsing value: Value '191379148' is below minimum 939524096 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi033 to 183.5M 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Unable to set osd_memory_target on smithi033 to 192483020: error parsing value: Value '192483020' is below minimum 939524096 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi033:/etc/ceph/ceph.conf 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:49.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:49.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:49 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi082 to 182.4M 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Unable to set osd_memory_target on smithi082 to 191350476: error parsing value: Value '191350476' is below minimum 939524096 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi132 to 182.5M 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Unable to set osd_memory_target on smithi132 to 191379148: error parsing value: Value '191379148' is below minimum 939524096 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='client.15345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi033 to 183.5M 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Unable to set osd_memory_target on smithi033 to 192483020: error parsing value: Value '192483020' is below minimum 939524096 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi033:/etc/ceph/ceph.conf 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T20:04:49.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi132:/etc/ceph/ceph.conf 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: mgrmap e22: x(active, since 3s), standbys: z, y 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi132:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:49.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:04:49.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:04:49.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:04:49.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:49 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:04:50.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:50 smithi033 ceph-mon[42490]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:50 smithi033 ceph-mon[42490]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:50 smithi033 ceph-mon[42490]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:50 smithi033 ceph-mon[42490]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:50.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:50 smithi033 ceph-mon[42490]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:50.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:50 smithi033 ceph-mon[42490]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-05-08T20:04:50.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:50 smithi082 ceph-mon[46774]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:50 smithi082 ceph-mon[46774]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:50 smithi082 ceph-mon[46774]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:50 smithi082 ceph-mon[46774]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:50.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:50 smithi082 ceph-mon[46774]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:50.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:50 smithi082 ceph-mon[46774]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-05-08T20:04:50.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:50 smithi132 ceph-mon[47484]: Updating smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:50 smithi132 ceph-mon[47484]: Updating smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:50 smithi132 ceph-mon[47484]: Updating smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T20:04:50.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:50 smithi132 ceph-mon[47484]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:04:50.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:50 smithi132 ceph-mon[47484]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:50.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:50 smithi132 ceph-mon[47484]: mgrmap e23: x(active, since 5s), standbys: z, y 2024-05-08T20:04:52.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:52 smithi033 ceph-mon[42490]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:52.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:52 smithi082 ceph-mon[46774]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:52.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:52 smithi132 ceph-mon[47484]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:04:54.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:54 smithi033 ceph-mon[42490]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-05-08T20:04:54.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:54 smithi082 ceph-mon[46774]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-05-08T20:04:54.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:54 smithi132 ceph-mon[47484]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 133 KiB/s wr, 78 op/s 2024-05-08T20:04:56.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:56 smithi033 ceph-mon[42490]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-05-08T20:04:56.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:56 smithi082 ceph-mon[46774]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-05-08T20:04:56.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:56 smithi132 ceph-mon[47484]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 103 KiB/s wr, 60 op/s 2024-05-08T20:04:58.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:04:58 smithi033 ceph-mon[42490]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 52 op/s 2024-05-08T20:04:58.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:04:58 smithi082 ceph-mon[46774]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 52 op/s 2024-05-08T20:04:58.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:04:58 smithi132 ceph-mon[47484]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 85 KiB/s wr, 52 op/s 2024-05-08T20:05:00.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:00 smithi033 ceph-mon[42490]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-08T20:05:00.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:00 smithi082 ceph-mon[46774]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-08T20:05:00.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:00 smithi132 ceph-mon[47484]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-08T20:05:01.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:05:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:05:00.799+0000 7f7dba034700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:05:01.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:05:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:05:00.799+0000 7f7dba034700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:05:01.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:05:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:05:00.799+0000 7f7dba034700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:05:01.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:05:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:05:00.799+0000 7f7dba034700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:05:01.071 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:05:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:05:00.799+0000 7f7dba034700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 -- 172.21.15.33:0/2590995641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c1011a0 msgr2=0x7f4b4c10d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/2590995641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c1011a0 0x7f4b4c10d3b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009990 tx=0x7f4b40009ca0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 -- 172.21.15.33:0/2590995641 shutdown_connections 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/2590995641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4c10d8f0 0x7f4b4c10fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/2590995641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b4c100880 0x7f4b4c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/2590995641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c1011a0 0x7f4b4c10d3b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 -- 172.21.15.33:0/2590995641 >> 172.21.15.33:0/2590995641 conn(0x7f4b4c076f10 msgr2=0x7f4b4c077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:01.974 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 -- 172.21.15.33:0/2590995641 shutdown_connections 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.982+0000 7f4b52fe3700 1 -- 172.21.15.33:0/2590995641 wait complete. 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 Processor -- start 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 -- start start 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c100880 0x7f4b4c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b4c1011a0 0x7f4b4c199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4c10d8f0 0x7f4b4c19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c19e5e0 con 0x7f4b4c100880 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c19e750 con 0x7f4b4c10d8f0 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b52fe3700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c19e910 con 0x7f4b4c1011a0 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b50d7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c100880 0x7f4b4c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b50d7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c100880 0x7f4b4c1996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43038/0 (socket says 172.21.15.33:43038) 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.983+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3891397359 learned_addr learned my addr 172.21.15.33:0/3891397359 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:01.975 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b51580700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4c10d8f0 0x7f4b4c19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b4c1011a0 0x7f4b4c199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3891397359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b4c1011a0 msgr2=0x7f4b4c199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b4c1011a0 0x7f4b4c199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3891397359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4c10d8f0 msgr2=0x7f4b4c19dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4c10d8f0 0x7f4b4c19dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3891397359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b400095f0 con 0x7f4b4c100880 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c100880 0x7f4b4c1996c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00d950 tx=0x7f4b3c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b49ffb700 1 -- 172.21.15.33:0/3891397359 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c009940 con 0x7f4b4c100880 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b49ffb700 1 -- 172.21.15.33:0/3891397359 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4b3c010460 con 0x7f4b4c100880 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c19ebf0 con 0x7f4b4c100880 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.984+0000 7f4b49ffb700 1 -- 172.21.15.33:0/3891397359 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00f620 con 0x7f4b4c100880 2024-05-08T20:05:01.976 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.985+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c1a6430 con 0x7f4b4c100880 2024-05-08T20:05:01.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.987+0000 7f4b49ffb700 1 -- 172.21.15.33:0/3891397359 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 23) v1 ==== 136100+0+0 (secure 0 0 0) 0x7f4b3c010960 con 0x7f4b4c100880 2024-05-08T20:05:01.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.988+0000 7f4b49ffb700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4b340a13b0 0x7f4b340a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.988+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4b340a13b0 0x7f4b340a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.977 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.988+0000 7f4b49ffb700 1 -- 172.21.15.33:0/3891397359 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f4b3c0ccee0 con 0x7f4b4c100880 2024-05-08T20:05:01.978 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.988+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4b340a13b0 0x7f4b340a3870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b40006010 tx=0x7f4b4001a040 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:01.980 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 Processor -- start 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 -- start start 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a313fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a3140270 0x55c7a3139f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a313a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a30910f0 con 0x55c7a313a480 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a308eab0 con 0x55c7a3140270 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a308a3a0 con 0x55c7a313f950 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b51580700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a313a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b51580700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a313a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43044/0 (socket says 172.21.15.33:43044) 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.989+0000 7f4b51580700 1 -- 172.21.15.33:0/30174781 learned_addr learned my addr 172.21.15.33:0/30174781 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a313fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a3140270 0x55c7a3139f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b51580700 1 -- 172.21.15.33:0/30174781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 msgr2=0x55c7a313fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:01.981 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b51580700 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a313fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b51580700 1 -- 172.21.15.33:0/30174781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a3140270 msgr2=0x55c7a3139f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b51580700 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a3140270 0x55c7a3139f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b51580700 1 -- 172.21.15.33:0/30174781 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a2f0b350 con 0x55c7a313a480 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b51580700 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a313a8a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4b44003ea0 tx=0x7f4b44009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65694f473403efca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b32ffd700 1 -- 172.21.15.33:0/30174781 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440045f0 con 0x55c7a313a480 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b32ffd700 1 -- 172.21.15.33:0/30174781 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4b4400f040 con 0x55c7a313a480 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.990+0000 7f4b32ffd700 1 -- 172.21.15.33:0/30174781 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440156f0 con 0x55c7a313a480 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 -- 172.21.15.33:0/30174781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 msgr2=0x55c7a313a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a313a8a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4b44003ea0 tx=0x7f4b44009c20 comp rx=0 tx=0).stop 2024-05-08T20:05:01.982 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 -- 172.21.15.33:0/30174781 shutdown_connections 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a313a8a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a313fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/30174781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a3140270 0x55c7a3139f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 -- 172.21.15.33:0/30174781 >> 172.21.15.33:0/30174781 conn(0x55c7a30981b0 msgr2=0x55c7a3134840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 -- 172.21.15.33:0/30174781 shutdown_connections 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 -- 172.21.15.33:0/30174781 wait complete. 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 -- start start 2024-05-08T20:05:01.983 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.991+0000 7f4b5f19db80 1 Processor -- start 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a31435b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313f950 0x55c7a3143af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3144030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a3026500 con 0x55c7a313f950 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a30261a0 con 0x55c7a313a480 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a2f0d640 con 0x55c7a3140270 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b5f19db80 10 client.0 _ll_register_callbacks cb 0x55c7a302fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313f950 0x55c7a3143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313f950 0x55c7a3143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43054/0 (socket says 172.21.15.33:43054) 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 -- 172.21.15.33:0/2929305661 learned_addr learned my addr 172.21.15.33:0/2929305661 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:01.987 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a31435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b51580700 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 -- 172.21.15.33:0/2929305661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 msgr2=0x55c7a3144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 -- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 msgr2=0x55c7a31435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a31435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.992+0000 7f4b4bfff700 1 -- 172.21.15.33:0/2929305661 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b44003b00 con 0x55c7a313f950 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313f950 0x55c7a3143af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0692f0 tx=0x7f4b40009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ba719c5a08fa3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b2bfff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b2bfff700 1 -- 172.21.15.33:0/2929305661 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4001d040 con 0x55c7a313f950 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b2bfff700 1 -- 172.21.15.33:0/2929305661 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f4b40023820 con 0x55c7a313f950 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7a2fe3210 con 0x55c7a313f950 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b2bfff700 1 -- 172.21.15.33:0/2929305661 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b400239e0 con 0x55c7a313f950 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 10 client.15375 fetch_fsmap learned FSMap version 24 2024-05-08T20:05:01.988 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c7a2eb7b00 con 0x55c7a313f950 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b2bfff700 1 -- 172.21.15.33:0/2929305661 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4b4003c020 con 0x55c7a313f950 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b2bfff700 1 -- 172.21.15.33:0/2929305661 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b4002fcb0 con 0x55c7a313f950 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 10 client.15375 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 20 client.15375 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a3153c50 0x55c7a3156070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 4 client.15375 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.993+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7a31097b0 con 0x55c7a3153c50 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.994+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a3153c50 0x55c7a3156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.994+0000 7f4b2bfff700 10 client.15375 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.994+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a3153c50 0x55c7a3156070 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4103323c6da282a0 server_cookie=9bc4f0384ddcc528 in_seq=0 out_seq=0 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b2bfff700 1 -- 172.21.15.33:0/2929305661 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c7a31097b0 con 0x55c7a3153c50 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b2bfff700 10 client.15375 handle_command_reply: tid=0 2024-05-08T20:05:01.989 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 client.15375 shutdown 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313f950 msgr2=0x55c7a3143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313f950 0x55c7a3143af0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0692f0 tx=0x7f4b40009ca0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 shutdown_connections 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a3153c50 0x55c7a3156070 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a31435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2929305661 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313f950 0x55c7a3143af0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b2bfff700 0 client.15375 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 >> 172.21.15.33:0/2929305661 conn(0x55c7a30981b0 msgr2=0x55c7a313d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 shutdown_connections 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2929305661 wait complete. 2024-05-08T20:05:01.990 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:01.995+0000 7f4b5f19db80 20 client.15375 trim_cache size 0 max 16384 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.011+0000 7f4b5f19db80 1 Processor -- start 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.011+0000 7f4b5f19db80 1 -- start start 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a313fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a3134910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a3140270 0x55c7a313a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a313ada0 con 0x55c7a3140270 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a315b280 con 0x55c7a313a480 2024-05-08T20:05:02.002 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a31391e0 con 0x55c7a313f950 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a3140270 0x55c7a313a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a3140270 0x55c7a313a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43064/0 (socket says 172.21.15.33:43064) 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 -- 172.21.15.33:0/2741110700 learned_addr learned my addr 172.21.15.33:0/2741110700 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a3134910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a313fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 -- 172.21.15.33:0/2741110700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 msgr2=0x55c7a3134910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a3134910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 -- 172.21.15.33:0/2741110700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 msgr2=0x55c7a313fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a313fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 -- 172.21.15.33:0/2741110700 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a3050500 con 0x55c7a3140270 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b51580700 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a3140270 0x55c7a313a860 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b440060a0 tx=0x7f4b44003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b800027b3503f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.012+0000 7f4b337fe700 1 -- 172.21.15.33:0/2741110700 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b44007940 con 0x55c7a3140270 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b337fe700 1 -- 172.21.15.33:0/2741110700 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4b44015480 con 0x55c7a3140270 2024-05-08T20:05:02.003 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b337fe700 1 -- 172.21.15.33:0/2741110700 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b440052a0 con 0x55c7a3140270 2024-05-08T20:05:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2741110700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a3140270 msgr2=0x55c7a313a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a3140270 0x55c7a313a860 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b440060a0 tx=0x7f4b44003a00 comp rx=0 tx=0).stop 2024-05-08T20:05:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2741110700 shutdown_connections 2024-05-08T20:05:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a3140270 0x55c7a313a860 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313a480 0x55c7a313fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:02.007 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/2741110700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a313f950 0x55c7a3134910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2741110700 >> 172.21.15.33:0/2741110700 conn(0x55c7a30981b0 msgr2=0x55c7a313d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2741110700 shutdown_connections 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.013+0000 7f4b5f19db80 1 -- 172.21.15.33:0/2741110700 wait complete. 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 -- start start 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 Processor -- start 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a314b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313f950 0x55c7a3146be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3147320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a3147a30 con 0x55c7a313a480 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a31a9140 con 0x55c7a313f950 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a31a9280 con 0x55c7a3140270 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b5f19db80 10 client.0 _ll_register_callbacks cb 0x55c7a302fad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:02.008 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b50d7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a314b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b50d7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a314b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43070/0 (socket says 172.21.15.33:43070) 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.014+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3437929100 learned_addr learned my addr 172.21.15.33:0/3437929100 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b51580700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313f950 0x55c7a3146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3437929100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 msgr2=0x55c7a3147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313f950 msgr2=0x55c7a3146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313f950 0x55c7a3146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b50d7f700 1 -- 172.21.15.33:0/3437929100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7a2f0b350 con 0x55c7a313a480 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313f950 0x55c7a3146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b50d7f700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a314b140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c096780 tx=0x7f4b3c005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f83ab289ca97e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b2bfff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:05:02.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b2bfff700 1 -- 172.21.15.33:0/3437929100 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0adde0 con 0x55c7a313a480 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b2bfff700 1 -- 172.21.15.33:0/3437929100 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f4b3c099f70 con 0x55c7a313a480 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b4400f040 con 0x55c7a313a480 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b2bfff700 1 -- 172.21.15.33:0/3437929100 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b3c09a130 con 0x55c7a313a480 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b5f19db80 10 client.15381 fetch_fsmap learned FSMap version 24 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.015+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c7a2f0fc70 con 0x55c7a313a480 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b2bfff700 1 -- 172.21.15.33:0/3437929100 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4b4400f040 con 0x55c7a313a480 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b2bfff700 1 -- 172.21.15.33:0/3437929100 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 24) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b3c0b7f90 con 0x55c7a313a480 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b5f19db80 10 client.15381 fetch_fsmap finished waiting for FSMap version 24 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b5f19db80 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b5f19db80 20 client.15381 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a31aa8a0 0x55c7a31accc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:02.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b5f19db80 4 client.15381 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:05:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c7a3082e60 con 0x55c7a31aa8a0 2024-05-08T20:05:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.016+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a31aa8a0 0x55c7a31accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.017+0000 7f4b2bfff700 10 client.15381 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:02.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.017+0000 7f4b4bfff700 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a31aa8a0 0x55c7a31accc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21551c2e300654c9 server_cookie=cbef2ceb5722e040 in_seq=0 out_seq=0 2024-05-08T20:05:02.263 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:02.274+0000 7f4b49ffb700 1 -- 172.21.15.33:0/3891397359 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7f4b3c094920 con 0x7f4b4c100880 2024-05-08T20:05:02.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:02 smithi033 ceph-mon[42490]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-08T20:05:02.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:02 smithi082 ceph-mon[46774]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-08T20:05:02.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:02 smithi132 ceph-mon[47484]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 77 KiB/s wr, 48 op/s 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.206+0000 7f4b2bfff700 1 -- 172.21.15.33:0/3437929100 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c7a3082e60 con 0x55c7a31aa8a0 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.206+0000 7f4b2bfff700 10 client.15381 handle_command_reply: tid=0 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.206+0000 7f4b5f19db80 1 client.15381 shutdown 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 msgr2=0x55c7a314b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a314b140 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c096780 tx=0x7f4b3c005910 comp rx=0 tx=0).stop 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 shutdown_connections 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55c7a31aa8a0 0x55c7a31accc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c7a3140270 0x55c7a3147320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55c7a313a480 0x55c7a314b140 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 --2- 172.21.15.33:0/3437929100 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c7a313f950 0x55c7a3146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.197 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b2bfff700 0 client.15381 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 >> 172.21.15.33:0/3437929100 conn(0x55c7a30981b0 msgr2=0x55c7a3140650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 shutdown_connections 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 1 -- 172.21.15.33:0/3437929100 wait complete. 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.207+0000 7f4b5f19db80 20 client.15381 trim_cache size 0 max 16384 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:05:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:05:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4b340a13b0 msgr2=0x7f4b340a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4b340a13b0 0x7f4b340a3870 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b40006010 tx=0x7f4b4001a040 comp rx=0 tx=0).stop 2024-05-08T20:05:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c100880 msgr2=0x7f4b4c1996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c100880 0x7f4b4c1996c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00d950 tx=0x7f4b3c00dc60 comp rx=0 tx=0).stop 2024-05-08T20:05:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 shutdown_connections 2024-05-08T20:05:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4b4c10d8f0 0x7f4b4c19dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4b340a13b0 0x7f4b340a3870 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b4c100880 0x7f4b4c1996c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 --2- 172.21.15.33:0/3891397359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b4c1011a0 0x7f4b4c199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 >> 172.21.15.33:0/3891397359 conn(0x7f4b4c076f10 msgr2=0x7f4b4c10f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 shutdown_connections 2024-05-08T20:05:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:03.208+0000 7f4b52fe3700 1 -- 172.21.15.33:0/3891397359 wait complete. 2024-05-08T20:05:03.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:03 smithi033 ceph-mon[42490]: mgrmap e24: x(active, since 17s), standbys: z, y 2024-05-08T20:05:03.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:03 smithi082 ceph-mon[46774]: mgrmap e24: x(active, since 17s), standbys: z, y 2024-05-08T20:05:03.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:03 smithi132 ceph-mon[47484]: mgrmap e24: x(active, since 17s), standbys: z, y 2024-05-08T20:05:04.372 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:04 smithi082 ceph-mon[46774]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-05-08T20:05:04.372 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: *** Caught signal (Segmentation fault) ** 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: in thread 7f07e2c4c700 thread_name:md_log_replay 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f07f380dd20] 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x560cb77ff5a2] 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x560cb78017f3] 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 4: (MDLog::_replay_thread()+0x699) [0x560cb785f079] 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 5: (MDLog::ReplayThread::entry()+0x11) [0x560cb75165f1] 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f07f38031ca] 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 7: clone() 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2024-05-08T20:05:04.132+0000 7f07e2c4c700 -1 *** Caught signal (Segmentation fault) ** 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: in thread 7f07e2c4c700 thread_name:md_log_replay 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2024-05-08T20:05:04.373 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f07f380dd20] 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x560cb77ff5a2] 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x560cb78017f3] 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 4: (MDLog::_replay_thread()+0x699) [0x560cb785f079] 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 5: (MDLog::ReplayThread::entry()+0x11) [0x560cb75165f1] 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f07f38031ca] 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 7: clone() 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 0> 2024-05-08T20:05:04.132+0000 7f07e2c4c700 -1 *** Caught signal (Segmentation fault) ** 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: in thread 7f07e2c4c700 thread_name:md_log_replay 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2024-05-08T20:05:04.374 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f07f380dd20] 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x560cb77ff5a2] 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x560cb78017f3] 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 4: (MDLog::_replay_thread()+0x699) [0x560cb785f079] 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 5: (MDLog::ReplayThread::entry()+0x11) [0x560cb75165f1] 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f07f38031ca] 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 7: clone() 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 0> 2024-05-08T20:05:04.132+0000 7f07e2c4c700 -1 *** Caught signal (Segmentation fault) ** 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: in thread 7f07e2c4c700 thread_name:md_log_replay 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: ceph version 18.2.2-1322-gd21e4f96 (d21e4f961318b56f0d915caa2490c3711bf13c34) reef (stable) 2024-05-08T20:05:04.375 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 1: /lib64/libpthread.so.0(+0x12d20) [0x7f07f380dd20] 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2: /usr/bin/ceph-mds(+0x4be5a2) [0x560cb77ff5a2] 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x560cb78017f3] 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 4: (MDLog::_replay_thread()+0x699) [0x560cb785f079] 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 5: (MDLog::ReplayThread::entry()+0x11) [0x560cb75165f1] 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f07f38031ca] 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 7: clone() 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-08T20:05:04.376 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[83199]: 2024-05-08T20:05:04.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:04 smithi033 ceph-mon[42490]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-05-08T20:05:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:04 smithi132 ceph-mon[47484]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-05-08T20:05:04.871 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h.service: Main process exited, code=exited, status=139/n/a 2024-05-08T20:05:04.872 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:04 smithi082 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h.service: Failed with result 'exit-code'. 2024-05-08T20:05:06.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:06 smithi033 ceph-mon[42490]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:05:06.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:06 smithi082 ceph-mon[46774]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:05:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:06 smithi132 ceph-mon[47484]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:05:08.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:08 smithi033 ceph-mon[42490]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-05-08T20:05:08.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:08 smithi082 ceph-mon[46774]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-05-08T20:05:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:08 smithi132 ceph-mon[47484]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 27 op/s 2024-05-08T20:05:10.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:10 smithi033 ceph-mon[42490]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-05-08T20:05:10.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:10 smithi082 ceph-mon[46774]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-05-08T20:05:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:10 smithi132 ceph-mon[47484]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-05-08T20:05:12.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:12 smithi033 ceph-mon[42490]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-05-08T20:05:12.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:12 smithi082 ceph-mon[46774]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-05-08T20:05:12.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:12 smithi132 ceph-mon[47484]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 24 op/s 2024-05-08T20:05:14.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:14 smithi033 ceph-mon[42490]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-05-08T20:05:14.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:14 smithi082 ceph-mon[46774]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-05-08T20:05:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:14 smithi132 ceph-mon[47484]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-05-08T20:05:15.126 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:14 smithi082 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h.service: Service RestartSec=10s expired, scheduling restart. 2024-05-08T20:05:15.126 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:14 smithi082 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h.service: Scheduled restart job, restart counter is at 1. 2024-05-08T20:05:15.126 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:14 smithi082 systemd[1]: Stopped Ceph mds.h for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:05:15.127 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:14 smithi082 systemd[1]: Starting Ceph mds.h for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:05:15.621 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[86583]: starting mds.h at 2024-05-08T20:05:15.621 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:15 smithi082 bash[86568]: 1c90618a7d6730ddbb56615f9b408494e8a74f35a4bee43148c54a3033d5e7c2 2024-05-08T20:05:15.621 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:05:15 smithi082 systemd[1]: Started Ceph mds.h for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:05:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 -- 172.21.15.33:0/2003550064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14100010 msgr2=0x7f6e141003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/2003550064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14100010 0x7f6e141003f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009990 tx=0x7f6e10009ca0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 -- 172.21.15.33:0/2003550064 shutdown_connections 2024-05-08T20:05:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/2003550064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e14105130 0x7f6e1410ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/2003550064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14100010 0x7f6e141003f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/2003550064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e141009c0 0x7f6e14104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 -- 172.21.15.33:0/2003550064 >> 172.21.15.33:0/2003550064 conn(0x7f6e14076f40 msgr2=0x7f6e14077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 -- 172.21.15.33:0/2003550064 shutdown_connections 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.342+0000 7f6e1c59b700 1 -- 172.21.15.33:0/2003550064 wait complete. 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 Processor -- start 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 -- start start 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e14100010 0x7f6e14197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14105130 0x7f6e141979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e1419bd40 0x7f6e1419c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1419c7c0 con 0x7f6e14105130 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1419c930 con 0x7f6e1419bd40 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e1c59b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1419caf0 con 0x7f6e14100010 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e19b36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14105130 0x7f6e141979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e19b36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14105130 0x7f6e141979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50270/0 (socket says 172.21.15.33:50270) 2024-05-08T20:05:16.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.343+0000 7f6e19b36700 1 -- 172.21.15.33:0/234005959 learned_addr learned my addr 172.21.15.33:0/234005959 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e1a337700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e14100010 0x7f6e14197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e1419bd40 0x7f6e1419c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e19b36700 1 -- 172.21.15.33:0/234005959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e14100010 msgr2=0x7f6e14197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e19b36700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e14100010 0x7f6e14197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e19b36700 1 -- 172.21.15.33:0/234005959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e1419bd40 msgr2=0x7f6e1419c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e19b36700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e1419bd40 0x7f6e1419c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e19b36700 1 -- 172.21.15.33:0/234005959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100095f0 con 0x7f6e14105130 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e1419bd40 0x7f6e1419c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e19b36700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14105130 0x7f6e141979a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e970 tx=0x7f6e0400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e0b7fe700 1 -- 172.21.15.33:0/234005959 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04009790 con 0x7f6e14105130 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e141a3ff0 con 0x7f6e14105130 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e0b7fe700 1 -- 172.21.15.33:0/234005959 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6e0400eec0 con 0x7f6e14105130 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e0b7fe700 1 -- 172.21.15.33:0/234005959 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04005690 con 0x7f6e14105130 2024-05-08T20:05:16.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.344+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e141a4520 con 0x7f6e14105130 2024-05-08T20:05:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.347+0000 7f6e0b7fe700 1 -- 172.21.15.33:0/234005959 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7f6e04004750 con 0x7f6e14105130 2024-05-08T20:05:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.348+0000 7f6e0b7fe700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f6e000a1440 0x7f6e000a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.348+0000 7f6e1a337700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f6e000a1440 0x7f6e000a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.348+0000 7f6e0b7fe700 1 -- 172.21.15.33:0/234005959 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f6e04014070 con 0x7f6e14105130 2024-05-08T20:05:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.348+0000 7f6e1a337700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f6e000a1440 0x7f6e000a3900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b790 tx=0x7f6e10005960 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:16.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 Processor -- start 2024-05-08T20:05:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 -- start start 2024-05-08T20:05:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab5eb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5ef900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab53e0f0 con 0x563fab5efe40 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab53bab0 con 0x563fab5ebe60 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e28755b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab5373a0 con 0x563fab5eb540 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e1ab38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e1ab38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50282/0 (socket says 172.21.15.33:50282) 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e1ab38700 1 -- 172.21.15.33:0/247382714 learned_addr learned my addr 172.21.15.33:0/247382714 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e1a337700 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab5eb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.349+0000 7f6e19b36700 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e1ab38700 1 -- 172.21.15.33:0/247382714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 msgr2=0x563fab5eb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab5eb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e1ab38700 1 -- 172.21.15.33:0/247382714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 msgr2=0x563fab5ef900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5ef900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e1ab38700 1 -- 172.21.15.33:0/247382714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fab3b8350 con 0x563fab5efe40 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f02a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009400 tx=0x7f6e0c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e882e963b34921e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e08ff9700 1 -- 172.21.15.33:0/247382714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c0153f0 con 0x563fab5efe40 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e08ff9700 1 -- 172.21.15.33:0/247382714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6e0c011040 con 0x563fab5efe40 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.350+0000 7f6e08ff9700 1 -- 172.21.15.33:0/247382714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c014990 con 0x563fab5efe40 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 -- 172.21.15.33:0/247382714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 msgr2=0x563fab5f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f02a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009400 tx=0x7f6e0c009920 comp rx=0 tx=0).stop 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 -- 172.21.15.33:0/247382714 shutdown_connections 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f02a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab5eb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 --2- 172.21.15.33:0/247382714 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5ef900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 -- 172.21.15.33:0/247382714 >> 172.21.15.33:0/247382714 conn(0x563fab5451b0 msgr2=0x563fab5e1840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 -- 172.21.15.33:0/247382714 shutdown_connections 2024-05-08T20:05:16.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 -- 172.21.15.33:0/247382714 wait complete. 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 -- start start 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.351+0000 7f6e28755b80 1 Processor -- start 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5eb540 0x563fab5f7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5ebe60 0x563fab5f4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e28755b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab4d3500 con 0x563fab5efe40 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e28755b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab4d31a0 con 0x563fab5eb540 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e28755b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab3ba640 con 0x563fab5ebe60 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e28755b80 10 client.0 _ll_register_callbacks cb 0x563fab4dcad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50290/0 (socket says 172.21.15.33:50290) 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 -- 172.21.15.33:0/3257740980 learned_addr learned my addr 172.21.15.33:0/3257740980 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:16.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e19b36700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5ebe60 0x563fab5f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1a337700 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5eb540 0x563fab5f7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 -- 172.21.15.33:0/3257740980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5ebe60 msgr2=0x563fab5f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5ebe60 0x563fab5f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 -- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5eb540 msgr2=0x563fab5f7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5eb540 0x563fab5f7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 -- 172.21.15.33:0/3257740980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c0090b0 con 0x563fab5efe40 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f5040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0093d0 tx=0x7f6e0c0148a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=badd48583ffefff3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6dfdffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.352+0000 7f6dfdffb700 1 -- 172.21.15.33:0/3257740980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0c014390 con 0x563fab5efe40 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6dfdffb700 1 -- 172.21.15.33:0/3257740980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f6e0c020470 con 0x563fab5efe40 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fab490210 con 0x563fab5efe40 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6dfdffb700 1 -- 172.21.15.33:0/3257740980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e0c020630 con 0x563fab5efe40 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 10 client.15399 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:16.347 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563fab364b00 con 0x563fab5efe40 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6dfdffb700 1 -- 172.21.15.33:0/3257740980 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x563fab490210 con 0x563fab5efe40 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6dfdffb700 1 -- 172.21.15.33:0/3257740980 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6e0c0157f0 con 0x563fab5efe40 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 10 client.15399 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 20 client.15399 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab604ed0 0x563fab6072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 4 client.15399 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fab5b67b0 con 0x563fab604ed0 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.353+0000 7f6e1a337700 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab604ed0 0x563fab6072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.354+0000 7f6e1a337700 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab604ed0 0x563fab6072c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efb4d0da5127f6ad server_cookie=b9f232e1b00f2741 in_seq=0 out_seq=0 2024-05-08T20:05:16.348 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.354+0000 7f6dfdffb700 10 client.15399 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.354+0000 7f6dfdffb700 1 -- 172.21.15.33:0/3257740980 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563fab5b67b0 con 0x563fab604ed0 2024-05-08T20:05:16.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.354+0000 7f6dfdffb700 10 client.15399 handle_command_reply: tid=0 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 client.15399 shutdown 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 msgr2=0x563fab5f5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f5040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0093d0 tx=0x7f6e0c0148a0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 shutdown_connections 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab604ed0 0x563fab6072c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5efe40 0x563fab5f5040 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6dfdffb700 0 client.15399 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5eb540 0x563fab5f7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3257740980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5ebe60 0x563fab5f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 >> 172.21.15.33:0/3257740980 conn(0x563fab5451b0 msgr2=0x563fab5e5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 shutdown_connections 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 1 -- 172.21.15.33:0/3257740980 wait complete. 2024-05-08T20:05:16.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.355+0000 7f6e28755b80 20 client.15399 trim_cache size 0 max 16384 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 Processor -- start 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 -- start start 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab6072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5ebe60 0x563fab5dde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5efe40 0x563fab5e6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab5e6dc0 con 0x563fab5ebe60 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab5e3340 con 0x563fab5efe40 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e28755b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab5e2930 con 0x563fab5eb540 2024-05-08T20:05:16.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5ebe60 0x563fab5dde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5ebe60 0x563fab5dde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50296/0 (socket says 172.21.15.33:50296) 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 -- 172.21.15.33:0/3862124810 learned_addr learned my addr 172.21.15.33:0/3862124810 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e1a337700 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab6072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5efe40 0x563fab5e6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 -- 172.21.15.33:0/3862124810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 msgr2=0x563fab6072c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab6072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 -- 172.21.15.33:0/3862124810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5efe40 msgr2=0x563fab5e6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5efe40 0x563fab5e6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.371+0000 7f6e19b36700 1 -- 172.21.15.33:0/3862124810 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fab4fd500 con 0x563fab5ebe60 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e19b36700 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5ebe60 0x563fab5dde00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c5b0 tx=0x7f6e04099a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc09c26b5968d66 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e097fa700 1 -- 172.21.15.33:0/3862124810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0409df00 con 0x563fab5ebe60 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e097fa700 1 -- 172.21.15.33:0/3862124810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6e040a2550 con 0x563fab5ebe60 2024-05-08T20:05:16.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e097fa700 1 -- 172.21.15.33:0/3862124810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04016590 con 0x563fab5ebe60 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 -- 172.21.15.33:0/3862124810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5ebe60 msgr2=0x563fab5dde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5ebe60 0x563fab5dde00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c5b0 tx=0x7f6e04099a30 comp rx=0 tx=0).stop 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 -- 172.21.15.33:0/3862124810 shutdown_connections 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5efe40 0x563fab5e6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5eb540 0x563fab6072c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 --2- 172.21.15.33:0/3862124810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5ebe60 0x563fab5dde00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 -- 172.21.15.33:0/3862124810 >> 172.21.15.33:0/3862124810 conn(0x563fab5451b0 msgr2=0x563fab5f2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 -- 172.21.15.33:0/3862124810 shutdown_connections 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.372+0000 7f6e28755b80 1 -- 172.21.15.33:0/3862124810 wait complete. 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 -- start start 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 Processor -- start 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5eb540 0x563fab5f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5fa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5efe40 0x563fab5faa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab65a4d0 con 0x563fab5eb540 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab65a640 con 0x563fab5ebe60 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fab65a800 con 0x563fab5efe40 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e28755b80 10 client.0 _ll_register_callbacks cb 0x563fab4dcad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e1a337700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5eb540 0x563fab5f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e1a337700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5eb540 0x563fab5f9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50304/0 (socket says 172.21.15.33:50304) 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.373+0000 7f6e1a337700 1 -- 172.21.15.33:0/800235967 learned_addr learned my addr 172.21.15.33:0/800235967 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e1ab38700 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5efe40 0x563fab5faa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e19b36700 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e1a337700 1 -- 172.21.15.33:0/800235967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5efe40 msgr2=0x563fab5faa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e1a337700 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5efe40 0x563fab5faa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e1a337700 1 -- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 msgr2=0x563fab5fa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:16.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e1a337700 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5fa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e1a337700 1 -- 172.21.15.33:0/800235967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e141a4520 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e1a337700 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5eb540 0x563fab5f9ff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e1001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd986c47cdb465c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6dfdffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6dfdffb700 1 -- 172.21.15.33:0/800235967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10036360 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6dfdffb700 1 -- 172.21.15.33:0/800235967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7f6e100364c0 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e0c011040 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6dfdffb700 1 -- 172.21.15.33:0/800235967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e10036680 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e28755b80 10 client.15405 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.374+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563fab3bcc70 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6dfdffb700 1 -- 172.21.15.33:0/800235967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6e10045020 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6dfdffb700 1 -- 172.21.15.33:0/800235967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6e1000f460 con 0x563fab5eb540 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e28755b80 10 client.15405 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e28755b80 10 client.15405 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:16.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e28755b80 20 client.15405 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e28755b80 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab65bff0 0x563fab65e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e28755b80 4 client.15405 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:05:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563fab52fe60 con 0x563fab65bff0 2024-05-08T20:05:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e19b36700 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab65bff0 0x563fab65e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6dfdffb700 10 client.15405 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:16.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.375+0000 7f6e19b36700 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab65bff0 0x563fab65e410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b1c8fbbd3e7ed5 server_cookie=c76a267a76632bf3 in_seq=0 out_seq=0 2024-05-08T20:05:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6dfdffb700 1 -- 172.21.15.33:0/800235967 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563fab52fe60 con 0x563fab65bff0 2024-05-08T20:05:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6dfdffb700 10 client.15405 handle_command_reply: tid=0 2024-05-08T20:05:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 client.15405 shutdown 2024-05-08T20:05:16.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5eb540 msgr2=0x563fab5f9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5eb540 0x563fab5f9ff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e1001a050 comp rx=0 tx=0).stop 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 shutdown_connections 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x563fab65bff0 0x563fab65e410 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x563fab5efe40 0x563fab5faa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fab5eb540 0x563fab5f9ff0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6dfdffb700 0 client.15405 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 --2- 172.21.15.33:0/800235967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563fab5ebe60 0x563fab5fa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 >> 172.21.15.33:0/800235967 conn(0x563fab5451b0 msgr2=0x563fab5ee040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 shutdown_connections 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 1 -- 172.21.15.33:0/800235967 wait complete. 2024-05-08T20:05:16.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e28755b80 20 client.15405 trim_cache size 0 max 16384 2024-05-08T20:05:16.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:05:16.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:05:16.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:05:16.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f6e000a1440 msgr2=0x7f6e000a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f6e000a1440 0x7f6e000a3900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b790 tx=0x7f6e10005960 comp rx=0 tx=0).stop 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14105130 msgr2=0x7f6e141979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.381+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14105130 0x7f6e141979a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400e970 tx=0x7f6e0400ec80 comp rx=0 tx=0).stop 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 shutdown_connections 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e1419bd40 0x7f6e1419c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e14100010 0x7f6e14197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f6e000a1440 0x7f6e000a3900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 --2- 172.21.15.33:0/234005959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e14105130 0x7f6e141979a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 >> 172.21.15.33:0/234005959 conn(0x7f6e14076f40 msgr2=0x7f6e14069520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 shutdown_connections 2024-05-08T20:05:16.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:16.382+0000 7f6e1c59b700 1 -- 172.21.15.33:0/234005959 wait complete. 2024-05-08T20:05:16.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:16 smithi033 ceph-mon[42490]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-05-08T20:05:16.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:16 smithi033 ceph-mon[42490]: daemon mds.h restarted 2024-05-08T20:05:16.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:16 smithi033 ceph-mon[42490]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T20:05:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:16 smithi082 ceph-mon[46774]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-05-08T20:05:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:16 smithi082 ceph-mon[46774]: daemon mds.h restarted 2024-05-08T20:05:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:16 smithi082 ceph-mon[46774]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T20:05:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:16 smithi132 ceph-mon[47484]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.5 KiB/s wr, 8 op/s 2024-05-08T20:05:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:16 smithi132 ceph-mon[47484]: daemon mds.h restarted 2024-05-08T20:05:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:16 smithi132 ceph-mon[47484]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T20:05:17.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6836/2592033355,v1:172.21.15.82:6837/2592033355] up:boot 2024-05-08T20:05:17.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:17 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-05-08T20:05:17.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:17 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:05:17.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:17 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:05:17.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6836/2592033355,v1:172.21.15.82:6837/2592033355] up:boot 2024-05-08T20:05:17.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:17 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-05-08T20:05:17.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:17 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:05:17.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:17 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:05:17.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6836/2592033355,v1:172.21.15.82:6837/2592033355] up:boot 2024-05-08T20:05:17.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:17 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2024-05-08T20:05:17.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:17 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:05:17.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:17 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:05:18.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:18 smithi033 ceph-mon[42490]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-05-08T20:05:18.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:18 smithi082 ceph-mon[46774]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-05-08T20:05:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:18 smithi132 ceph-mon[47484]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-05-08T20:05:20.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:20 smithi033 ceph-mon[42490]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-05-08T20:05:20.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:20 smithi082 ceph-mon[46774]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-05-08T20:05:20.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:20 smithi132 ceph-mon[47484]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 3 op/s 2024-05-08T20:05:22.573 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:22 smithi033 ceph-mon[42490]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-05-08T20:05:22.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:22 smithi082 ceph-mon[46774]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-05-08T20:05:22.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:22 smithi132 ceph-mon[47484]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 4 op/s 2024-05-08T20:05:24.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:24 smithi033 ceph-mon[42490]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T20:05:24.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:24 smithi082 ceph-mon[46774]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T20:05:24.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:24 smithi132 ceph-mon[47484]: pgmap v23: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T20:05:26.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:26 smithi082 ceph-mon[46774]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T20:05:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:26 smithi132 ceph-mon[47484]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T20:05:26.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:26 smithi033 ceph-mon[42490]: pgmap v24: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-05-08T20:05:28.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:28 smithi082 ceph-mon[46774]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-08T20:05:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:28 smithi132 ceph-mon[47484]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-08T20:05:28.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:28 smithi033 ceph-mon[42490]: pgmap v25: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-05-08T20:05:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3558236429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4741009c0 msgr2=0x7fc474104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3558236429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4741009c0 0x7fc474104a00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009990 tx=0x7fc45c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3558236429 shutdown_connections 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3558236429 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc474105130 0x7fc47410ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3558236429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc474100010 0x7fc4741003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3558236429 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4741009c0 0x7fc474104a00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3558236429 >> 172.21.15.33:0/3558236429 conn(0x7fc474076f40 msgr2=0x7fc474077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3558236429 shutdown_connections 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3558236429 wait complete. 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.509+0000 7fc47ab4f700 1 Processor -- start 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc47ab4f700 1 -- start start 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc47ab4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc474100010 0x7fc474198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc47ab4f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc474105130 0x7fc474198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc47ab4f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc474198d80 0x7fc4741a3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc47ab4f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741a3a10 con 0x7fc474100010 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc47ab4f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741a3b80 con 0x7fc474198d80 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc47ab4f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4741a3d40 con 0x7fc474105130 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc474100010 0x7fc474198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc474100010 0x7fc474198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37938/0 (socket says 172.21.15.33:37938) 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 -- 172.21.15.33:0/3870141272 learned_addr learned my addr 172.21.15.33:0/3870141272 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc473fff700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc474105130 0x7fc474198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4790ec700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc474198d80 0x7fc4741a3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 -- 172.21.15.33:0/3870141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc474105130 msgr2=0x7fc474198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc474105130 0x7fc474198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 -- 172.21.15.33:0/3870141272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc474198d80 msgr2=0x7fc4741a3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc474198d80 0x7fc4741a3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 -- 172.21.15.33:0/3870141272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0095f0 con 0x7fc474100010 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4790ec700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc474198d80 0x7fc4741a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.510+0000 7fc4788eb700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc474100010 0x7fc474198300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d980 tx=0x7fc46400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.511+0000 7fc471ffb700 1 -- 172.21.15.33:0/3870141272 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46400bb60 con 0x7fc474100010 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.511+0000 7fc471ffb700 1 -- 172.21.15.33:0/3870141272 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc464007640 con 0x7fc474100010 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.511+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4741a3fc0 con 0x7fc474100010 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.511+0000 7fc471ffb700 1 -- 172.21.15.33:0/3870141272 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464005020 con 0x7fc474100010 2024-05-08T20:05:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.511+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4741a44f0 con 0x7fc474100010 2024-05-08T20:05:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.514+0000 7fc471ffb700 1 -- 172.21.15.33:0/3870141272 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fc464004020 con 0x7fc474100010 2024-05-08T20:05:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.514+0000 7fc471ffb700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4600a14c0 0x7fc4600a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.514+0000 7fc471ffb700 1 -- 172.21.15.33:0/3870141272 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7fc4640ccde0 con 0x7fc474100010 2024-05-08T20:05:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.514+0000 7fc473fff700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4600a14c0 0x7fc4600a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.504 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.515+0000 7fc473fff700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4600a14c0 0x7fc4600a3980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc45c006010 tx=0x7fc45c00b540 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.515+0000 7fc486d09b80 1 Processor -- start 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.515+0000 7fc486d09b80 1 -- start start 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.515+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb9950 0x5600dfeb9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfeb3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb4480 0x5600dfeb48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc486d09b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfe0b0f0 con 0x5600dfeba270 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc486d09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfe08ab0 con 0x5600dfeb4480 2024-05-08T20:05:29.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc486d09b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfe043a0 con 0x5600dfeb9950 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfeb3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfeb3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37946/0 (socket says 172.21.15.33:37946) 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 -- 172.21.15.33:0/317861939 learned_addr learned my addr 172.21.15.33:0/317861939 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc4790ec700 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb4480 0x5600dfeb48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc4788eb700 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb9950 0x5600dfeb9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 -- 172.21.15.33:0/317861939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb9950 msgr2=0x5600dfeb9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb9950 0x5600dfeb9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 -- 172.21.15.33:0/317861939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb4480 msgr2=0x5600dfeb48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb4480 0x5600dfeb48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 -- 172.21.15.33:0/317861939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600dfc85350 con 0x5600dfeba270 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc473fff700 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfeb3f40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0059d0 tx=0x7fc45c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b105ed533440e39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc46affd700 1 -- 172.21.15.33:0/317861939 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c02b070 con 0x5600dfeba270 2024-05-08T20:05:29.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc46affd700 1 -- 172.21.15.33:0/317861939 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc45c01e040 con 0x5600dfeba270 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.516+0000 7fc46affd700 1 -- 172.21.15.33:0/317861939 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45c003cd0 con 0x5600dfeba270 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 -- 172.21.15.33:0/317861939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 msgr2=0x5600dfeb3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfeb3f40 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0059d0 tx=0x7fc45c01f000 comp rx=0 tx=0).stop 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 -- 172.21.15.33:0/317861939 shutdown_connections 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb4480 0x5600dfeb48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb9950 0x5600dfeb9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 --2- 172.21.15.33:0/317861939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfeb3f40 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 -- 172.21.15.33:0/317861939 >> 172.21.15.33:0/317861939 conn(0x5600dfe121b0 msgr2=0x5600dfeae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 -- 172.21.15.33:0/317861939 shutdown_connections 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.517+0000 7fc486d09b80 1 -- 172.21.15.33:0/317861939 wait complete. 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 -- start start 2024-05-08T20:05:29.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 Processor -- start 2024-05-08T20:05:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfec01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfebd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfebdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfda0500 con 0x5600dfeb4480 2024-05-08T20:05:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfda01a0 con 0x5600dfeb9950 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfc87640 con 0x5600dfeba270 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc486d09b80 10 client.0 _ll_register_callbacks cb 0x5600dfda9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc4788eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfec01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc4788eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfec01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37948/0 (socket says 172.21.15.33:37948) 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.518+0000 7fc4788eb700 1 -- 172.21.15.33:0/274871241 learned_addr learned my addr 172.21.15.33:0/274871241 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc4790ec700 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfebdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc473fff700 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfebd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc4788eb700 1 -- 172.21.15.33:0/274871241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 msgr2=0x5600dfebdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc4788eb700 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfebdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc4788eb700 1 -- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 msgr2=0x5600dfebd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc4788eb700 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfebd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc4788eb700 1 -- 172.21.15.33:0/274871241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47410d520 con 0x5600dfeb4480 2024-05-08T20:05:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc4788eb700 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfec01f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc464099c10 tx=0x7fc46400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfd58d565b34a61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc453fff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc453fff700 1 -- 172.21.15.33:0/274871241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46409a0e0 con 0x5600dfeb4480 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc453fff700 1 -- 172.21.15.33:0/274871241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7fc464099c80 con 0x5600dfeb4480 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600dfd5d210 con 0x5600dfeb4480 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc453fff700 1 -- 172.21.15.33:0/274871241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc46409dab0 con 0x5600dfeb4480 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc486d09b80 10 client.15417 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5600dfc31b00 con 0x5600dfeb4480 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.519+0000 7fc453fff700 1 -- 172.21.15.33:0/274871241 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc4640b8080 con 0x5600dfeb4480 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc453fff700 1 -- 172.21.15.33:0/274871241 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc4640a1ce0 con 0x5600dfeb4480 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc486d09b80 10 client.15417 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc486d09b80 10 client.15417 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc486d09b80 20 client.15417 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc486d09b80 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dfecdac0 0x5600dfecfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc486d09b80 4 client.15417 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600dfe837b0 con 0x5600dfecdac0 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc473fff700 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dfecdac0 0x5600dfecfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc473fff700 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dfecdac0 0x5600dfecfeb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672b1f6c638d4cef server_cookie=6aa8fffb4fda6d8 in_seq=0 out_seq=0 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.520+0000 7fc453fff700 10 client.15417 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc453fff700 1 -- 172.21.15.33:0/274871241 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5600dfe837b0 con 0x5600dfecdac0 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc453fff700 10 client.15417 handle_command_reply: tid=0 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 client.15417 shutdown 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 msgr2=0x5600dfec01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfec01f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc464099c10 tx=0x7fc46400f3c0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 shutdown_connections 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dfecdac0 0x5600dfecfeb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfebdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc453fff700 0 client.15417 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfec01f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 --2- 172.21.15.33:0/274871241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfebd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 >> 172.21.15.33:0/274871241 conn(0x5600dfe121b0 msgr2=0x5600dfeb7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 shutdown_connections 2024-05-08T20:05:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.521+0000 7fc486d09b80 1 -- 172.21.15.33:0/274871241 wait complete. 2024-05-08T20:05:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.522+0000 7fc486d09b80 20 client.15417 trim_cache size 0 max 16384 2024-05-08T20:05:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 Processor -- start 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 -- start start 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfecfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfeae910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfeb4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfebe2c0 con 0x5600dfeb4480 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfeaf580 con 0x5600dfeb9950 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc486d09b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfeb31b0 con 0x5600dfeba270 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.537+0000 7fc4788eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfecfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfecfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37950/0 (socket says 172.21.15.33:37950) 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 -- 172.21.15.33:0/2232264406 learned_addr learned my addr 172.21.15.33:0/2232264406 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc473fff700 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfeae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4790ec700 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfeb4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 -- 172.21.15.33:0/2232264406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 msgr2=0x5600dfeb4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfeb4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 -- 172.21.15.33:0/2232264406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 msgr2=0x5600dfeae910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfeae910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 -- 172.21.15.33:0/2232264406 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600dfdca500 con 0x5600dfeb4480 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4790ec700 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfeb4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc4788eb700 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfecfeb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc4640966f0 tx=0x7fc464098230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938b2bcedda7f9b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc46b7fe700 1 -- 172.21.15.33:0/2232264406 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640b8080 con 0x5600dfeb4480 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc46b7fe700 1 -- 172.21.15.33:0/2232264406 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5600dfd5d210 con 0x5600dfeb4480 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.538+0000 7fc46b7fe700 1 -- 172.21.15.33:0/2232264406 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc464099170 con 0x5600dfeb4480 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 -- 172.21.15.33:0/2232264406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 msgr2=0x5600dfecfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfecfeb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc4640966f0 tx=0x7fc464098230 comp rx=0 tx=0).stop 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 -- 172.21.15.33:0/2232264406 shutdown_connections 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeba270 0x5600dfeb4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeb4480 0x5600dfecfeb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 --2- 172.21.15.33:0/2232264406 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfeae910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 -- 172.21.15.33:0/2232264406 >> 172.21.15.33:0/2232264406 conn(0x5600dfe121b0 msgr2=0x5600dfed47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 -- 172.21.15.33:0/2232264406 shutdown_connections 2024-05-08T20:05:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 -- 172.21.15.33:0/2232264406 wait complete. 2024-05-08T20:05:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 -- start start 2024-05-08T20:05:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.539+0000 7fc486d09b80 1 Processor -- start 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb4480 0x5600dfec4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfec0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc486d09b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfec1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc486d09b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfec5440 con 0x5600dfeba270 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc486d09b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfec15d0 con 0x5600dfeb9950 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc486d09b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600dfec1790 con 0x5600dfeb4480 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc486d09b80 10 client.0 _ll_register_callbacks cb 0x5600dfda9ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfec1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfec1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37956/0 (socket says 172.21.15.33:37956) 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 -- 172.21.15.33:0/448660493 learned_addr learned my addr 172.21.15.33:0/448660493 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4788eb700 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb4480 0x5600dfec4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc473fff700 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfec0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 -- 172.21.15.33:0/448660493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb4480 msgr2=0x5600dfec4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb4480 0x5600dfec4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 -- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 msgr2=0x5600dfec0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfec0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.540+0000 7fc4790ec700 1 -- 172.21.15.33:0/448660493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600dfc31b00 con 0x5600dfeba270 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc4790ec700 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfec1090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007bd0 tx=0x7fc46c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f497ef9074d35e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc453fff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc453fff700 1 -- 172.21.15.33:0/448660493 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0159b0 con 0x5600dfeba270 2024-05-08T20:05:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc453fff700 1 -- 172.21.15.33:0/448660493 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7fc46c015b10 con 0x5600dfeba270 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc45c01e040 con 0x5600dfeba270 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc453fff700 1 -- 172.21.15.33:0/448660493 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc46c015cd0 con 0x5600dfeba270 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 10 client.15423 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5600dfc89c70 con 0x5600dfeba270 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc453fff700 1 -- 172.21.15.33:0/448660493 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc45c01e040 con 0x5600dfeba270 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc453fff700 1 -- 172.21.15.33:0/448660493 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc46c021530 con 0x5600dfeba270 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 10 client.15423 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 10 client.15423 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 20 client.15423 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dff243a0 0x5600dff267c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 4 client.15423 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.541+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5600dfdfce60 con 0x5600dff243a0 2024-05-08T20:05:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.542+0000 7fc4788eb700 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dff243a0 0x5600dff267c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.542+0000 7fc4788eb700 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dff243a0 0x5600dff267c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3548d5be2c6efe86 server_cookie=345d8cd9021e7abd in_seq=0 out_seq=0 2024-05-08T20:05:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.542+0000 7fc453fff700 10 client.15423 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc453fff700 1 -- 172.21.15.33:0/448660493 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5600dfdfce60 con 0x5600dff243a0 2024-05-08T20:05:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc453fff700 10 client.15423 handle_command_reply: tid=0 2024-05-08T20:05:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 client.15423 shutdown 2024-05-08T20:05:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 msgr2=0x5600dfec1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfec1090 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007bd0 tx=0x7fc46c007ee0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 shutdown_connections 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5600dff243a0 0x5600dff267c0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600dfeba270 0x5600dfec1090 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5600dfeb4480 0x5600dfec4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc453fff700 0 client.15423 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 --2- 172.21.15.33:0/448660493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5600dfeb9950 0x5600dfec0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 >> 172.21.15.33:0/448660493 conn(0x5600dfe121b0 msgr2=0x5600dfeb35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 shutdown_connections 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.549+0000 7fc486d09b80 1 -- 172.21.15.33:0/448660493 wait complete. 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc486d09b80 20 client.15423 trim_cache size 0 max 16384 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:05:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:05:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:05:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:05:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4600a14c0 msgr2=0x7fc4600a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.541 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4600a14c0 0x7fc4600a3980 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc45c006010 tx=0x7fc45c00b540 comp rx=0 tx=0).stop 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc474100010 msgr2=0x7fc474198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc474100010 0x7fc474198300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc46400d980 tx=0x7fc46400dd40 comp rx=0 tx=0).stop 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 shutdown_connections 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc474198d80 0x7fc4741a3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4600a14c0 0x7fc4600a3980 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc474100010 0x7fc474198300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 --2- 172.21.15.33:0/3870141272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc474105130 0x7fc474198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 >> 172.21.15.33:0/3870141272 conn(0x7fc474076f40 msgr2=0x7fc4740fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 shutdown_connections 2024-05-08T20:05:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:29.550+0000 7fc47ab4f700 1 -- 172.21.15.33:0/3870141272 wait complete. 2024-05-08T20:05:30.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:30 smithi082 ceph-mon[46774]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-08T20:05:30.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:30 smithi132 ceph-mon[47484]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-08T20:05:30.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:30 smithi033 ceph-mon[42490]: pgmap v26: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-05-08T20:05:32.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:32 smithi082 ceph-mon[46774]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T20:05:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:32 smithi132 ceph-mon[47484]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T20:05:32.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:32 smithi033 ceph-mon[42490]: pgmap v27: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-05-08T20:05:34.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:34 smithi082 ceph-mon[46774]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T20:05:34.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:34 smithi132 ceph-mon[47484]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T20:05:34.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:34 smithi033 ceph-mon[42490]: pgmap v28: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T20:05:36.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:36 smithi082 ceph-mon[46774]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-05-08T20:05:36.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:36 smithi132 ceph-mon[47484]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-05-08T20:05:36.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:36 smithi033 ceph-mon[42490]: pgmap v29: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-05-08T20:05:38.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:38 smithi082 ceph-mon[46774]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T20:05:38.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:38 smithi132 ceph-mon[47484]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T20:05:38.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:38 smithi033 ceph-mon[42490]: pgmap v30: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T20:05:40.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:40 smithi082 ceph-mon[46774]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:05:40.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:40 smithi132 ceph-mon[47484]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:05:40.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:40 smithi033 ceph-mon[42490]: pgmap v31: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:05:42.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:42 smithi082 ceph-mon[46774]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:05:42.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:42 smithi132 ceph-mon[47484]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.698+0000 7feb13aab700 1 -- 172.21.15.33:0/1419777383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 msgr2=0x7feb0c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.698+0000 7feb13aab700 1 --2- 172.21.15.33:0/1419777383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c068760 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7feafc009990 tx=0x7feafc009ca0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 -- 172.21.15.33:0/1419777383 shutdown_connections 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 --2- 172.21.15.33:0/1419777383 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0c068ca0 0x7feb0c10dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 --2- 172.21.15.33:0/1419777383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb0c107000 0x7feb0c1073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 --2- 172.21.15.33:0/1419777383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c068760 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 -- 172.21.15.33:0/1419777383 >> 172.21.15.33:0/1419777383 conn(0x7feb0c076f10 msgr2=0x7feb0c077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:42.689 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 -- 172.21.15.33:0/1419777383 shutdown_connections 2024-05-08T20:05:42.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 -- 172.21.15.33:0/1419777383 wait complete. 2024-05-08T20:05:42.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 Processor -- start 2024-05-08T20:05:42.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.699+0000 7feb13aab700 1 -- start start 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb13aab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c1951e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb13aab700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb0c068ca0 0x7feb0c195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb13aab700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0c107000 0x7feb0c199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb13aab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19a0b0 con 0x7feb0c0682e0 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb13aab700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19a220 con 0x7feb0c107000 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb13aab700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0c19a3e0 con 0x7feb0c068ca0 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c1951e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c1951e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48734/0 (socket says 172.21.15.33:48734) 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 -- 172.21.15.33:0/3420632770 learned_addr learned my addr 172.21.15.33:0/3420632770 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11046700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb0c068ca0 0x7feb0c195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb12048700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0c107000 0x7feb0c199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 -- 172.21.15.33:0/3420632770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb0c068ca0 msgr2=0x7feb0c195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb0c068ca0 0x7feb0c195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 -- 172.21.15.33:0/3420632770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0c107000 msgr2=0x7feb0c199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0c107000 0x7feb0c199a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb11847700 1 -- 172.21.15.33:0/3420632770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0095f0 con 0x7feb0c0682e0 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.700+0000 7feb12048700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0c107000 0x7feb0c199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.701+0000 7feb11847700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c1951e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feb08009c70 tx=0x7feb08009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.701+0000 7feb02ffd700 1 -- 172.21.15.33:0/3420632770 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08007bd0 con 0x7feb0c0682e0 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.701+0000 7feb02ffd700 1 -- 172.21.15.33:0/3420632770 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feb08015040 con 0x7feb0c0682e0 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.701+0000 7feb02ffd700 1 -- 172.21.15.33:0/3420632770 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080185b0 con 0x7feb0c0682e0 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.701+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0c19a6c0 con 0x7feb0c0682e0 2024-05-08T20:05:42.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.701+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c1a1f00 con 0x7feb0c0682e0 2024-05-08T20:05:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.704+0000 7feb02ffd700 1 -- 172.21.15.33:0/3420632770 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7feb080193f0 con 0x7feb0c0682e0 2024-05-08T20:05:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.705+0000 7feb02ffd700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7feaf80a1440 0x7feaf80a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.705+0000 7feb02ffd700 1 -- 172.21.15.33:0/3420632770 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7feb080d0df0 con 0x7feb0c0682e0 2024-05-08T20:05:42.694 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.705+0000 7feb11046700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7feaf80a1440 0x7feaf80a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.695 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.706+0000 7feb11046700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7feaf80a1440 0x7feaf80a3900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feafc00b2e0 tx=0x7feafc005960 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.706+0000 7feb1fc65b80 1 Processor -- start 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb1fc65b80 1 -- start start 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ed950 0x55de1a7edd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ee270 0x55de1a7e7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7e8480 0x55de1a7e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a73f0f0 con 0x55de1a7ed950 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a73cab0 con 0x55de1a7ee270 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a7383a0 con 0x55de1a7e8480 2024-05-08T20:05:42.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11847700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ed950 0x55de1a7edd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11847700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ed950 0x55de1a7edd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48748/0 (socket says 172.21.15.33:48748) 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11847700 1 -- 172.21.15.33:0/2452543697 learned_addr learned my addr 172.21.15.33:0/2452543697 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb12048700 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7e8480 0x55de1a7e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11046700 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ee270 0x55de1a7e7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11847700 1 -- 172.21.15.33:0/2452543697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7e8480 msgr2=0x55de1a7e88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11847700 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7e8480 0x55de1a7e88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11847700 1 -- 172.21.15.33:0/2452543697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ee270 msgr2=0x55de1a7e7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.707+0000 7feb11847700 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ee270 0x55de1a7e7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.708+0000 7feb11847700 1 -- 172.21.15.33:0/2452543697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de1a5b9350 con 0x55de1a7ed950 2024-05-08T20:05:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.708+0000 7feb11847700 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ed950 0x55de1a7edd30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7feb08007550 tx=0x7feb0809d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83a0d493597e208 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:42.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.708+0000 7feaf7fff700 1 -- 172.21.15.33:0/2452543697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080a6110 con 0x55de1a7ed950 2024-05-08T20:05:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.708+0000 7feaf7fff700 1 -- 172.21.15.33:0/2452543697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feb0809c030 con 0x55de1a7ed950 2024-05-08T20:05:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.708+0000 7feaf7fff700 1 -- 172.21.15.33:0/2452543697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0809d3e0 con 0x55de1a7ed950 2024-05-08T20:05:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.709+0000 7feb1fc65b80 1 -- 172.21.15.33:0/2452543697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ed950 msgr2=0x55de1a7edd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.709+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ed950 0x55de1a7edd30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7feb08007550 tx=0x7feb0809d900 comp rx=0 tx=0).stop 2024-05-08T20:05:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.709+0000 7feb1fc65b80 1 -- 172.21.15.33:0/2452543697 shutdown_connections 2024-05-08T20:05:42.703 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.709+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7e8480 0x55de1a7e88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.709+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ed950 0x55de1a7edd30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.709+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/2452543697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ee270 0x55de1a7e7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.709+0000 7feb1fc65b80 1 -- 172.21.15.33:0/2452543697 >> 172.21.15.33:0/2452543697 conn(0x55de1a7461b0 msgr2=0x55de1a7e2840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.710+0000 7feb1fc65b80 1 -- 172.21.15.33:0/2452543697 shutdown_connections 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.710+0000 7feb1fc65b80 1 -- 172.21.15.33:0/2452543697 wait complete. 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.710+0000 7feb1fc65b80 1 -- start start 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.710+0000 7feb1fc65b80 1 Processor -- start 2024-05-08T20:05:42.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7e8480 0x55de1a7f4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ed950 0x55de1a7f1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ee270 0x55de1a7f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a6d4500 con 0x55de1a7e8480 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a6d41a0 con 0x55de1a7ed950 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a5bb640 con 0x55de1a7ee270 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb1fc65b80 10 client.0 _ll_register_callbacks cb 0x55de1a6ddad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ee270 0x55de1a7f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ee270 0x55de1a7f1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:37428/0 (socket says 172.21.15.33:37428) 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 -- 172.21.15.33:0/219616667 learned_addr learned my addr 172.21.15.33:0/219616667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:42.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb11046700 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ed950 0x55de1a7f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb11847700 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7e8480 0x55de1a7f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 -- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ed950 msgr2=0x55de1a7f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ed950 0x55de1a7f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 -- 172.21.15.33:0/219616667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7e8480 msgr2=0x55de1a7f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7e8480 0x55de1a7f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.711+0000 7feb12048700 1 -- 172.21.15.33:0/219616667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0c1a1f00 con 0x55de1a7ee270 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feb12048700 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ee270 0x55de1a7f1c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb04007cd0 tx=0x7feb04012240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92790907c69e161a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feaf57fa700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-05-08T20:05:42.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feaf57fa700 1 -- 172.21.15.33:0/219616667 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04009af0 con 0x55de1a7ee270 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55de1a691210 con 0x55de1a7ee270 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feaf57fa700 1 -- 172.21.15.33:0/219616667 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7feb04012d80 con 0x55de1a7ee270 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feaf57fa700 1 -- 172.21.15.33:0/219616667 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb04016420 con 0x55de1a7ee270 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feb1fc65b80 10 client.25261 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55de1a565b00 con 0x55de1a7ee270 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.712+0000 7feaf57fa700 1 -- 172.21.15.33:0/219616667 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55de1a691210 con 0x55de1a7ee270 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feaf57fa700 1 -- 172.21.15.33:0/219616667 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7feb04014040 con 0x55de1a7ee270 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feb1fc65b80 10 client.25261 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feb1fc65b80 10 client.25261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feb1fc65b80 20 client.25261 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a80a430 0x55de1a80c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feb1fc65b80 4 client.25261 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:05:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55de1a7b77b0 con 0x55de1a80a430 2024-05-08T20:05:42.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.713+0000 7feb11847700 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a80a430 0x55de1a80c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.714+0000 7feaf57fa700 10 client.25261 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.714+0000 7feb11847700 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a80a430 0x55de1a80c850 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0a5567d0b0fa91b server_cookie=95562adec2dae630 in_seq=0 out_seq=0 2024-05-08T20:05:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.714+0000 7feaf57fa700 1 -- 172.21.15.33:0/219616667 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55de1a7b77b0 con 0x55de1a80a430 2024-05-08T20:05:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.714+0000 7feaf57fa700 10 client.25261 handle_command_reply: tid=0 2024-05-08T20:05:42.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.714+0000 7feb1fc65b80 1 client.25261 shutdown 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ee270 msgr2=0x55de1a7f1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ee270 0x55de1a7f1c20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feb04007cd0 tx=0x7feb04012240 comp rx=0 tx=0).stop 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 shutdown_connections 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a80a430 0x55de1a80c850 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ee270 0x55de1a7f1c20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7e8480 0x55de1a7f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/219616667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7ed950 0x55de1a7f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 >> 172.21.15.33:0/219616667 conn(0x55de1a7461b0 msgr2=0x55de1a7e6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:42.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feaf57fa700 0 client.25261 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 shutdown_connections 2024-05-08T20:05:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 1 -- 172.21.15.33:0/219616667 wait complete. 2024-05-08T20:05:42.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.715+0000 7feb1fc65b80 20 client.25261 trim_cache size 0 max 16384 2024-05-08T20:05:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.741+0000 7feb1fc65b80 1 Processor -- start 2024-05-08T20:05:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.741+0000 7feb1fc65b80 1 -- start start 2024-05-08T20:05:42.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a7e2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a7e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a7dd330 con 0x55de1a7ee270 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a7e44b0 con 0x55de1a7e8480 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a7ec190 con 0x55de1a7ed950 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7e77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48774/0 (socket says 172.21.15.33:48774) 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 -- 172.21.15.33:0/1443815546 learned_addr learned my addr 172.21.15.33:0/1443815546 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb11847700 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a7e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb11046700 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a7e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 -- 172.21.15.33:0/1443815546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 msgr2=0x55de1a7e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a7e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 -- 172.21.15.33:0/1443815546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 msgr2=0x55de1a7e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a7e2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb12048700 1 -- 172.21.15.33:0/1443815546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55de1a6fe500 con 0x55de1a7ee270 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.742+0000 7feb11847700 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a7e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.743+0000 7feb12048700 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7e77e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7feb04015490 tx=0x7feb04009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed214aef94fbfd1a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.743+0000 7feb00da4700 1 -- 172.21.15.33:0/1443815546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04012d80 con 0x55de1a7ee270 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.743+0000 7feb00da4700 1 -- 172.21.15.33:0/1443815546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feb0400f040 con 0x55de1a7ee270 2024-05-08T20:05:42.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.743+0000 7feb00da4700 1 -- 172.21.15.33:0/1443815546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04015770 con 0x55de1a7ee270 2024-05-08T20:05:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 -- 172.21.15.33:0/1443815546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 msgr2=0x55de1a7e77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7e77e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7feb04015490 tx=0x7feb04009330 comp rx=0 tx=0).stop 2024-05-08T20:05:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 -- 172.21.15.33:0/1443815546 shutdown_connections 2024-05-08T20:05:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7e77e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a7e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/1443815546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a7e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 -- 172.21.15.33:0/1443815546 >> 172.21.15.33:0/1443815546 conn(0x55de1a7461b0 msgr2=0x55de1a7dee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 -- 172.21.15.33:0/1443815546 shutdown_connections 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.744+0000 7feb1fc65b80 1 -- 172.21.15.33:0/1443815546 wait complete. 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 -- start start 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 Processor -- start 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a801470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a8019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7ff450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a7ffb60 con 0x55de1a7ee270 2024-05-08T20:05:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a7ffcd0 con 0x55de1a7e8480 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55de1a7ffe90 con 0x55de1a7ed950 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb1fc65b80 10 client.0 _ll_register_callbacks cb 0x7feb04007500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb12048700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb12048700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7ff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48784/0 (socket says 172.21.15.33:48784) 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.745+0000 7feb12048700 1 -- 172.21.15.33:0/3202860168 learned_addr learned my addr 172.21.15.33:0/3202860168 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb11847700 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a801470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb11046700 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a8019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb12048700 1 -- 172.21.15.33:0/3202860168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 msgr2=0x55de1a8019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb12048700 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a8019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb12048700 1 -- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 msgr2=0x55de1a801470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb12048700 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a801470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb12048700 1 -- 172.21.15.33:0/3202860168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55de1a565b00 con 0x55de1a7ee270 2024-05-08T20:05:42.740 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb12048700 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7ff450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feb04016970 tx=0x7feb04009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d812ca7a1334dab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feaf57fa700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feaf57fa700 1 -- 172.21.15.33:0/3202860168 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04012d80 con 0x55de1a7ee270 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feaf57fa700 1 -- 172.21.15.33:0/3202860168 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8570+0+0 (secure 0 0 0) 0x7feb04004a90 con 0x55de1a7ee270 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.746+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb0809c030 con 0x55de1a7ee270 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feaf57fa700 1 -- 172.21.15.33:0/3202860168 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb04016790 con 0x55de1a7ee270 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 10 client.15441 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55de1a5bdc70 con 0x55de1a7ee270 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feaf57fa700 1 -- 172.21.15.33:0/3202860168 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feb0403f020 con 0x55de1a7ee270 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feaf57fa700 1 -- 172.21.15.33:0/3202860168 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7feb04031070 con 0x55de1a7ee270 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 10 client.15441 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 10 client.15441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 20 client.15441 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a8606c0 0x55de1a862ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 4 client.15441 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:05:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55de1a730e60 con 0x55de1a8606c0 2024-05-08T20:05:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.747+0000 7feb11847700 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a8606c0 0x55de1a862ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.748+0000 7feaf57fa700 10 client.15441 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.748+0000 7feb11847700 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a8606c0 0x55de1a862ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3083402b2ffb92d server_cookie=c39af2fd55250d43 in_seq=0 out_seq=0 2024-05-08T20:05:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feaf57fa700 1 -- 172.21.15.33:0/3202860168 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55de1a730e60 con 0x55de1a8606c0 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feaf57fa700 10 client.15441 handle_command_reply: tid=0 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 client.15441 shutdown 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 msgr2=0x55de1a7ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7ff450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7feb04016970 tx=0x7feb04009560 comp rx=0 tx=0).stop 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 shutdown_connections 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55de1a8606c0 0x55de1a862ab0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55de1a7ee270 0x55de1a7ff450 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55de1a7e8480 0x55de1a801470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feaf57fa700 0 client.15441 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 --2- 172.21.15.33:0/3202860168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55de1a7ed950 0x55de1a8019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 >> 172.21.15.33:0/3202860168 conn(0x55de1a7461b0 msgr2=0x55de1a8111b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 shutdown_connections 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 1 -- 172.21.15.33:0/3202860168 wait complete. 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.752+0000 7feb1fc65b80 20 client.15441 trim_cache size 0 max 16384 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:05:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:05:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7feaf80a1440 msgr2=0x7feaf80a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7feaf80a1440 0x7feaf80a3900 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7feafc00b2e0 tx=0x7feafc005960 comp rx=0 tx=0).stop 2024-05-08T20:05:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 msgr2=0x7feb0c1951e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c1951e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feb08009c70 tx=0x7feb08009f80 comp rx=0 tx=0).stop 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 shutdown_connections 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7feb0c107000 0x7feb0c199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7feaf80a1440 0x7feaf80a3900 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb0c0682e0 0x7feb0c1951e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 --2- 172.21.15.33:0/3420632770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb0c068ca0 0x7feb0c195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 >> 172.21.15.33:0/3420632770 conn(0x7feb0c076f10 msgr2=0x7feb0c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 shutdown_connections 2024-05-08T20:05:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:42.753+0000 7feb13aab700 1 -- 172.21.15.33:0/3420632770 wait complete. 2024-05-08T20:05:42.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:42 smithi033 ceph-mon[42490]: pgmap v32: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-05-08T20:05:44.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:44 smithi082 ceph-mon[46774]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-08T20:05:44.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:44 smithi132 ceph-mon[47484]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-08T20:05:44.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:44 smithi033 ceph-mon[42490]: pgmap v33: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 9 op/s 2024-05-08T20:05:45.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:45 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-08T20:05:45.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:45 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-08T20:05:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:45 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-08T20:05:45.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:45 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-08T20:05:45.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:45 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2024-05-08T20:05:45.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:45 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-05-08T20:05:46.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:46 smithi082 ceph-mon[46774]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:05:46.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-08T20:05:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:46 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-08T20:05:46.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:46 smithi082 ceph-mon[46774]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T20:05:46.623 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:46 smithi132 ceph-mon[47484]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:05:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-08T20:05:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:46 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-08T20:05:46.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:46 smithi132 ceph-mon[47484]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T20:05:46.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:46 smithi033 ceph-mon[42490]: pgmap v34: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:05:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2024-05-08T20:05:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:46 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-05-08T20:05:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:46 smithi033 ceph-mon[42490]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T20:05:47.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:47 smithi132 ceph-mon[47484]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T20:05:47.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:47 smithi033 ceph-mon[42490]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T20:05:47.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:47 smithi082 ceph-mon[46774]: osdmap e86: 12 total, 12 up, 12 in 2024-05-08T20:05:48.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:48 smithi033 ceph-mon[42490]: pgmap v37: 97 pgs: 2 peering, 95 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:48.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:48 smithi082 ceph-mon[46774]: pgmap v37: 97 pgs: 2 peering, 95 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:48.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:48 smithi132 ceph-mon[47484]: pgmap v37: 97 pgs: 2 peering, 95 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:50.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:50 smithi033 ceph-mon[42490]: pgmap v38: 97 pgs: 2 peering, 95 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:50.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:50 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:05:50.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:50 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:05:50.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:50 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:05:50.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:50 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:05:50.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:50 smithi082 ceph-mon[46774]: pgmap v38: 97 pgs: 2 peering, 95 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:50.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:50 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:05:50.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:50 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:05:50.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:50 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:05:50.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:50 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:05:50.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:50 smithi132 ceph-mon[47484]: pgmap v38: 97 pgs: 2 peering, 95 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:50.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:50 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:05:50.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:50 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:05:50.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:50 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:05:50.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:50 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:05:52.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:52 smithi033 ceph-mon[42490]: pgmap v39: 97 pgs: 1 peering, 96 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T20:05:52.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:52 smithi082 ceph-mon[46774]: pgmap v39: 97 pgs: 1 peering, 96 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T20:05:52.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:52 smithi132 ceph-mon[47484]: pgmap v39: 97 pgs: 1 peering, 96 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 383 B/s wr, 7 op/s 2024-05-08T20:05:54.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:54 smithi033 ceph-mon[42490]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:54.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:54 smithi082 ceph-mon[46774]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:54.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:54 smithi132 ceph-mon[47484]: pgmap v40: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 383 B/s wr, 8 op/s 2024-05-08T20:05:55.882 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/936913637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f681009c0 msgr2=0x7f1f68104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/936913637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f681009c0 0x7f1f68104a00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009990 tx=0x7f1f5c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/936913637 shutdown_connections 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/936913637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f68105130 0x7f1f6810ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/936913637 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f68100010 0x7f1f681003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/936913637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f681009c0 0x7f1f68104a00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/936913637 >> 172.21.15.33:0/936913637 conn(0x7f1f68076f40 msgr2=0x7f1f68077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/936913637 shutdown_connections 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/936913637 wait complete. 2024-05-08T20:05:55.883 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.893+0000 7f1f6e7d0700 1 Processor -- start 2024-05-08T20:05:55.884 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6e7d0700 1 -- start start 2024-05-08T20:05:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6e7d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f68100010 0x7f1f6810d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.885 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6e7d0700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f68105130 0x7f1f6810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6e7d0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f6810deb0 0x7f1f681a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6e7d0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681a5c20 con 0x7f1f68100010 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6e7d0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681a5d60 con 0x7f1f6810deb0 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6e7d0700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f681a5f20 con 0x7f1f68105130 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6cd6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f6810deb0 0x7f1f681a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6cd6d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f6810deb0 0x7f1f681a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:36854/0 (socket says 172.21.15.33:36854) 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.894+0000 7f1f6cd6d700 1 -- 172.21.15.33:0/2095580897 learned_addr learned my addr 172.21.15.33:0/2095580897 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f677fe700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f68105130 0x7f1f6810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f68100010 0x7f1f6810d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6cd6d700 1 -- 172.21.15.33:0/2095580897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f68105130 msgr2=0x7f1f6810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6cd6d700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f68105130 0x7f1f6810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6cd6d700 1 -- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f68100010 msgr2=0x7f1f6810d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.886 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6cd6d700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f68100010 0x7f1f6810d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6cd6d700 1 -- 172.21.15.33:0/2095580897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c0095f0 con 0x7f1f6810deb0 2024-05-08T20:05:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6cd6d700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f6810deb0 0x7f1f681a5650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000ef30 tx=0x7f1f6000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f657fa700 1 -- 172.21.15.33:0/2095580897 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f60018070 con 0x7f1f6810deb0 2024-05-08T20:05:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f657fa700 1 -- 172.21.15.33:0/2095580897 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f6000f040 con 0x7f1f6810deb0 2024-05-08T20:05:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f657fa700 1 -- 172.21.15.33:0/2095580897 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6000cd50 con 0x7f1f6810deb0 2024-05-08T20:05:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f681a61a0 con 0x7f1f6810deb0 2024-05-08T20:05:55.887 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.895+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f681a6660 con 0x7f1f6810deb0 2024-05-08T20:05:55.888 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.899+0000 7f1f657fa700 1 -- 172.21.15.33:0/2095580897 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7f1f60003a00 con 0x7f1f6810deb0 2024-05-08T20:05:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.900+0000 7f1f657fa700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f1f500a14c0 0x7f1f500a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.900+0000 7f1f657fa700 1 -- 172.21.15.33:0/2095580897 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f1f600ccb40 con 0x7f1f6810deb0 2024-05-08T20:05:55.889 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.900+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f1f500a14c0 0x7f1f500a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.901+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f1f500a14c0 0x7f1f500a3980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f58005950 tx=0x7f1f5800a300 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.901+0000 7f1f7a98ab80 1 Processor -- start 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.901+0000 7f1f7a98ab80 1 -- start start 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.901+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.901+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9ba480 0x56344c9ba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c9110f0 con 0x56344c9ba480 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c90eab0 con 0x56344c9bf950 2024-05-08T20:05:55.891 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c90a3a0 con 0x56344c9c0270 2024-05-08T20:05:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f6cd6d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9ba480 0x56344c9ba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9bfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:36870/0 (socket says 172.21.15.33:36870) 2024-05-08T20:05:55.893 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 -- 172.21.15.33:0/2703543060 learned_addr learned my addr 172.21.15.33:0/2703543060 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f677fe700 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 -- 172.21.15.33:0/2703543060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 msgr2=0x56344c9b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 -- 172.21.15.33:0/2703543060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9ba480 msgr2=0x56344c9ba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9ba480 0x56344c9ba8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 -- 172.21.15.33:0/2703543060 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56344c78b350 con 0x56344c9bf950 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f6cd6d700 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9ba480 0x56344c9ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.902+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9bfd30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800fde0 tx=0x7f1f58012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ce1d022470191a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.903+0000 7f1f4e7fc700 1 -- 172.21.15.33:0/2703543060 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f580108c0 con 0x56344c9bf950 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.903+0000 7f1f4e7fc700 1 -- 172.21.15.33:0/2703543060 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f58020070 con 0x56344c9bf950 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.903+0000 7f1f4e7fc700 1 -- 172.21.15.33:0/2703543060 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58025e90 con 0x56344c9bf950 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.903+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2703543060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 msgr2=0x56344c9bfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.894 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.903+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9bfd30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800fde0 tx=0x7f1f58012000 comp rx=0 tx=0).stop 2024-05-08T20:05:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2703543060 shutdown_connections 2024-05-08T20:05:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9ba480 0x56344c9ba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9bfd30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2703543060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2703543060 >> 172.21.15.33:0/2703543060 conn(0x56344c9181b0 msgr2=0x56344c9b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2703543060 shutdown_connections 2024-05-08T20:05:55.895 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2703543060 wait complete. 2024-05-08T20:05:55.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 -- start start 2024-05-08T20:05:55.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.904+0000 7f1f7a98ab80 1 Processor -- start 2024-05-08T20:05:55.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9ba480 0x56344c9c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.898 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c8a6500 con 0x56344c9bf950 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c8a61a0 con 0x56344c9ba480 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c78d640 con 0x56344c9c0270 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f7a98ab80 10 client.0 _ll_register_callbacks cb 0x56344c8afad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f6cd6d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f6cd6d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9c3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:43402/0 (socket says 172.21.15.33:43402) 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f6cd6d700 1 -- 172.21.15.33:0/2927863808 learned_addr learned my addr 172.21.15.33:0/2927863808 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9ba480 0x56344c9c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f67fff700 1 -- 172.21.15.33:0/2927863808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 msgr2=0x56344c9c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f67fff700 1 -- 172.21.15.33:0/2927863808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 msgr2=0x56344c9c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.899 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f67fff700 1 -- 172.21.15.33:0/2927863808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5800fa90 con 0x56344c9ba480 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.905+0000 7f1f6cd6d700 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f67fff700 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9ba480 0x56344c9c6200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800f750 tx=0x7f1f58025470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d564c36a3f2367aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f477fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f477fe700 1 -- 172.21.15.33:0/2927863808 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f580108c0 con 0x56344c9ba480 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56344c863210 con 0x56344c9ba480 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f477fe700 1 -- 172.21.15.33:0/2927863808 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f1f58010a20 con 0x56344c9ba480 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f477fe700 1 -- 172.21.15.33:0/2927863808 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f58010be0 con 0x56344c9ba480 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f7a98ab80 10 client.25319 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56344c737b00 con 0x56344c9ba480 2024-05-08T20:05:55.900 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.906+0000 7f1f477fe700 1 -- 172.21.15.33:0/2927863808 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x56344c863210 con 0x56344c9ba480 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f477fe700 1 -- 172.21.15.33:0/2927863808 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1f5801b420 con 0x56344c9ba480 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f7a98ab80 10 client.25319 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f7a98ab80 10 client.25319 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f7a98ab80 20 client.25319 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344c9d2360 0x56344c9d4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f7a98ab80 4 client.25319 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56344c9897b0 con 0x56344c9d2360 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f677fe700 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344c9d2360 0x56344c9d4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f477fe700 10 client.25319 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.907+0000 7f1f677fe700 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344c9d2360 0x56344c9d4750 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd69c783e1b00e3b server_cookie=b3d83a9aa280c5d3 in_seq=0 out_seq=0 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f477fe700 1 -- 172.21.15.33:0/2927863808 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56344c9897b0 con 0x56344c9d2360 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f477fe700 10 client.25319 handle_command_reply: tid=0 2024-05-08T20:05:55.901 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 client.25319 shutdown 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9ba480 msgr2=0x56344c9c6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9ba480 0x56344c9c6200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1f5800f750 tx=0x7f1f58025470 comp rx=0 tx=0).stop 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 shutdown_connections 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344c9d2360 0x56344c9d4750 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9c0270 0x56344c9c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9ba480 0x56344c9c6200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/2927863808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 >> 172.21.15.33:0/2927863808 conn(0x56344c9181b0 msgr2=0x56344c9b8f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f477fe700 0 client.25319 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 shutdown_connections 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.908+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/2927863808 wait complete. 2024-05-08T20:05:55.902 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.909+0000 7f1f7a98ab80 20 client.25319 trim_cache size 0 max 16384 2024-05-08T20:05:55.928 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 Processor -- start 2024-05-08T20:05:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 -- start start 2024-05-08T20:05:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9c0270 0x56344c9b6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c9b60f0 con 0x56344c9bf950 2024-05-08T20:05:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c9bac10 con 0x56344c9c0270 2024-05-08T20:05:55.929 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.939+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c9b5330 con 0x56344c9ba480 2024-05-08T20:05:55.930 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:43406/0 (socket says 172.21.15.33:43406) 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 -- 172.21.15.33:0/3072971120 learned_addr learned my addr 172.21.15.33:0/3072971120 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f6cd6d700 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9c0270 0x56344c9b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f677fe700 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 -- 172.21.15.33:0/3072971120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9c0270 msgr2=0x56344c9b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9c0270 0x56344c9b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 -- 172.21.15.33:0/3072971120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 msgr2=0x56344c9b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 -- 172.21.15.33:0/3072971120 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56344c8d0500 con 0x56344c9ba480 2024-05-08T20:05:55.931 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f677fe700 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:05:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.940+0000 7f1f67fff700 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cf690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f5801b7b0 tx=0x7f1f5800fda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba7c1a4d69580f61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.941+0000 7f1f4effd700 1 -- 172.21.15.33:0/3072971120 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5800a960 con 0x56344c9ba480 2024-05-08T20:05:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.941+0000 7f1f4effd700 1 -- 172.21.15.33:0/3072971120 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f58014070 con 0x56344c9ba480 2024-05-08T20:05:55.932 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.941+0000 7f1f4effd700 1 -- 172.21.15.33:0/3072971120 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f58004830 con 0x56344c9ba480 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/3072971120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 msgr2=0x56344c9cf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cf690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1f5801b7b0 tx=0x7f1f5800fda0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/3072971120 shutdown_connections 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9c0270 0x56344c9b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cf690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/3072971120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9bf950 0x56344c9b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/3072971120 >> 172.21.15.33:0/3072971120 conn(0x56344c9181b0 msgr2=0x56344c9c5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:55.935 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/3072971120 shutdown_connections 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/3072971120 wait complete. 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.942+0000 7f1f7a98ab80 1 -- start start 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 1 Processor -- start 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9c0270 0x56344c9c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c9c6000 con 0x56344c9c0270 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344c9c6170 con 0x56344c9bf950 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56344ca28570 con 0x56344c9ba480 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f7a98ab80 10 client.0 _ll_register_callbacks cb 0x56344c8afad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:05:55.936 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f677fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:36894/0 (socket says 172.21.15.33:36894) 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.943+0000 7f1f677fe700 1 -- 172.21.15.33:0/1910298985 learned_addr learned my addr 172.21.15.33:0/1910298985 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f67fff700 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f677fe700 1 -- 172.21.15.33:0/1910298985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 msgr2=0x56344c9cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f677fe700 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f677fe700 1 -- 172.21.15.33:0/1910298985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9c0270 msgr2=0x56344c9c58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f677fe700 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9c0270 0x56344c9c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f677fe700 1 -- 172.21.15.33:0/1910298985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56344c737b00 con 0x56344c9bf950 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f677fe700 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9c53b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009990 tx=0x7f1f5c005410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d44b02a5c016dee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f477fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f477fe700 1 -- 172.21.15.33:0/1910298985 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5c01d070 con 0x56344c9bf950 2024-05-08T20:05:55.937 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f477fe700 1 -- 172.21.15.33:0/1910298985 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f1f5c00bd40 con 0x56344c9bf950 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.944+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f58020070 con 0x56344c9bf950 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f477fe700 1 -- 172.21.15.33:0/1910298985 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f5c027040 con 0x56344c9bf950 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 10 client.25325 fetch_fsmap learned FSMap version 26 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x56344c78fc70 con 0x56344c9bf950 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f477fe700 1 -- 172.21.15.33:0/1910298985 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f58020070 con 0x56344c9bf950 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f477fe700 1 -- 172.21.15.33:0/1910298985 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1f5c004870 con 0x56344c9bf950 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 10 client.25325 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 10 client.25325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 20 client.25325 populate_metadata read hostname 'smithi033' 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344ca29c90 0x56344ca2c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 4 client.25325 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56344c902e60 con 0x56344ca29c90 2024-05-08T20:05:55.938 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.945+0000 7f1f67fff700 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344ca29c90 0x56344ca2c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:05:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.946+0000 7f1f477fe700 10 client.25325 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:55.939 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.946+0000 7f1f67fff700 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344ca29c90 0x56344ca2c0b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8f8c9e2a75dd72 server_cookie=18ddec50c0141d93 in_seq=0 out_seq=0 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.949+0000 7f1f477fe700 1 -- 172.21.15.33:0/1910298985 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56344c902e60 con 0x56344ca29c90 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.949+0000 7f1f477fe700 10 client.25325 handle_command_reply: tid=0 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.949+0000 7f1f7a98ab80 1 client.25325 shutdown 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 msgr2=0x56344c9c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9c53b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009990 tx=0x7f1f5c005410 comp rx=0 tx=0).stop 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 shutdown_connections 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56344ca29c90 0x56344ca2c0b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56344c9c0270 0x56344c9c58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.940 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56344c9ba480 0x56344c9cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 --2- 172.21.15.33:0/1910298985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56344c9bf950 0x56344c9c53b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 >> 172.21.15.33:0/1910298985 conn(0x56344c9181b0 msgr2=0x56344c9e05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f477fe700 0 client.25325 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 shutdown_connections 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 1 -- 172.21.15.33:0/1910298985 wait complete. 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.950+0000 7f1f7a98ab80 20 client.25325 trim_cache size 0 max 16384 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:05:55.941 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:05:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f1f500a14c0 msgr2=0x7f1f500a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f1f500a14c0 0x7f1f500a3980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1f58005950 tx=0x7f1f5800a300 comp rx=0 tx=0).stop 2024-05-08T20:05:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f6810deb0 msgr2=0x7f1f681a5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:05:55.942 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f6810deb0 0x7f1f681a5650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000ef30 tx=0x7f1f6000c3a0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 shutdown_connections 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f6810deb0 0x7f1f681a5650 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f1f500a14c0 0x7f1f500a3980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f68100010 0x7f1f6810d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 --2- 172.21.15.33:0/2095580897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f68105130 0x7f1f6810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 >> 172.21.15.33:0/2095580897 conn(0x7f1f68076f40 msgr2=0x7f1f680fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 shutdown_connections 2024-05-08T20:05:55.943 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:05:55.951+0000 7f1f6e7d0700 1 -- 172.21.15.33:0/2095580897 wait complete. 2024-05-08T20:05:56.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:56 smithi033 ceph-mon[42490]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 310 B/s wr, 6 op/s 2024-05-08T20:05:56.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:56 smithi082 ceph-mon[46774]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 310 B/s wr, 6 op/s 2024-05-08T20:05:56.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:56 smithi132 ceph-mon[47484]: pgmap v41: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 310 B/s wr, 6 op/s 2024-05-08T20:05:58.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:05:58 smithi033 ceph-mon[42490]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 282 B/s wr, 5 op/s 2024-05-08T20:05:58.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:05:58 smithi082 ceph-mon[46774]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 282 B/s wr, 5 op/s 2024-05-08T20:05:58.873 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:05:58 smithi132 ceph-mon[47484]: pgmap v42: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 282 B/s wr, 5 op/s 2024-05-08T20:06:00.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:00 smithi033 ceph-mon[42490]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T20:06:00.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:00 smithi082 ceph-mon[46774]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T20:06:00.873 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:00 smithi132 ceph-mon[47484]: pgmap v43: 97 pgs: 97 active+clean; 1.4 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 255 B/s wr, 5 op/s 2024-05-08T20:06:01.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:01 smithi033 ceph-mon[42490]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T20:06:01.871 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:01 smithi082 ceph-mon[46774]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T20:06:01.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:01 smithi132 ceph-mon[47484]: pgmap v44: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-05-08T20:06:04.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:04 smithi033 ceph-mon[42490]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:04.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:04 smithi082 ceph-mon[46774]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:04.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:04 smithi132 ceph-mon[47484]: pgmap v45: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:06.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:06 smithi033 ceph-mon[42490]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:06.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:06 smithi082 ceph-mon[46774]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:06.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:06 smithi132 ceph-mon[47484]: pgmap v46: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:08.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:08 smithi033 ceph-mon[42490]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:06:08.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:08 smithi082 ceph-mon[46774]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:06:08.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:08 smithi132 ceph-mon[47484]: pgmap v47: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:06:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.132+0000 7fc56e47a700 1 -- 172.21.15.33:0/2888628035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 msgr2=0x7fc568068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.122 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.132+0000 7fc56e47a700 1 --2- 172.21.15.33:0/2888628035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 0x7fc568068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc55c009990 tx=0x7fc55c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.133+0000 7fc56e47a700 1 -- 172.21.15.33:0/2888628035 shutdown_connections 2024-05-08T20:06:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.133+0000 7fc56e47a700 1 --2- 172.21.15.33:0/2888628035 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568068ca0 0x7fc56810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.133+0000 7fc56e47a700 1 --2- 172.21.15.33:0/2888628035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc568107000 0x7fc5681073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.133+0000 7fc56e47a700 1 --2- 172.21.15.33:0/2888628035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 0x7fc568068760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.133+0000 7fc56e47a700 1 -- 172.21.15.33:0/2888628035 >> 172.21.15.33:0/2888628035 conn(0x7fc568076f10 msgr2=0x7fc568077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.133+0000 7fc56e47a700 1 -- 172.21.15.33:0/2888628035 shutdown_connections 2024-05-08T20:06:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.133+0000 7fc56e47a700 1 -- 172.21.15.33:0/2888628035 wait complete. 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 Processor -- start 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 -- start start 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 0x7fc5681973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc568068ca0 0x7fc568197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568107000 0x7fc56819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56819c2f0 con 0x7fc568107000 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56819c460 con 0x7fc5680682e0 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.134+0000 7fc56e47a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56819c620 con 0x7fc568068ca0 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568107000 0x7fc56819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568107000 0x7fc56819bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56268/0 (socket says 172.21.15.33:56268) 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 -- 172.21.15.33:0/3337509104 learned_addr learned my addr 172.21.15.33:0/3337509104 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc567fff700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 0x7fc5681973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc5677fe700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc568068ca0 0x7fc568197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 -- 172.21.15.33:0/3337509104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc568068ca0 msgr2=0x7fc568197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc568068ca0 0x7fc568197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 -- 172.21.15.33:0/3337509104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 msgr2=0x7fc5681973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 0x7fc5681973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 -- 172.21.15.33:0/3337509104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c0095f0 con 0x7fc568107000 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc567fff700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 0x7fc5681973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc56ca17700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568107000 0x7fc56819bcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc56000ef30 tx=0x7fc56000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc5657fa700 1 -- 172.21.15.33:0/3337509104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560018070 con 0x7fc568107000 2024-05-08T20:06:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.135+0000 7fc5657fa700 1 -- 172.21.15.33:0/3337509104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc56000f040 con 0x7fc568107000 2024-05-08T20:06:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.136+0000 7fc5657fa700 1 -- 172.21.15.33:0/3337509104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000ce00 con 0x7fc568107000 2024-05-08T20:06:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.136+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56819c8a0 con 0x7fc568107000 2024-05-08T20:06:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.136+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56806aba0 con 0x7fc568107000 2024-05-08T20:06:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.139+0000 7fc5657fa700 1 -- 172.21.15.33:0/3337509104 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 24) v1 ==== 136157+0+0 (secure 0 0 0) 0x7fc560003a00 con 0x7fc568107000 2024-05-08T20:06:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.139+0000 7fc5657fa700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc5500a1440 0x7fc5500a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.139+0000 7fc5657fa700 1 -- 172.21.15.33:0/3337509104 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7fc5600cc3f0 con 0x7fc568107000 2024-05-08T20:06:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.140+0000 7fc567fff700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc5500a1440 0x7fc5500a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.140+0000 7fc567fff700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc5500a1440 0x7fc5500a3900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc558011490 tx=0x7fc558009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:09.130 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.141+0000 7fc57a634b80 1 Processor -- start 2024-05-08T20:06:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc57a634b80 1 -- start start 2024-05-08T20:06:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f21dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f217f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f2188a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc57a634b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f16f0f0 con 0x555a6f21e270 2024-05-08T20:06:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc57a634b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f16cab0 con 0x555a6f21d950 2024-05-08T20:06:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc57a634b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f1683a0 con 0x555a6f218480 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f217f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f217f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56276/0 (socket says 172.21.15.33:56276) 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc5677fe700 1 -- 172.21.15.33:0/3798060047 learned_addr learned my addr 172.21.15.33:0/3798060047 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.142+0000 7fc56ca17700 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f2188a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc567fff700 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f21dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc56ca17700 1 -- 172.21.15.33:0/3798060047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 msgr2=0x555a6f21dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc56ca17700 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f21dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc56ca17700 1 -- 172.21.15.33:0/3798060047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 msgr2=0x555a6f217f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc56ca17700 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f217f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc56ca17700 1 -- 172.21.15.33:0/3798060047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a6efe9350 con 0x555a6f218480 2024-05-08T20:06:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc56ca17700 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f2188a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc5600c9890 tx=0x7fc560098d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22e04678d8e4af67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc54e7fc700 1 -- 172.21.15.33:0/3798060047 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560099950 con 0x555a6f218480 2024-05-08T20:06:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc54e7fc700 1 -- 172.21.15.33:0/3798060047 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc560099250 con 0x555a6f218480 2024-05-08T20:06:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.143+0000 7fc54e7fc700 1 -- 172.21.15.33:0/3798060047 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560099710 con 0x555a6f218480 2024-05-08T20:06:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 -- 172.21.15.33:0/3798060047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 msgr2=0x555a6f2188a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f2188a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc5600c9890 tx=0x7fc560098d90 comp rx=0 tx=0).stop 2024-05-08T20:06:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 -- 172.21.15.33:0/3798060047 shutdown_connections 2024-05-08T20:06:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f2188a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f21dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 --2- 172.21.15.33:0/3798060047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f217f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 -- 172.21.15.33:0/3798060047 >> 172.21.15.33:0/3798060047 conn(0x555a6f1761b0 msgr2=0x555a6f212840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.144+0000 7fc57a634b80 1 -- 172.21.15.33:0/3798060047 shutdown_connections 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.145+0000 7fc57a634b80 1 -- 172.21.15.33:0/3798060047 wait complete. 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.145+0000 7fc57a634b80 1 -- start start 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.145+0000 7fc57a634b80 1 Processor -- start 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f218480 0x555a6f221600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f221b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f21e270 0x555a6f222080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc57a634b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f104500 con 0x555a6f21d950 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc57a634b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f1041a0 con 0x555a6f218480 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc57a634b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6efeb640 con 0x555a6f21e270 2024-05-08T20:06:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc57a634b80 10 client.0 _ll_register_callbacks cb 0x555a6f10dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f221b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f221b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56280/0 (socket says 172.21.15.33:56280) 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc5677fe700 1 -- 172.21.15.33:0/419700371 learned_addr learned my addr 172.21.15.33:0/419700371 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.146+0000 7fc56ca17700 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f21e270 0x555a6f222080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc567fff700 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f218480 0x555a6f221600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc56ca17700 1 -- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f218480 msgr2=0x555a6f221600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc56ca17700 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f218480 0x555a6f221600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc56ca17700 1 -- 172.21.15.33:0/419700371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 msgr2=0x555a6f221b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc56ca17700 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f221b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc56ca17700 1 -- 172.21.15.33:0/419700371 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56806aba0 con 0x555a6f21e270 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc56ca17700 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f21e270 0x555a6f222080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc560098f50 tx=0x7fc5600c9800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b67370cfd2f732 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.147+0000 7fc5477fe700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc5477fe700 1 -- 172.21.15.33:0/419700371 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56009d080 con 0x555a6f21e270 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc5477fe700 1 -- 172.21.15.33:0/419700371 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7fc5600a16d0 con 0x555a6f21e270 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a6f0c1210 con 0x555a6f21e270 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc5477fe700 1 -- 172.21.15.33:0/419700371 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5600996c0 con 0x555a6f21e270 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc57a634b80 10 client.25294 fetch_fsmap learned FSMap version 26 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555a6ef95b00 con 0x555a6f21e270 2024-05-08T20:06:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc5477fe700 1 -- 172.21.15.33:0/419700371 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555a6f0c1210 con 0x555a6f21e270 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.148+0000 7fc5477fe700 1 -- 172.21.15.33:0/419700371 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc5600b74e0 con 0x555a6f21e270 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.149+0000 7fc57a634b80 10 client.25294 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.149+0000 7fc57a634b80 10 client.25294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.149+0000 7fc57a634b80 20 client.25294 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.149+0000 7fc57a634b80 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f235d80 0x555a6f2381a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.149+0000 7fc57a634b80 4 client.25294 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.149+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a6f1e77b0 con 0x555a6f235d80 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.149+0000 7fc567fff700 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f235d80 0x555a6f2381a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.150+0000 7fc567fff700 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f235d80 0x555a6f2381a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9430c8b84cd2d262 server_cookie=7ff0b32b2744d88e in_seq=0 out_seq=0 2024-05-08T20:06:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.150+0000 7fc5477fe700 10 client.25294 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.150+0000 7fc5477fe700 1 -- 172.21.15.33:0/419700371 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555a6f1e77b0 con 0x555a6f235d80 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.150+0000 7fc5477fe700 10 client.25294 handle_command_reply: tid=0 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.150+0000 7fc57a634b80 1 client.25294 shutdown 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f21e270 msgr2=0x555a6f222080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f21e270 0x555a6f222080 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc560098f50 tx=0x7fc5600c9800 comp rx=0 tx=0).stop 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 shutdown_connections 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f235d80 0x555a6f2381a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f21e270 0x555a6f222080 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f218480 0x555a6f221600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 --2- 172.21.15.33:0/419700371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f221b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 >> 172.21.15.33:0/419700371 conn(0x555a6f1761b0 msgr2=0x555a6f21c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc5477fe700 0 client.25294 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 shutdown_connections 2024-05-08T20:06:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 1 -- 172.21.15.33:0/419700371 wait complete. 2024-05-08T20:06:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.151+0000 7fc57a634b80 20 client.25294 trim_cache size 0 max 16384 2024-05-08T20:06:09.171 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 Processor -- start 2024-05-08T20:06:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 -- start start 2024-05-08T20:06:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f22dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f212910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f22d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f222cb0 con 0x555a6f21e270 2024-05-08T20:06:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f214510 con 0x555a6f21d950 2024-05-08T20:06:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.182+0000 7fc57a634b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f21d410 con 0x555a6f218480 2024-05-08T20:06:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc56ca17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f22d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f22dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc56ca17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f22d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56286/0 (socket says 172.21.15.33:56286) 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f22dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:58690/0 (socket says 172.21.15.33:58690) 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc56ca17700 1 -- 172.21.15.33:0/2645615667 learned_addr learned my addr 172.21.15.33:0/2645615667 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc5677fe700 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f212910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 -- 172.21.15.33:0/2645615667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 msgr2=0x555a6f212910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f212910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 -- 172.21.15.33:0/2645615667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 msgr2=0x555a6f22d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f22d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 -- 172.21.15.33:0/2645615667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a6f12e500 con 0x555a6f218480 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.183+0000 7fc567fff700 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f22dd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x555a6f238a10 tx=0x7fc558014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35e7865c0eaea52f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.184+0000 7fc54effd700 1 -- 172.21.15.33:0/2645615667 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558024040 con 0x555a6f218480 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.184+0000 7fc54effd700 1 -- 172.21.15.33:0/2645615667 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc558029900 con 0x555a6f218480 2024-05-08T20:06:09.174 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.184+0000 7fc54effd700 1 -- 172.21.15.33:0/2645615667 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55801ea60 con 0x555a6f218480 2024-05-08T20:06:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.185+0000 7fc57a634b80 1 -- 172.21.15.33:0/2645615667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 msgr2=0x555a6f22dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.185+0000 7fc57a634b80 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f22dd00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x555a6f238a10 tx=0x7fc558014000 comp rx=0 tx=0).stop 2024-05-08T20:06:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.186+0000 7fc57a634b80 1 -- 172.21.15.33:0/2645615667 shutdown_connections 2024-05-08T20:06:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.186+0000 7fc57a634b80 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21e270 0x555a6f22d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.186+0000 7fc57a634b80 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f22dd00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.186+0000 7fc57a634b80 1 --2- 172.21.15.33:0/2645615667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21d950 0x555a6f212910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.186+0000 7fc57a634b80 1 -- 172.21.15.33:0/2645615667 >> 172.21.15.33:0/2645615667 conn(0x555a6f1761b0 msgr2=0x555a6f20ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.187+0000 7fc57a634b80 1 -- 172.21.15.33:0/2645615667 shutdown_connections 2024-05-08T20:06:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.187+0000 7fc57a634b80 1 -- 172.21.15.33:0/2645615667 wait complete. 2024-05-08T20:06:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.187+0000 7fc57a634b80 1 -- start start 2024-05-08T20:06:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.187+0000 7fc57a634b80 1 Processor -- start 2024-05-08T20:06:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f228d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f21b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc57a634b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21e270 0x555a6f21b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc57a634b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f21be70 con 0x555a6f21d950 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc57a634b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f21bfb0 con 0x555a6f21e270 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc57a634b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a6f21c170 con 0x555a6f218480 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc57a634b80 10 client.0 _ll_register_callbacks cb 0x555a6f10dad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f21b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc5677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f21b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56292/0 (socket says 172.21.15.33:56292) 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc5677fe700 1 -- 172.21.15.33:0/1909731922 learned_addr learned my addr 172.21.15.33:0/1909731922 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.188+0000 7fc56ca17700 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21e270 0x555a6f21b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc56ca17700 1 -- 172.21.15.33:0/1909731922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 msgr2=0x555a6f228d70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc56ca17700 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f228d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc56ca17700 1 -- 172.21.15.33:0/1909731922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 msgr2=0x555a6f21b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:09.179 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc56ca17700 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f21b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc56ca17700 1 -- 172.21.15.33:0/1909731922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc558017070 con 0x555a6f21e270 2024-05-08T20:06:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc56ca17700 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21e270 0x555a6f21b930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc560095cc0 tx=0x7fc560097450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dedb973e49e228a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc5477fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:06:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc5477fe700 1 -- 172.21.15.33:0/1909731922 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560098d90 con 0x555a6f21e270 2024-05-08T20:06:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc560099250 con 0x555a6f21e270 2024-05-08T20:06:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc5477fe700 1 -- 172.21.15.33:0/1909731922 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7fc560099950 con 0x555a6f21e270 2024-05-08T20:06:09.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.189+0000 7fc5477fe700 1 -- 172.21.15.33:0/1909731922 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5600a16d0 con 0x555a6f21e270 2024-05-08T20:06:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.190+0000 7fc57a634b80 10 client.25343 fetch_fsmap learned FSMap version 26 2024-05-08T20:06:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.190+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555a6efedc70 con 0x555a6f21e270 2024-05-08T20:06:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.190+0000 7fc5477fe700 1 -- 172.21.15.33:0/1909731922 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc560099250 con 0x555a6f21e270 2024-05-08T20:06:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.191+0000 7fc5477fe700 1 -- 172.21.15.33:0/1909731922 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc5600981b0 con 0x555a6f21e270 2024-05-08T20:06:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.191+0000 7fc57a634b80 10 client.25343 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:06:09.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.191+0000 7fc57a634b80 10 client.25343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.191+0000 7fc57a634b80 20 client.25343 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.191+0000 7fc57a634b80 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f28c300 0x555a6f28e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.191+0000 7fc57a634b80 4 client.25343 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:06:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.191+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555a6f160e60 con 0x555a6f28c300 2024-05-08T20:06:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.192+0000 7fc567fff700 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f28c300 0x555a6f28e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.192+0000 7fc5477fe700 10 client.25343 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:09.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.192+0000 7fc567fff700 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f28c300 0x555a6f28e6f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94bd5f62e68f9fbb server_cookie=90487018c64f91c5 in_seq=0 out_seq=0 2024-05-08T20:06:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc5477fe700 1 -- 172.21.15.33:0/1909731922 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555a6f160e60 con 0x555a6f28c300 2024-05-08T20:06:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc5477fe700 10 client.25343 handle_command_reply: tid=0 2024-05-08T20:06:09.187 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 client.25343 shutdown 2024-05-08T20:06:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21e270 msgr2=0x555a6f21b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21e270 0x555a6f21b930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc560095cc0 tx=0x7fc560097450 comp rx=0 tx=0).stop 2024-05-08T20:06:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 shutdown_connections 2024-05-08T20:06:09.188 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x555a6f28c300 0x555a6f28e6f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555a6f21e270 0x555a6f21b930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555a6f218480 0x555a6f228d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 --2- 172.21.15.33:0/1909731922 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x555a6f21d950 0x555a6f21b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc5477fe700 0 client.25343 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.198+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 >> 172.21.15.33:0/1909731922 conn(0x555a6f1761b0 msgr2=0x555a6f2166d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.199+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 shutdown_connections 2024-05-08T20:06:09.189 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.199+0000 7fc57a634b80 1 -- 172.21.15.33:0/1909731922 wait complete. 2024-05-08T20:06:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.200+0000 7fc57a634b80 20 client.25343 trim_cache size 0 max 16384 2024-05-08T20:06:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:06:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:06:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:06:09.190 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:06:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc5500a1440 msgr2=0x7fc5500a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.191 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc5500a1440 0x7fc5500a3900 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc558011490 tx=0x7fc558009260 comp rx=0 tx=0).stop 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568107000 msgr2=0x7fc56819bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568107000 0x7fc56819bcb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc56000ef30 tx=0x7fc56000c3a0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 shutdown_connections 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc5500a1440 0x7fc5500a3900 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc568107000 0x7fc56819bcb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc5680682e0 0x7fc5681973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 --2- 172.21.15.33:0/3337509104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc568068ca0 0x7fc568197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 >> 172.21.15.33:0/3337509104 conn(0x7fc568076f10 msgr2=0x7fc5680feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 shutdown_connections 2024-05-08T20:06:09.192 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:09.202+0000 7fc56e47a700 1 -- 172.21.15.33:0/3337509104 wait complete. 2024-05-08T20:06:10.571 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:10 smithi033 ceph-mon[42490]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:10.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:10 smithi082 ceph-mon[46774]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:10.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:10 smithi132 ceph-mon[47484]: pgmap v48: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:06:12.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:12 smithi033 ceph-mon[42490]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T20:06:12.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:12 smithi082 ceph-mon[46774]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T20:06:12.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:12 smithi132 ceph-mon[47484]: pgmap v49: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-05-08T20:06:14.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:14 smithi033 ceph-mon[42490]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-05-08T20:06:14.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:14 smithi082 ceph-mon[46774]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-05-08T20:06:14.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:14 smithi132 ceph-mon[47484]: pgmap v50: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 KiB/s wr, 19 op/s 2024-05-08T20:06:15.841 INFO:tasks.workunit.client.0.smithi033.stderr:Updating files: 84% (10366/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-08T20:06:16.570 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:16 smithi033 ceph-mon[42490]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T20:06:16.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:16 smithi082 ceph-mon[46774]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T20:06:16.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:16 smithi132 ceph-mon[47484]: pgmap v51: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-05-08T20:06:16.811 INFO:tasks.workunit.client.0.smithi033.stderr:Note: switching to 'd21e4f961318b56f0d915caa2490c3711bf13c34'. 2024-05-08T20:06:16.811 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-05-08T20:06:16.811 INFO:tasks.workunit.client.0.smithi033.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr:state without impacting any branches by switching back to a branch. 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: git switch -c 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr:Or undo this operation with: 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: git switch - 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-08T20:06:16.812 INFO:tasks.workunit.client.0.smithi033.stderr: 2024-05-08T20:06:16.813 INFO:tasks.workunit.client.0.smithi033.stderr:HEAD is now at d21e4f96131 Merge PR #57343 into wip-pdonnell-testing-20240508.150423-reef 2024-05-08T20:06:16.818 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-08T20:06:16.884 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-08T20:06:16.887 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:06:16.887 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-08T20:06:17.344 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-08T20:06:17.439 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-08T20:06:17.482 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-08T20:06:17.483 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:06:17.484 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-08T20:06:17.525 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-08T20:06:17.528 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T20:06:17.529 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-08T20:06:17.588 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-05-08T20:06:17.590 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-05-08T20:06:17.590 DEBUG:teuthology.orchestra.run.smithi033:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d21e4f961318b56f0d915caa2490c3711bf13c34 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-05-08T20:06:17.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:17 smithi082 ceph-mon[46774]: mgrmap e25: x(active, since 91s), standbys: z, y 2024-05-08T20:06:17.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:17 smithi132 ceph-mon[47484]: mgrmap e25: x(active, since 91s), standbys: z, y 2024-05-08T20:06:17.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:17 smithi033 ceph-mon[42490]: mgrmap e25: x(active, since 91s), standbys: z, y 2024-05-08T20:06:18.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:18 smithi082 ceph-mon[46774]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-05-08T20:06:18.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:18 smithi132 ceph-mon[47484]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-05-08T20:06:18.820 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:18 smithi033 ceph-mon[42490]: pgmap v52: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.4 KiB/s wr, 9 op/s 2024-05-08T20:06:20.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:20 smithi082 ceph-mon[46774]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T20:06:20.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:20 smithi132 ceph-mon[47484]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T20:06:20.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:20 smithi033 ceph-mon[42490]: pgmap v53: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-05-08T20:06:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 -- 172.21.15.33:0/2090401513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 msgr2=0x7f5b60068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 --2- 172.21.15.33:0/2090401513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60068760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400b0a0 tx=0x7f5b5400b3b0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 -- 172.21.15.33:0/2090401513 shutdown_connections 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 --2- 172.21.15.33:0/2090401513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b60068ca0 0x7f5b6010dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 --2- 172.21.15.33:0/2090401513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b60107000 0x7f5b601073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 --2- 172.21.15.33:0/2090401513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60068760 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 -- 172.21.15.33:0/2090401513 >> 172.21.15.33:0/2090401513 conn(0x7f5b60076f10 msgr2=0x7f5b60077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 -- 172.21.15.33:0/2090401513 shutdown_connections 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.336+0000 7f5b65162700 1 -- 172.21.15.33:0/2090401513 wait complete. 2024-05-08T20:06:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 Processor -- start 2024-05-08T20:06:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 -- start start 2024-05-08T20:06:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b60068ca0 0x7f5b60197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b60107000 0x7f5b6019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6019c440 con 0x7f5b600682e0 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6019c5b0 con 0x7f5b60107000 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.337+0000 7f5b65162700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6019c770 con 0x7f5b60068ca0 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57660/0 (socket says 172.21.15.33:57660) 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 -- 172.21.15.33:0/3401514923 learned_addr learned my addr 172.21.15.33:0/3401514923 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b60107000 0x7f5b6019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b60068ca0 0x7f5b60197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 -- 172.21.15.33:0/3401514923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b60068ca0 msgr2=0x7f5b60197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b60068ca0 0x7f5b60197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 -- 172.21.15.33:0/3401514923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b60107000 msgr2=0x7f5b6019be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b60107000 0x7f5b6019be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 -- 172.21.15.33:0/3401514923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b54009d00 con 0x7f5b600682e0 2024-05-08T20:06:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b60107000 0x7f5b6019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60197520 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000d950 tx=0x7f5b5000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b47fff700 1 -- 172.21.15.33:0/3401514923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000f890 con 0x7f5b600682e0 2024-05-08T20:06:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6019ca50 con 0x7f5b600682e0 2024-05-08T20:06:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b47fff700 1 -- 172.21.15.33:0/3401514923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b50010460 con 0x7f5b600682e0 2024-05-08T20:06:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.338+0000 7f5b47fff700 1 -- 172.21.15.33:0/3401514923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5000e610 con 0x7f5b600682e0 2024-05-08T20:06:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.339+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b601a4290 con 0x7f5b600682e0 2024-05-08T20:06:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.341+0000 7f5b47fff700 1 -- 172.21.15.33:0/3401514923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5b50010960 con 0x7f5b600682e0 2024-05-08T20:06:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.342+0000 7f5b47fff700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5b480a1290 0x7f5b480a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.342+0000 7f5b47fff700 1 -- 172.21.15.33:0/3401514923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f5b500ccaf0 con 0x7f5b600682e0 2024-05-08T20:06:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.342+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5b480a1290 0x7f5b480a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.342+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5b480a1290 0x7f5b480a3750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b60198a70 tx=0x7f5b5400b7b0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 Processor -- start 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 -- start start 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3965140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a395f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a395fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a38b20f0 con 0x5648a3965680 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a38afab0 con 0x5648a3964d60 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a38ab3a0 con 0x5648a395f890 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.343+0000 7f5b5e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a395f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a395f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57668/0 (socket says 172.21.15.33:57668) 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5ed9d700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3965140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 -- 172.21.15.33:0/1983694912 learned_addr learned my addr 172.21.15.33:0/1983694912 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a395fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 -- 172.21.15.33:0/1983694912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 msgr2=0x5648a395fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a395fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 -- 172.21.15.33:0/1983694912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 msgr2=0x5648a3965140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3965140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 -- 172.21.15.33:0/1983694912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a372c350 con 0x5648a3965680 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3965140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.344+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a395f350 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d010 tx=0x7f5b5401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719d359e49e3581a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.346+0000 7f5b457fa700 1 -- 172.21.15.33:0/1983694912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400e040 con 0x5648a3965680 2024-05-08T20:06:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.346+0000 7f5b457fa700 1 -- 172.21.15.33:0/1983694912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b54007940 con 0x5648a3965680 2024-05-08T20:06:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.346+0000 7f5b457fa700 1 -- 172.21.15.33:0/1983694912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54005330 con 0x5648a3965680 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1983694912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 msgr2=0x5648a395f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a395f350 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d010 tx=0x7f5b5401c000 comp rx=0 tx=0).stop 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1983694912 shutdown_connections 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a395fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3965140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1983694912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a395f350 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1983694912 >> 172.21.15.33:0/1983694912 conn(0x5648a38b91b0 msgr2=0x5648a3955840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1983694912 shutdown_connections 2024-05-08T20:06:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1983694912 wait complete. 2024-05-08T20:06:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 -- start start 2024-05-08T20:06:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.347+0000 7f5b7131cb80 1 Processor -- start 2024-05-08T20:06:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a396b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3964d60 0x5648a39688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3965680 0x5648a3968f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a3847500 con 0x5648a3964d60 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a38471a0 con 0x5648a395f890 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a372e640 con 0x5648a3965680 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b7131cb80 10 client.0 _ll_register_callbacks cb 0x5648a3850ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3964d60 0x5648a39688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3964d60 0x5648a39688c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57670/0 (socket says 172.21.15.33:57670) 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 -- 172.21.15.33:0/3831815749 learned_addr learned my addr 172.21.15.33:0/3831815749 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a396b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3965680 0x5648a3968f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 -- 172.21.15.33:0/3831815749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3965680 msgr2=0x5648a3968f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3965680 0x5648a3968f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 -- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 msgr2=0x5648a396b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a396b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.348+0000 7f5b5e59c700 1 -- 172.21.15.33:0/3831815749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b601a4290 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3964d60 0x5648a39688c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009340 tx=0x7f5b5401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592379106b35d24d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b42ff5700 1 -- 172.21.15.33:0/3831815749 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5400e040 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b42ff5700 1 -- 172.21.15.33:0/3831815749 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f5b54023040 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648a3804210 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b42ff5700 1 -- 172.21.15.33:0/3831815749 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b54031860 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 10 client.15483 fetch_fsmap learned FSMap version 26 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f5b6010e630 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b42ff5700 1 -- 172.21.15.33:0/3831815749 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5648a3804210 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b42ff5700 1 -- 172.21.15.33:0/3831815749 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5b54028860 con 0x5648a3964d60 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 10 client.15483 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 10 client.15483 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 20 client.15483 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a3978980 0x5648a397ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 4 client.15483 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.349+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648a392a7b0 con 0x5648a3978980 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.350+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a3978980 0x5648a397ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.350+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a3978980 0x5648a397ad70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=117f12a69546eb3a server_cookie=1efe77bbacd431ca in_seq=0 out_seq=0 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.350+0000 7f5b42ff5700 10 client.15483 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b42ff5700 1 -- 172.21.15.33:0/3831815749 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5648a392a7b0 con 0x5648a3978980 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b42ff5700 10 client.15483 handle_command_reply: tid=0 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 client.15483 shutdown 2024-05-08T20:06:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3964d60 msgr2=0x5648a39688c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3964d60 0x5648a39688c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009340 tx=0x7f5b5401cb60 comp rx=0 tx=0).stop 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 shutdown_connections 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a3978980 0x5648a397ad70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3965680 0x5648a3968f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a396b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/3831815749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3964d60 0x5648a39688c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b42ff5700 0 client.15483 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 >> 172.21.15.33:0/3831815749 conn(0x5648a38b91b0 msgr2=0x5648a3962870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 shutdown_connections 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 1 -- 172.21.15.33:0/3831815749 wait complete. 2024-05-08T20:06:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.351+0000 7f5b7131cb80 20 client.15483 trim_cache size 0 max 16384 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 Processor -- start 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 -- start start 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a3955910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3964d60 0x5648a396fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a39529b0 con 0x5648a3965680 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a39759b0 con 0x5648a395f890 2024-05-08T20:06:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a3962e10 con 0x5648a3964d60 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.368+0000 7f5b5f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57674/0 (socket says 172.21.15.33:57674) 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 -- 172.21.15.33:0/1299300895 learned_addr learned my addr 172.21.15.33:0/1299300895 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a3955910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3964d60 0x5648a396fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 -- 172.21.15.33:0/1299300895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3964d60 msgr2=0x5648a396fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3964d60 0x5648a396fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 -- 172.21.15.33:0/1299300895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 msgr2=0x5648a3955910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a3955910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 -- 172.21.15.33:0/1299300895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648a36d8b00 con 0x5648a3965680 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a3955910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39703c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b58004390 tx=0x7f5b580046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a17f9257f6c5c6a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b45ffb700 1 -- 172.21.15.33:0/1299300895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5801f070 con 0x5648a3965680 2024-05-08T20:06:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b45ffb700 1 -- 172.21.15.33:0/1299300895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b58017040 con 0x5648a3965680 2024-05-08T20:06:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.369+0000 7f5b45ffb700 1 -- 172.21.15.33:0/1299300895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58016070 con 0x5648a3965680 2024-05-08T20:06:22.364 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1299300895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 msgr2=0x5648a39703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39703c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5b58004390 tx=0x7f5b580046a0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1299300895 shutdown_connections 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39703c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a395f890 0x5648a3955910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/1299300895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a3964d60 0x5648a396fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1299300895 >> 172.21.15.33:0/1299300895 conn(0x5648a38b91b0 msgr2=0x5648a39570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1299300895 shutdown_connections 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 -- 172.21.15.33:0/1299300895 wait complete. 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 -- start start 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.370+0000 7f5b7131cb80 1 Processor -- start 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a3970390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3962fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.365 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b7131cb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39636c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a3963dd0 con 0x5648a3965680 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a3963f40 con 0x5648a3964d60 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b7131cb80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648a3964100 con 0x5648a395f890 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b7131cb80 10 client.0 _ll_register_callbacks cb 0x5648a3850ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39636c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39636c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57688/0 (socket says 172.21.15.33:57688) 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5ed9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a3970390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5f59e700 1 -- 172.21.15.33:0/226629923 learned_addr learned my addr 172.21.15.33:0/226629923 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3962fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5ed9d700 1 -- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 msgr2=0x5648a3962fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3962fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.366 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5ed9d700 1 -- 172.21.15.33:0/226629923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 msgr2=0x5648a39636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39636c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5ed9d700 1 -- 172.21.15.33:0/226629923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b58004040 con 0x5648a395f890 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5f59e700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.371+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3962fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b5ed9d700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a3970390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b500ca1d0 tx=0x7f5b50000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8e784622bae1af4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b42ff5700 1 -- 172.21.15.33:0/226629923 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b500107d0 con 0x5648a395f890 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b54007940 con 0x5648a395f890 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b42ff5700 1 -- 172.21.15.33:0/226629923 <== mon.1 v2:172.21.15.132:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f5b500b1070 con 0x5648a395f890 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b42ff5700 1 -- 172.21.15.33:0/226629923 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b500b22d0 con 0x5648a395f890 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 10 client.25315 fetch_fsmap learned FSMap version 26 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5648a3871500 con 0x5648a395f890 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b42ff5700 1 -- 172.21.15.33:0/226629923 <== mon.1 v2:172.21.15.132:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b50065080 con 0x5648a395f890 2024-05-08T20:06:22.367 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b42ff5700 1 -- 172.21.15.33:0/226629923 <== mon.1 v2:172.21.15.132:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5b500a1b80 con 0x5648a395f890 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 10 client.25315 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 10 client.25315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 20 client.25315 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a39cfaa0 0x5648a39d1e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 4 client.25315 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.372+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5648a38a3e60 con 0x5648a39cfaa0 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.373+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a39cfaa0 0x5648a39d1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.373+0000 7f5b5e59c700 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a39cfaa0 0x5648a39d1e90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c3dff14439667e server_cookie=f26846a6ee4fac0f in_seq=0 out_seq=0 2024-05-08T20:06:22.368 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.373+0000 7f5b42ff5700 10 client.25315 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b42ff5700 1 -- 172.21.15.33:0/226629923 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5648a38a3e60 con 0x5648a39cfaa0 2024-05-08T20:06:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b42ff5700 10 client.25315 handle_command_reply: tid=0 2024-05-08T20:06:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 client.25315 shutdown 2024-05-08T20:06:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 msgr2=0x5648a3970390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a3970390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5b500ca1d0 tx=0x7f5b50000bc0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.372 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 shutdown_connections 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x5648a39cfaa0 0x5648a39d1e90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5648a3965680 0x5648a39636c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b42ff5700 0 client.25315 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5648a395f890 0x5648a3970390 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 --2- 172.21.15.33:0/226629923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648a3964d60 0x5648a3962fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 >> 172.21.15.33:0/226629923 conn(0x5648a38b91b0 msgr2=0x5648a395d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 shutdown_connections 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 1 -- 172.21.15.33:0/226629923 wait complete. 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.382+0000 7f5b7131cb80 20 client.25315 trim_cache size 0 max 16384 2024-05-08T20:06:22.373 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:06:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:06:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:06:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:06:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5b480a1290 msgr2=0x7f5b480a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5b480a1290 0x7f5b480a3750 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5b60198a70 tx=0x7f5b5400b7b0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 msgr2=0x7f5b60197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60197520 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000d950 tx=0x7f5b5000dc60 comp rx=0 tx=0).stop 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 shutdown_connections 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b60107000 0x7f5b6019be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5b480a1290 0x7f5b480a3750 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b600682e0 0x7f5b60197520 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 --2- 172.21.15.33:0/3401514923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b60068ca0 0x7f5b60197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 >> 172.21.15.33:0/3401514923 conn(0x7f5b60076f10 msgr2=0x7f5b600febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 shutdown_connections 2024-05-08T20:06:22.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:22.383+0000 7f5b65162700 1 -- 172.21.15.33:0/3401514923 wait complete. 2024-05-08T20:06:22.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:22 smithi082 ceph-mon[46774]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 KiB/s wr, 9 op/s 2024-05-08T20:06:22.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:22 smithi132 ceph-mon[47484]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 KiB/s wr, 9 op/s 2024-05-08T20:06:22.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:22 smithi033 ceph-mon[42490]: pgmap v54: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.8 KiB/s wr, 9 op/s 2024-05-08T20:06:23.143 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ 2024-05-08T20:06:23.145 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/00-INDEX 2024-05-08T20:06:23.146 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/ 2024-05-08T20:06:23.148 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/README 2024-05-08T20:06:23.149 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-05-08T20:06:23.151 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-05-08T20:06:23.152 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-05-08T20:06:23.153 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-05-08T20:06:23.154 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-05-08T20:06:23.155 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-05-08T20:06:23.156 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-05-08T20:06:23.157 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-05-08T20:06:23.158 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-05-08T20:06:23.160 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-05-08T20:06:23.161 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-05-08T20:06:23.162 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-05-08T20:06:23.163 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-05-08T20:06:23.164 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-05-08T20:06:23.165 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-05-08T20:06:23.166 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-05-08T20:06:23.168 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-05-08T20:06:23.169 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-05-08T20:06:23.170 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-05-08T20:06:23.171 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-05-08T20:06:23.173 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-05-08T20:06:23.174 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-05-08T20:06:23.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-05-08T20:06:23.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-05-08T20:06:23.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-05-08T20:06:23.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-05-08T20:06:23.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-05-08T20:06:23.180 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-05-08T20:06:23.181 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-05-08T20:06:23.182 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-05-08T20:06:23.183 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-05-08T20:06:23.184 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-05-08T20:06:23.185 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-05-08T20:06:23.186 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-05-08T20:06:23.187 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-05-08T20:06:23.188 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-05-08T20:06:23.189 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-05-08T20:06:23.190 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-05-08T20:06:23.191 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-05-08T20:06:23.192 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-05-08T20:06:23.193 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-05-08T20:06:23.194 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-05-08T20:06:23.195 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-05-08T20:06:23.196 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-05-08T20:06:23.197 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-05-08T20:06:23.198 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-05-08T20:06:23.199 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-05-08T20:06:23.201 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-05-08T20:06:23.202 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-05-08T20:06:23.203 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-05-08T20:06:23.204 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-05-08T20:06:23.205 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-05-08T20:06:23.206 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-05-08T20:06:23.207 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-05-08T20:06:23.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-05-08T20:06:23.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-05-08T20:06:23.209 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-05-08T20:06:23.211 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-05-08T20:06:23.212 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-05-08T20:06:23.213 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-05-08T20:06:23.214 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-05-08T20:06:23.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-05-08T20:06:23.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-05-08T20:06:23.216 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-05-08T20:06:23.217 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-05-08T20:06:23.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-05-08T20:06:23.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-05-08T20:06:23.219 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-05-08T20:06:23.220 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-05-08T20:06:23.221 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-05-08T20:06:23.222 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-05-08T20:06:23.223 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-05-08T20:06:23.224 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-05-08T20:06:23.225 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-05-08T20:06:23.226 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-05-08T20:06:23.226 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-05-08T20:06:23.227 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-05-08T20:06:23.228 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-05-08T20:06:23.229 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-05-08T20:06:23.230 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-05-08T20:06:23.231 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-05-08T20:06:23.231 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-05-08T20:06:23.232 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-05-08T20:06:23.233 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-05-08T20:06:23.234 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-05-08T20:06:23.235 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-05-08T20:06:23.236 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-05-08T20:06:23.237 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-05-08T20:06:23.238 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-05-08T20:06:23.239 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-05-08T20:06:23.240 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-05-08T20:06:23.241 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-05-08T20:06:23.243 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-05-08T20:06:23.244 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-05-08T20:06:23.245 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-05-08T20:06:23.246 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-05-08T20:06:23.247 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-05-08T20:06:23.248 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-05-08T20:06:23.250 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-05-08T20:06:23.251 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-05-08T20:06:23.252 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-05-08T20:06:23.253 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-05-08T20:06:23.254 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-05-08T20:06:23.255 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-05-08T20:06:23.256 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-05-08T20:06:23.256 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-05-08T20:06:23.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-05-08T20:06:23.258 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-05-08T20:06:23.259 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-05-08T20:06:23.259 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-05-08T20:06:23.260 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-05-08T20:06:23.261 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-05-08T20:06:23.262 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-05-08T20:06:23.263 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-05-08T20:06:23.264 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-05-08T20:06:23.265 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-05-08T20:06:23.265 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-05-08T20:06:23.266 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-05-08T20:06:23.267 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-05-08T20:06:23.268 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-05-08T20:06:23.269 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-05-08T20:06:23.270 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-05-08T20:06:23.270 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-05-08T20:06:23.271 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-05-08T20:06:23.272 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-05-08T20:06:23.273 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-05-08T20:06:23.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-05-08T20:06:23.275 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-05-08T20:06:23.275 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-05-08T20:06:23.276 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-05-08T20:06:23.277 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-05-08T20:06:23.278 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-05-08T20:06:23.279 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-05-08T20:06:23.280 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-05-08T20:06:23.281 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-05-08T20:06:23.282 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-05-08T20:06:23.282 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-05-08T20:06:23.283 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-05-08T20:06:23.284 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-05-08T20:06:23.285 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-05-08T20:06:23.286 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-05-08T20:06:23.287 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-05-08T20:06:23.288 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-05-08T20:06:23.288 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-05-08T20:06:23.289 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-05-08T20:06:23.290 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-05-08T20:06:23.291 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-05-08T20:06:23.291 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-05-08T20:06:23.293 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-05-08T20:06:23.293 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-05-08T20:06:23.294 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-05-08T20:06:23.295 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-05-08T20:06:23.296 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-05-08T20:06:23.297 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-05-08T20:06:23.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-05-08T20:06:23.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-05-08T20:06:23.299 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-05-08T20:06:23.300 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-05-08T20:06:23.301 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-05-08T20:06:23.302 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-05-08T20:06:23.303 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-05-08T20:06:23.304 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-05-08T20:06:23.305 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-05-08T20:06:23.305 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-05-08T20:06:23.306 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-05-08T20:06:23.307 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-05-08T20:06:23.308 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-05-08T20:06:23.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-05-08T20:06:23.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-05-08T20:06:23.310 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-05-08T20:06:23.311 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-05-08T20:06:23.312 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-05-08T20:06:23.313 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-05-08T20:06:23.313 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-05-08T20:06:23.314 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-05-08T20:06:23.315 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-05-08T20:06:23.316 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-05-08T20:06:23.317 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-05-08T20:06:23.317 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-05-08T20:06:23.318 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-05-08T20:06:23.320 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-05-08T20:06:23.321 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-05-08T20:06:23.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-05-08T20:06:23.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-05-08T20:06:23.323 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-05-08T20:06:23.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-05-08T20:06:23.325 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-05-08T20:06:23.326 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-05-08T20:06:23.327 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-05-08T20:06:23.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-05-08T20:06:23.329 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-05-08T20:06:23.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-05-08T20:06:23.331 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-05-08T20:06:23.332 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-05-08T20:06:23.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-05-08T20:06:24.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:24 smithi082 ceph-mon[46774]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T20:06:24.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:24 smithi132 ceph-mon[47484]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T20:06:24.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:24 smithi033 ceph-mon[42490]: pgmap v55: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T20:06:26.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:26 smithi082 ceph-mon[46774]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T20:06:26.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:26 smithi132 ceph-mon[47484]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T20:06:26.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:26 smithi033 ceph-mon[42490]: pgmap v56: 97 pgs: 97 active+clean; 1.4 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.2 KiB/s wr, 6 op/s 2024-05-08T20:06:28.269 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-05-08T20:06:28.270 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-05-08T20:06:28.271 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-05-08T20:06:28.272 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-05-08T20:06:28.273 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-05-08T20:06:28.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-05-08T20:06:28.275 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-05-08T20:06:28.276 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-05-08T20:06:28.277 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-05-08T20:06:28.277 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-05-08T20:06:28.278 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-05-08T20:06:28.279 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-05-08T20:06:28.280 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-05-08T20:06:28.281 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-05-08T20:06:28.282 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-05-08T20:06:28.283 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-05-08T20:06:28.283 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-05-08T20:06:28.284 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-05-08T20:06:28.285 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-05-08T20:06:28.287 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-05-08T20:06:28.288 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-05-08T20:06:28.289 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-05-08T20:06:28.290 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-05-08T20:06:28.291 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-05-08T20:06:28.292 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-05-08T20:06:28.293 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-05-08T20:06:28.294 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-05-08T20:06:28.295 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-05-08T20:06:28.296 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-05-08T20:06:28.297 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-05-08T20:06:28.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-05-08T20:06:28.299 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-05-08T20:06:28.300 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-05-08T20:06:28.301 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-05-08T20:06:28.302 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-05-08T20:06:28.303 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-05-08T20:06:28.304 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-05-08T20:06:28.305 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-05-08T20:06:28.306 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-05-08T20:06:28.307 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-05-08T20:06:28.308 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-05-08T20:06:28.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-05-08T20:06:28.310 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-05-08T20:06:28.311 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-05-08T20:06:28.312 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-05-08T20:06:28.313 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-05-08T20:06:28.314 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-05-08T20:06:28.315 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-05-08T20:06:28.316 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-05-08T20:06:28.317 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-05-08T20:06:28.318 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-05-08T20:06:28.319 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-05-08T20:06:28.319 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-05-08T20:06:28.320 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-05-08T20:06:28.321 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-05-08T20:06:28.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-05-08T20:06:28.323 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-05-08T20:06:28.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-05-08T20:06:28.325 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-05-08T20:06:28.326 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-05-08T20:06:28.327 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-05-08T20:06:28.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-05-08T20:06:28.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-05-08T20:06:28.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/Changes 2024-05-08T20:06:28.331 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-05-08T20:06:28.332 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/CodingStyle 2024-05-08T20:06:28.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-05-08T20:06:28.334 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-05-08T20:06:28.335 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-05-08T20:06:28.336 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-05-08T20:06:28.338 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/ 2024-05-08T20:06:28.338 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-05-08T20:06:28.339 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-05-08T20:06:28.340 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-05-08T20:06:28.341 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-05-08T20:06:28.342 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-05-08T20:06:28.342 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-05-08T20:06:28.343 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-05-08T20:06:28.345 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-05-08T20:06:28.345 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-05-08T20:06:28.347 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-05-08T20:06:28.348 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-05-08T20:06:28.349 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-05-08T20:06:28.350 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-05-08T20:06:28.351 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-05-08T20:06:28.352 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-05-08T20:06:28.353 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-05-08T20:06:28.353 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-05-08T20:06:28.354 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-05-08T20:06:28.355 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-05-08T20:06:28.356 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-05-08T20:06:28.357 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-05-08T20:06:28.358 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-05-08T20:06:28.359 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-05-08T20:06:28.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-05-08T20:06:28.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-05-08T20:06:28.361 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-05-08T20:06:28.363 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-05-08T20:06:28.364 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-05-08T20:06:28.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-05-08T20:06:28.366 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-05-08T20:06:28.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-05-08T20:06:28.368 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-05-08T20:06:28.368 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-05-08T20:06:28.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-05-08T20:06:28.370 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-05-08T20:06:28.371 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-05-08T20:06:28.372 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-05-08T20:06:28.373 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-05-08T20:06:28.374 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-05-08T20:06:28.375 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-05-08T20:06:28.377 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-05-08T20:06:28.378 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-05-08T20:06:28.379 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-05-08T20:06:28.380 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-05-08T20:06:28.381 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-05-08T20:06:28.382 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-05-08T20:06:28.383 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-05-08T20:06:28.384 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-05-08T20:06:28.385 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-05-08T20:06:28.386 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-05-08T20:06:28.386 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-05-08T20:06:28.388 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-05-08T20:06:28.390 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-05-08T20:06:28.391 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-05-08T20:06:28.392 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-05-08T20:06:28.393 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-05-08T20:06:28.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-05-08T20:06:28.395 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-05-08T20:06:28.395 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-05-08T20:06:28.396 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-05-08T20:06:28.397 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-05-08T20:06:28.398 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-05-08T20:06:28.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-05-08T20:06:28.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-05-08T20:06:28.400 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-05-08T20:06:28.401 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-05-08T20:06:28.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-05-08T20:06:28.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-05-08T20:06:28.403 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-05-08T20:06:28.404 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-05-08T20:06:28.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-05-08T20:06:28.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-05-08T20:06:28.406 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-05-08T20:06:28.407 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-05-08T20:06:28.407 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-05-08T20:06:28.408 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-05-08T20:06:28.409 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-05-08T20:06:28.410 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-05-08T20:06:28.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-05-08T20:06:28.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-05-08T20:06:28.412 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-05-08T20:06:28.413 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-05-08T20:06:28.414 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-05-08T20:06:28.415 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-05-08T20:06:28.415 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-05-08T20:06:28.416 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-05-08T20:06:28.417 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-05-08T20:06:28.418 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-05-08T20:06:28.419 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-05-08T20:06:28.420 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-05-08T20:06:28.421 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-05-08T20:06:28.421 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-05-08T20:06:28.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-05-08T20:06:28.423 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-05-08T20:06:28.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-05-08T20:06:28.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-05-08T20:06:28.425 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-05-08T20:06:28.426 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-05-08T20:06:28.427 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-05-08T20:06:28.427 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-05-08T20:06:28.428 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-05-08T20:06:28.428 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-05-08T20:06:28.429 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-05-08T20:06:28.430 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-05-08T20:06:28.431 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-05-08T20:06:28.431 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-05-08T20:06:28.432 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-05-08T20:06:28.433 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-05-08T20:06:28.434 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-05-08T20:06:28.435 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-05-08T20:06:28.436 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-05-08T20:06:28.436 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-05-08T20:06:28.437 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-05-08T20:06:28.438 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-05-08T20:06:28.439 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-05-08T20:06:28.440 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-05-08T20:06:28.440 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-05-08T20:06:28.441 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-05-08T20:06:28.442 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-05-08T20:06:28.443 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-05-08T20:06:28.444 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-05-08T20:06:28.445 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-05-08T20:06:28.445 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-05-08T20:06:28.446 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-05-08T20:06:28.447 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-05-08T20:06:28.448 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-05-08T20:06:28.449 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-05-08T20:06:28.450 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-05-08T20:06:28.451 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-05-08T20:06:28.452 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-05-08T20:06:28.453 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-05-08T20:06:28.454 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-05-08T20:06:28.455 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-05-08T20:06:28.456 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-05-08T20:06:28.456 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-05-08T20:06:28.457 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-05-08T20:06:28.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-05-08T20:06:28.459 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-05-08T20:06:28.460 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-05-08T20:06:28.461 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-05-08T20:06:28.462 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-05-08T20:06:28.464 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-05-08T20:06:28.464 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-05-08T20:06:28.465 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-05-08T20:06:28.466 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-05-08T20:06:28.467 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-05-08T20:06:28.468 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-05-08T20:06:28.469 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-05-08T20:06:28.469 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-05-08T20:06:28.470 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-05-08T20:06:28.471 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-05-08T20:06:28.472 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-05-08T20:06:28.473 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-05-08T20:06:28.473 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-05-08T20:06:28.474 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-05-08T20:06:28.475 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-05-08T20:06:28.476 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-05-08T20:06:28.477 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-05-08T20:06:28.478 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-05-08T20:06:28.479 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-05-08T20:06:28.480 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-05-08T20:06:28.480 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-05-08T20:06:28.481 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-05-08T20:06:28.482 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-05-08T20:06:28.483 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-05-08T20:06:28.483 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-05-08T20:06:28.484 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-05-08T20:06:28.485 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-05-08T20:06:28.486 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-05-08T20:06:28.487 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-05-08T20:06:28.488 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-05-08T20:06:28.489 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-05-08T20:06:28.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-05-08T20:06:28.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-05-08T20:06:28.491 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-05-08T20:06:28.492 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-05-08T20:06:28.493 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-05-08T20:06:28.493 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-05-08T20:06:28.498 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-05-08T20:06:28.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-05-08T20:06:28.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-05-08T20:06:28.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-05-08T20:06:28.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-05-08T20:06:28.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-05-08T20:06:28.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-05-08T20:06:28.500 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-05-08T20:06:28.501 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-05-08T20:06:28.502 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-05-08T20:06:28.502 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-05-08T20:06:28.503 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-05-08T20:06:28.504 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-05-08T20:06:28.505 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-05-08T20:06:28.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-05-08T20:06:28.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-05-08T20:06:28.507 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-05-08T20:06:28.508 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-05-08T20:06:28.509 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-05-08T20:06:28.510 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-05-08T20:06:28.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:28 smithi082 ceph-mon[46774]: pgmap v57: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 14 op/s 2024-05-08T20:06:28.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:28 smithi132 ceph-mon[47484]: pgmap v57: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 14 op/s 2024-05-08T20:06:28.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:28 smithi033 ceph-mon[42490]: pgmap v57: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.5 MiB/s wr, 14 op/s 2024-05-08T20:06:30.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:30 smithi082 ceph-mon[46774]: pgmap v58: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 11 op/s 2024-05-08T20:06:30.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:30 smithi132 ceph-mon[47484]: pgmap v58: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 11 op/s 2024-05-08T20:06:30.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:30 smithi033 ceph-mon[42490]: pgmap v58: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.5 MiB/s wr, 11 op/s 2024-05-08T20:06:32.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:32 smithi082 ceph-mon[46774]: pgmap v59: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 16 op/s 2024-05-08T20:06:32.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:32 smithi132 ceph-mon[47484]: pgmap v59: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 16 op/s 2024-05-08T20:06:32.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:32 smithi033 ceph-mon[42490]: pgmap v59: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.6 MiB/s wr, 16 op/s 2024-05-08T20:06:33.320 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-05-08T20:06:33.321 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-05-08T20:06:33.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-05-08T20:06:33.323 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-05-08T20:06:33.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-05-08T20:06:33.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-05-08T20:06:33.325 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-05-08T20:06:33.326 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-05-08T20:06:33.327 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-05-08T20:06:33.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-05-08T20:06:33.329 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-05-08T20:06:33.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-05-08T20:06:33.331 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-05-08T20:06:33.332 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-05-08T20:06:33.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-05-08T20:06:33.334 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-05-08T20:06:33.335 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-05-08T20:06:33.336 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-05-08T20:06:33.337 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-05-08T20:06:33.338 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-05-08T20:06:33.339 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-05-08T20:06:33.339 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-05-08T20:06:33.340 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-05-08T20:06:33.341 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-05-08T20:06:33.342 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-05-08T20:06:33.343 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-05-08T20:06:33.344 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-05-08T20:06:33.345 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-05-08T20:06:33.346 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-05-08T20:06:33.347 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-05-08T20:06:33.348 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-05-08T20:06:33.351 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-05-08T20:06:33.352 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-05-08T20:06:33.353 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-05-08T20:06:33.353 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/ 2024-05-08T20:06:33.354 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-05-08T20:06:33.355 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-05-08T20:06:33.356 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-05-08T20:06:33.357 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-05-08T20:06:33.357 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-05-08T20:06:33.358 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-05-08T20:06:33.359 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-05-08T20:06:33.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-05-08T20:06:33.361 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-05-08T20:06:33.362 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/EDID/hex 2024-05-08T20:06:33.363 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/HOWTO 2024-05-08T20:06:33.364 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-05-08T20:06:33.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-05-08T20:06:33.366 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-05-08T20:06:33.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-05-08T20:06:33.368 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-05-08T20:06:33.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/Makefile 2024-05-08T20:06:33.370 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-05-08T20:06:33.371 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/ 2024-05-08T20:06:33.372 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-05-08T20:06:33.373 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-05-08T20:06:33.374 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-05-08T20:06:33.375 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-05-08T20:06:33.377 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-05-08T20:06:33.378 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-05-08T20:06:33.379 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-05-08T20:06:33.380 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/ 2024-05-08T20:06:33.381 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-05-08T20:06:33.383 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-05-08T20:06:33.384 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-05-08T20:06:33.385 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-05-08T20:06:33.387 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-05-08T20:06:33.388 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-05-08T20:06:33.389 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-05-08T20:06:33.390 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-05-08T20:06:33.391 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-05-08T20:06:33.392 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-05-08T20:06:33.393 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-05-08T20:06:33.395 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-05-08T20:06:33.396 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-05-08T20:06:33.397 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-05-08T20:06:33.398 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-05-08T20:06:33.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-05-08T20:06:33.400 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-05-08T20:06:33.401 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-05-08T20:06:33.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/SAK.txt 2024-05-08T20:06:33.404 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/SM501.txt 2024-05-08T20:06:33.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-05-08T20:06:33.406 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-05-08T20:06:33.407 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-05-08T20:06:33.409 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-05-08T20:06:33.410 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-05-08T20:06:33.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/ 2024-05-08T20:06:33.413 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-05-08T20:06:33.414 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-05-08T20:06:33.415 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-05-08T20:06:33.417 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-05-08T20:06:33.418 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-05-08T20:06:33.419 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-05-08T20:06:33.420 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-05-08T20:06:33.421 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/ 2024-05-08T20:06:33.423 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-05-08T20:06:33.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-05-08T20:06:33.426 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-05-08T20:06:33.427 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-05-08T20:06:33.428 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-05-08T20:06:33.430 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-05-08T20:06:33.431 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-05-08T20:06:33.432 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-05-08T20:06:33.433 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-05-08T20:06:33.434 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-05-08T20:06:33.435 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-05-08T20:06:33.436 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-05-08T20:06:33.437 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-05-08T20:06:33.438 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/aoe/ 2024-05-08T20:06:33.440 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-05-08T20:06:33.442 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-05-08T20:06:33.443 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-05-08T20:06:33.444 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-05-08T20:06:33.445 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-05-08T20:06:33.446 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-05-08T20:06:33.447 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-05-08T20:06:33.448 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/ 2024-05-08T20:06:33.450 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-05-08T20:06:33.451 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-05-08T20:06:33.453 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-05-08T20:06:33.454 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Booting 2024-05-08T20:06:33.455 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-05-08T20:06:33.457 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-05-08T20:06:33.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-05-08T20:06:33.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-05-08T20:06:33.459 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-05-08T20:06:33.460 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-05-08T20:06:33.462 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-05-08T20:06:33.463 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-05-08T20:06:33.465 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-05-08T20:06:33.466 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-05-08T20:06:33.467 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Porting 2024-05-08T20:06:33.468 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/README 2024-05-08T20:06:33.469 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-05-08T20:06:33.470 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-05-08T20:06:33.472 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-05-08T20:06:33.473 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-05-08T20:06:33.474 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-05-08T20:06:33.475 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-05-08T20:06:33.476 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-05-08T20:06:33.477 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-05-08T20:06:33.478 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-05-08T20:06:33.479 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-05-08T20:06:33.481 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-05-08T20:06:33.482 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-05-08T20:06:33.483 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-05-08T20:06:33.484 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-05-08T20:06:33.485 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-05-08T20:06:33.486 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-05-08T20:06:33.487 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-05-08T20:06:33.488 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-05-08T20:06:33.489 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-05-08T20:06:33.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-05-08T20:06:33.492 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-05-08T20:06:33.493 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-05-08T20:06:33.494 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-05-08T20:06:33.495 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-05-08T20:06:33.496 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-05-08T20:06:33.497 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-05-08T20:06:33.498 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-05-08T20:06:33.500 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-05-08T20:06:33.501 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-05-08T20:06:33.503 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-05-08T20:06:33.504 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-05-08T20:06:33.505 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-05-08T20:06:33.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-05-08T20:06:33.507 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-05-08T20:06:33.508 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-05-08T20:06:33.510 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-05-08T20:06:33.511 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-05-08T20:06:33.512 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-05-08T20:06:33.512 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-05-08T20:06:33.513 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-05-08T20:06:33.514 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-05-08T20:06:33.515 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-05-08T20:06:33.516 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-05-08T20:06:33.517 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/Setup 2024-05-08T20:06:33.518 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-05-08T20:06:33.519 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-05-08T20:06:33.520 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-05-08T20:06:33.521 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-05-08T20:06:33.522 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-05-08T20:06:33.523 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-05-08T20:06:33.524 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-05-08T20:06:33.524 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-05-08T20:06:33.525 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-05-08T20:06:33.526 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-05-08T20:06:33.527 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-05-08T20:06:33.528 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-05-08T20:06:33.529 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-05-08T20:06:33.530 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-05-08T20:06:33.531 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-05-08T20:06:33.532 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-05-08T20:06:33.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-05-08T20:06:33.534 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-05-08T20:06:33.535 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-05-08T20:06:33.536 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-05-08T20:06:33.537 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-05-08T20:06:33.538 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-05-08T20:06:33.539 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-05-08T20:06:33.540 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-05-08T20:06:33.541 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-05-08T20:06:33.542 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-05-08T20:06:33.543 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-05-08T20:06:33.544 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-05-08T20:06:33.545 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-05-08T20:06:33.546 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-05-08T20:06:33.547 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm64/ 2024-05-08T20:06:33.548 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-05-08T20:06:33.549 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-05-08T20:06:33.550 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-05-08T20:06:33.551 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-05-08T20:06:33.552 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-05-08T20:06:33.553 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-05-08T20:06:33.554 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-05-08T20:06:33.555 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-05-08T20:06:33.556 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-05-08T20:06:33.557 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-05-08T20:06:33.558 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-05-08T20:06:33.559 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-05-08T20:06:33.560 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/backlight/ 2024-05-08T20:06:33.561 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-05-08T20:06:33.562 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-05-08T20:06:33.563 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-05-08T20:06:33.564 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/bcache.txt 2024-05-08T20:06:33.565 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-05-08T20:06:33.566 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blackfin/ 2024-05-08T20:06:33.567 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-05-08T20:06:33.568 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-05-08T20:06:33.569 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-05-08T20:06:33.570 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-05-08T20:06:33.571 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-05-08T20:06:33.572 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/ 2024-05-08T20:06:33.573 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-05-08T20:06:33.574 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-05-08T20:06:33.575 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-05-08T20:06:33.576 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-05-08T20:06:33.576 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-05-08T20:06:33.577 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-05-08T20:06:33.578 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-05-08T20:06:33.579 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-05-08T20:06:33.580 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-05-08T20:06:33.581 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-05-08T20:06:33.582 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-05-08T20:06:33.583 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/request.txt 2024-05-08T20:06:33.584 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-05-08T20:06:33.585 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-05-08T20:06:33.586 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-05-08T20:06:33.586 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/ 2024-05-08T20:06:33.587 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-05-08T20:06:33.588 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-05-08T20:06:33.589 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-05-08T20:06:33.590 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-05-08T20:06:33.591 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-05-08T20:06:33.592 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-05-08T20:06:33.593 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-05-08T20:06:33.594 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-05-08T20:06:33.595 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-05-08T20:06:33.596 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-05-08T20:06:33.596 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-05-08T20:06:33.597 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-05-08T20:06:33.598 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-05-08T20:06:33.599 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-05-08T20:06:33.600 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-05-08T20:06:33.601 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-05-08T20:06:33.602 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-05-08T20:06:33.602 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-05-08T20:06:33.605 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-05-08T20:06:33.605 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-05-08T20:06:33.605 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-05-08T20:06:33.606 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-05-08T20:06:33.607 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-05-08T20:06:33.608 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-05-08T20:06:33.609 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-05-08T20:06:33.610 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-05-08T20:06:33.611 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cdrom/ 2024-05-08T20:06:33.612 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-05-08T20:06:33.613 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-05-08T20:06:33.614 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-05-08T20:06:33.615 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-05-08T20:06:33.616 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-05-08T20:06:33.617 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/ 2024-05-08T20:06:33.618 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-05-08T20:06:33.619 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-05-08T20:06:33.620 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-05-08T20:06:33.621 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-05-08T20:06:33.622 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-05-08T20:06:33.623 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-05-08T20:06:33.624 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-05-08T20:06:33.624 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-05-08T20:06:33.625 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-05-08T20:06:33.626 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-05-08T20:06:33.627 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-05-08T20:06:33.628 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-05-08T20:06:33.629 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-05-08T20:06:33.629 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-05-08T20:06:33.630 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/clk.txt 2024-05-08T20:06:33.631 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-05-08T20:06:33.632 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/connector/ 2024-05-08T20:06:33.633 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-05-08T20:06:33.634 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-05-08T20:06:33.635 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-05-08T20:06:33.636 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-05-08T20:06:33.637 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-05-08T20:06:33.638 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/console/ 2024-05-08T20:06:33.639 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/console/console.txt 2024-05-08T20:06:33.640 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-05-08T20:06:33.641 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-05-08T20:06:33.642 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-05-08T20:06:33.643 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-05-08T20:06:33.644 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-05-08T20:06:33.645 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-05-08T20:06:33.646 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-05-08T20:06:33.647 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-05-08T20:06:33.648 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-05-08T20:06:33.649 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-05-08T20:06:33.650 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-05-08T20:06:33.650 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-05-08T20:06:33.651 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-05-08T20:06:33.652 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-05-08T20:06:33.653 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-05-08T20:06:33.654 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-05-08T20:06:33.655 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-05-08T20:06:33.656 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-05-08T20:06:33.657 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-05-08T20:06:33.658 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-05-08T20:06:33.659 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/crc32.txt 2024-05-08T20:06:33.660 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cris/ 2024-05-08T20:06:33.661 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/cris/README 2024-05-08T20:06:33.662 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/crypto/ 2024-05-08T20:06:33.663 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-05-08T20:06:33.664 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-05-08T20:06:33.665 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-05-08T20:06:33.666 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-05-08T20:06:33.667 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-05-08T20:06:33.668 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-05-08T20:06:33.669 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-05-08T20:06:33.670 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-05-08T20:06:33.671 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-05-08T20:06:33.672 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/ 2024-05-08T20:06:33.673 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-05-08T20:06:33.674 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-05-08T20:06:33.675 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-05-08T20:06:33.676 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-05-08T20:06:33.677 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-05-08T20:06:33.677 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-05-08T20:06:33.678 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-05-08T20:06:33.679 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-05-08T20:06:33.680 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-05-08T20:06:33.681 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-05-08T20:06:33.682 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-05-08T20:06:33.683 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-05-08T20:06:33.684 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-05-08T20:06:33.685 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-05-08T20:06:33.685 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-05-08T20:06:33.686 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-05-08T20:06:33.687 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-05-08T20:06:33.688 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-05-08T20:06:33.689 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-05-08T20:06:33.689 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-05-08T20:06:33.690 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-05-08T20:06:33.691 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-05-08T20:06:33.692 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-05-08T20:06:33.693 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-05-08T20:06:33.694 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-05-08T20:06:33.695 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-05-08T20:06:33.696 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-05-08T20:06:33.696 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-05-08T20:06:33.697 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-05-08T20:06:33.698 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-05-08T20:06:33.699 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-05-08T20:06:33.700 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devices.txt 2024-05-08T20:06:33.702 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/ 2024-05-08T20:06:33.703 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-05-08T20:06:33.704 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-05-08T20:06:33.705 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-05-08T20:06:33.706 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-05-08T20:06:33.707 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-05-08T20:06:33.708 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-05-08T20:06:33.709 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-05-08T20:06:33.710 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-05-08T20:06:33.711 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-05-08T20:06:33.712 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-05-08T20:06:33.713 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-05-08T20:06:33.714 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-05-08T20:06:33.715 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-05-08T20:06:33.715 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-05-08T20:06:33.716 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-05-08T20:06:33.717 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-05-08T20:06:33.718 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-05-08T20:06:33.719 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-05-08T20:06:33.720 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-05-08T20:06:33.721 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-05-08T20:06:33.721 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-05-08T20:06:33.722 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-05-08T20:06:33.723 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-05-08T20:06:33.724 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-05-08T20:06:33.725 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-05-08T20:06:33.726 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-05-08T20:06:33.727 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-05-08T20:06:33.728 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-05-08T20:06:33.729 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-05-08T20:06:33.730 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-05-08T20:06:33.731 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-05-08T20:06:33.731 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-05-08T20:06:33.732 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-05-08T20:06:33.733 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-05-08T20:06:33.734 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-05-08T20:06:33.735 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-05-08T20:06:33.736 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-05-08T20:06:33.737 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-05-08T20:06:33.738 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-05-08T20:06:33.739 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-05-08T20:06:33.740 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-05-08T20:06:33.740 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-05-08T20:06:33.741 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-05-08T20:06:33.742 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-05-08T20:06:33.743 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-05-08T20:06:33.743 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-05-08T20:06:33.744 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-05-08T20:06:33.745 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-05-08T20:06:33.746 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-05-08T20:06:33.747 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-05-08T20:06:33.748 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-05-08T20:06:33.749 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-05-08T20:06:33.750 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-05-08T20:06:33.751 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-05-08T20:06:33.752 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-05-08T20:06:33.753 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-05-08T20:06:33.754 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-05-08T20:06:33.755 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-05-08T20:06:33.756 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-05-08T20:06:33.757 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-05-08T20:06:33.758 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-05-08T20:06:33.759 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-05-08T20:06:33.759 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-05-08T20:06:33.760 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-05-08T20:06:33.761 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-05-08T20:06:33.762 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-05-08T20:06:33.763 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-05-08T20:06:33.764 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-05-08T20:06:33.765 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-05-08T20:06:33.766 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-05-08T20:06:33.767 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-05-08T20:06:33.768 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-05-08T20:06:33.769 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-05-08T20:06:33.770 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-05-08T20:06:33.770 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-05-08T20:06:33.771 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-05-08T20:06:33.772 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-05-08T20:06:33.773 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-05-08T20:06:33.774 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-05-08T20:06:33.775 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-05-08T20:06:33.776 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-05-08T20:06:33.777 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-05-08T20:06:33.778 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-05-08T20:06:33.779 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-05-08T20:06:33.780 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-05-08T20:06:33.781 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-05-08T20:06:33.782 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-05-08T20:06:33.783 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-05-08T20:06:33.784 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-05-08T20:06:33.785 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-05-08T20:06:33.786 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-05-08T20:06:33.787 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-05-08T20:06:33.788 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-05-08T20:06:33.789 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-05-08T20:06:33.790 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-05-08T20:06:33.791 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-05-08T20:06:33.791 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-05-08T20:06:33.793 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-05-08T20:06:33.794 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-05-08T20:06:33.795 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-05-08T20:06:33.796 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-05-08T20:06:33.796 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-05-08T20:06:33.797 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-05-08T20:06:33.798 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-05-08T20:06:33.798 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-05-08T20:06:33.799 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-05-08T20:06:33.800 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-05-08T20:06:33.801 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-05-08T20:06:33.801 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-05-08T20:06:33.802 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-05-08T20:06:33.803 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-05-08T20:06:33.804 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-05-08T20:06:33.805 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-05-08T20:06:33.805 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-05-08T20:06:33.806 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-05-08T20:06:33.807 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-05-08T20:06:33.808 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-05-08T20:06:33.809 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-05-08T20:06:33.810 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-05-08T20:06:33.810 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-05-08T20:06:33.811 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-05-08T20:06:33.812 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-05-08T20:06:33.813 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-05-08T20:06:33.814 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-05-08T20:06:33.815 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-05-08T20:06:33.816 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-05-08T20:06:33.817 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-05-08T20:06:33.818 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-05-08T20:06:33.818 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-05-08T20:06:33.819 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-05-08T20:06:33.820 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-05-08T20:06:33.821 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-05-08T20:06:33.822 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-05-08T20:06:33.823 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-05-08T20:06:33.824 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-05-08T20:06:33.825 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-05-08T20:06:33.826 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-05-08T20:06:33.827 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-05-08T20:06:33.828 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-05-08T20:06:33.829 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-05-08T20:06:33.830 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-05-08T20:06:33.831 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-05-08T20:06:33.832 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-05-08T20:06:33.833 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-05-08T20:06:33.834 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-05-08T20:06:33.835 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-05-08T20:06:33.836 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-05-08T20:06:33.836 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-05-08T20:06:33.837 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-05-08T20:06:33.839 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-05-08T20:06:33.840 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-05-08T20:06:33.840 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-05-08T20:06:33.841 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-05-08T20:06:33.842 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-05-08T20:06:33.843 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-05-08T20:06:33.844 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-05-08T20:06:33.844 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-05-08T20:06:33.845 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-05-08T20:06:33.995 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-05-08T20:06:33.995 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-05-08T20:06:33.996 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-05-08T20:06:33.997 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-05-08T20:06:33.998 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-05-08T20:06:33.999 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-05-08T20:06:34.000 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-05-08T20:06:34.001 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-05-08T20:06:34.001 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-05-08T20:06:34.002 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-05-08T20:06:34.003 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-05-08T20:06:34.003 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-05-08T20:06:34.004 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-05-08T20:06:34.005 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-05-08T20:06:34.006 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-05-08T20:06:34.007 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-05-08T20:06:34.008 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-05-08T20:06:34.008 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-05-08T20:06:34.009 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-05-08T20:06:34.010 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-05-08T20:06:34.011 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-05-08T20:06:34.012 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-05-08T20:06:34.013 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-05-08T20:06:34.014 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-05-08T20:06:34.014 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-05-08T20:06:34.015 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-05-08T20:06:34.016 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-05-08T20:06:34.017 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-05-08T20:06:34.018 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-05-08T20:06:34.019 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-05-08T20:06:34.020 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-05-08T20:06:34.020 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-05-08T20:06:34.021 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-05-08T20:06:34.022 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-05-08T20:06:34.023 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-05-08T20:06:34.024 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-05-08T20:06:34.024 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-05-08T20:06:34.026 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-05-08T20:06:34.027 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-05-08T20:06:34.028 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-05-08T20:06:34.028 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-05-08T20:06:34.029 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-05-08T20:06:34.030 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-05-08T20:06:34.031 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-05-08T20:06:34.032 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-05-08T20:06:34.033 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-05-08T20:06:34.033 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-05-08T20:06:34.034 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-05-08T20:06:34.035 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-05-08T20:06:34.036 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-05-08T20:06:34.037 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-05-08T20:06:34.038 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-05-08T20:06:34.038 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-05-08T20:06:34.039 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-05-08T20:06:34.040 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-05-08T20:06:34.041 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-05-08T20:06:34.042 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-05-08T20:06:34.043 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-05-08T20:06:34.043 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-05-08T20:06:34.044 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-05-08T20:06:34.045 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-05-08T20:06:34.046 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-05-08T20:06:34.047 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-05-08T20:06:34.047 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-05-08T20:06:34.048 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-05-08T20:06:34.049 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-05-08T20:06:34.050 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-05-08T20:06:34.050 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-05-08T20:06:34.051 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-05-08T20:06:34.052 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-05-08T20:06:34.053 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-05-08T20:06:34.053 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-05-08T20:06:34.054 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-05-08T20:06:34.055 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-05-08T20:06:34.056 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-05-08T20:06:34.057 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-05-08T20:06:34.057 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-05-08T20:06:34.058 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-05-08T20:06:34.059 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-05-08T20:06:34.060 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-05-08T20:06:34.061 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-05-08T20:06:34.062 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-05-08T20:06:34.063 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-05-08T20:06:34.063 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-05-08T20:06:34.064 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-05-08T20:06:34.065 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-05-08T20:06:34.065 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-05-08T20:06:34.066 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-05-08T20:06:34.067 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-05-08T20:06:34.068 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-05-08T20:06:34.069 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-05-08T20:06:34.069 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-05-08T20:06:34.070 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-05-08T20:06:34.071 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-05-08T20:06:34.072 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-05-08T20:06:34.073 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-05-08T20:06:34.074 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-05-08T20:06:34.074 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-05-08T20:06:34.075 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-05-08T20:06:34.076 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-05-08T20:06:34.077 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-05-08T20:06:34.078 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-05-08T20:06:34.078 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-05-08T20:06:34.079 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-05-08T20:06:34.080 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-05-08T20:06:34.081 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-05-08T20:06:34.082 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-05-08T20:06:34.082 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-05-08T20:06:34.083 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-05-08T20:06:34.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-05-08T20:06:34.085 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-05-08T20:06:34.086 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-05-08T20:06:34.087 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-05-08T20:06:34.088 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-05-08T20:06:34.088 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-05-08T20:06:34.089 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-05-08T20:06:34.090 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-05-08T20:06:34.091 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-05-08T20:06:34.092 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-05-08T20:06:34.092 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-05-08T20:06:34.093 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-05-08T20:06:34.094 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-05-08T20:06:34.095 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-05-08T20:06:34.096 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-05-08T20:06:34.097 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-05-08T20:06:34.098 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-05-08T20:06:34.099 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-05-08T20:06:34.099 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-05-08T20:06:34.100 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-05-08T20:06:34.101 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-05-08T20:06:34.102 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-05-08T20:06:34.103 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-05-08T20:06:34.104 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-05-08T20:06:34.105 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-05-08T20:06:34.105 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-05-08T20:06:34.106 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-05-08T20:06:34.107 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-05-08T20:06:34.108 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-05-08T20:06:34.109 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-05-08T20:06:34.110 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-05-08T20:06:34.111 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-05-08T20:06:34.112 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-05-08T20:06:34.113 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-05-08T20:06:34.114 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-05-08T20:06:34.114 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-05-08T20:06:34.115 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-05-08T20:06:34.116 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-05-08T20:06:34.117 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-05-08T20:06:34.118 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-05-08T20:06:34.119 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-05-08T20:06:34.120 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-05-08T20:06:34.121 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-05-08T20:06:34.122 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-05-08T20:06:34.123 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-05-08T20:06:34.124 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-05-08T20:06:34.125 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-05-08T20:06:34.126 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-05-08T20:06:34.127 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-05-08T20:06:34.128 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-05-08T20:06:34.129 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-05-08T20:06:34.130 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-05-08T20:06:34.131 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-05-08T20:06:34.131 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-05-08T20:06:34.132 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-05-08T20:06:34.133 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-05-08T20:06:34.134 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-05-08T20:06:34.135 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-05-08T20:06:34.136 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-05-08T20:06:34.137 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-05-08T20:06:34.138 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-05-08T20:06:34.139 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-05-08T20:06:34.140 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-05-08T20:06:34.141 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-05-08T20:06:34.142 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-05-08T20:06:34.143 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-05-08T20:06:34.144 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-05-08T20:06:34.145 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-05-08T20:06:34.146 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-05-08T20:06:34.147 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-05-08T20:06:34.148 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-05-08T20:06:34.149 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-05-08T20:06:34.150 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-05-08T20:06:34.150 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-05-08T20:06:34.151 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-05-08T20:06:34.152 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-05-08T20:06:34.153 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-05-08T20:06:34.154 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-05-08T20:06:34.155 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-05-08T20:06:34.156 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-05-08T20:06:34.157 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-05-08T20:06:34.157 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-05-08T20:06:34.158 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-05-08T20:06:34.159 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-05-08T20:06:34.160 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-05-08T20:06:34.160 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-05-08T20:06:34.161 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-05-08T20:06:34.161 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-05-08T20:06:34.162 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-05-08T20:06:34.163 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-05-08T20:06:34.164 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-05-08T20:06:34.164 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-05-08T20:06:34.165 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-05-08T20:06:34.166 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-05-08T20:06:34.167 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-05-08T20:06:34.167 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-05-08T20:06:34.168 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-05-08T20:06:34.169 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-05-08T20:06:34.170 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-05-08T20:06:34.171 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-05-08T20:06:34.172 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-05-08T20:06:34.173 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-05-08T20:06:34.174 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-05-08T20:06:34.175 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-05-08T20:06:34.176 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-05-08T20:06:34.177 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-05-08T20:06:34.178 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-05-08T20:06:34.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-05-08T20:06:34.180 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-05-08T20:06:34.181 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-05-08T20:06:34.182 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-05-08T20:06:34.183 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-05-08T20:06:34.184 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-05-08T20:06:34.185 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-05-08T20:06:34.186 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-05-08T20:06:34.187 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-05-08T20:06:34.188 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-05-08T20:06:34.189 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-05-08T20:06:34.190 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-05-08T20:06:34.191 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-05-08T20:06:34.192 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-05-08T20:06:34.193 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-05-08T20:06:34.194 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-05-08T20:06:34.195 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-05-08T20:06:34.196 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-05-08T20:06:34.197 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-05-08T20:06:34.198 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-05-08T20:06:34.199 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-05-08T20:06:34.200 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-05-08T20:06:34.202 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-05-08T20:06:34.203 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-05-08T20:06:34.204 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-05-08T20:06:34.205 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-05-08T20:06:34.206 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-05-08T20:06:34.207 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-05-08T20:06:34.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-05-08T20:06:34.209 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-05-08T20:06:34.210 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-05-08T20:06:34.211 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-05-08T20:06:34.212 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-05-08T20:06:34.213 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-05-08T20:06:34.214 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-05-08T20:06:34.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-05-08T20:06:34.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-05-08T20:06:34.216 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-05-08T20:06:34.217 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-05-08T20:06:34.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-05-08T20:06:34.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-05-08T20:06:34.219 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-05-08T20:06:34.220 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-05-08T20:06:34.220 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-05-08T20:06:34.221 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-05-08T20:06:34.222 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-05-08T20:06:34.223 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-05-08T20:06:34.224 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-05-08T20:06:34.225 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-05-08T20:06:34.226 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-05-08T20:06:34.227 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-05-08T20:06:34.228 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-05-08T20:06:34.229 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-05-08T20:06:34.230 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-05-08T20:06:34.230 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-05-08T20:06:34.231 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-05-08T20:06:34.232 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-05-08T20:06:34.233 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-05-08T20:06:34.234 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-05-08T20:06:34.235 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-05-08T20:06:34.236 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-05-08T20:06:34.237 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-05-08T20:06:34.237 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-05-08T20:06:34.238 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-05-08T20:06:34.239 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-05-08T20:06:34.240 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-05-08T20:06:34.241 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-05-08T20:06:34.242 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-05-08T20:06:34.243 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-05-08T20:06:34.243 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-05-08T20:06:34.244 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-05-08T20:06:34.245 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-05-08T20:06:34.246 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-05-08T20:06:34.247 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-05-08T20:06:34.247 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-05-08T20:06:34.248 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-05-08T20:06:34.249 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-05-08T20:06:34.250 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-05-08T20:06:34.251 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-05-08T20:06:34.252 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-05-08T20:06:34.253 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-05-08T20:06:34.254 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-05-08T20:06:34.255 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-05-08T20:06:34.256 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-05-08T20:06:34.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-05-08T20:06:34.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-05-08T20:06:34.258 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-05-08T20:06:34.260 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-05-08T20:06:34.261 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-05-08T20:06:34.262 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-05-08T20:06:34.263 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-05-08T20:06:34.264 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-05-08T20:06:34.265 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-05-08T20:06:34.266 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-05-08T20:06:34.267 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-05-08T20:06:34.268 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-05-08T20:06:34.268 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-05-08T20:06:34.269 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-05-08T20:06:34.270 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-05-08T20:06:34.271 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-05-08T20:06:34.273 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-05-08T20:06:34.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-05-08T20:06:34.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-05-08T20:06:34.275 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-05-08T20:06:34.276 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-05-08T20:06:34.277 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-05-08T20:06:34.278 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-05-08T20:06:34.280 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-05-08T20:06:34.280 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-05-08T20:06:34.281 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-05-08T20:06:34.282 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-05-08T20:06:34.283 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-05-08T20:06:34.284 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-05-08T20:06:34.285 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-05-08T20:06:34.285 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-05-08T20:06:34.286 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-05-08T20:06:34.287 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-05-08T20:06:34.288 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-05-08T20:06:34.289 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-05-08T20:06:34.290 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-05-08T20:06:34.291 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-05-08T20:06:34.292 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-05-08T20:06:34.293 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-05-08T20:06:34.294 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-05-08T20:06:34.295 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-05-08T20:06:34.296 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-05-08T20:06:34.297 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-05-08T20:06:34.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-05-08T20:06:34.299 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-05-08T20:06:34.300 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-05-08T20:06:34.301 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-05-08T20:06:34.302 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-05-08T20:06:34.303 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-05-08T20:06:34.304 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-05-08T20:06:34.305 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-05-08T20:06:34.306 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-05-08T20:06:34.307 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-05-08T20:06:34.307 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-05-08T20:06:34.308 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-05-08T20:06:34.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-05-08T20:06:34.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-05-08T20:06:34.310 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-05-08T20:06:34.311 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-05-08T20:06:34.312 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-05-08T20:06:34.313 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-05-08T20:06:34.314 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-05-08T20:06:34.315 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-05-08T20:06:34.316 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-05-08T20:06:34.317 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-05-08T20:06:34.317 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-05-08T20:06:34.318 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-05-08T20:06:34.319 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-05-08T20:06:34.320 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-05-08T20:06:34.321 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-05-08T20:06:34.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-05-08T20:06:34.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-05-08T20:06:34.323 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-05-08T20:06:34.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-05-08T20:06:34.325 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-05-08T20:06:34.326 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-05-08T20:06:34.327 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-05-08T20:06:34.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-05-08T20:06:34.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-05-08T20:06:34.331 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-05-08T20:06:34.332 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-05-08T20:06:34.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-05-08T20:06:34.334 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-05-08T20:06:34.335 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-05-08T20:06:34.336 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-05-08T20:06:34.336 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-05-08T20:06:34.337 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-05-08T20:06:34.338 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-05-08T20:06:34.339 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-05-08T20:06:34.340 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-05-08T20:06:34.341 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-05-08T20:06:34.342 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-05-08T20:06:34.343 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-05-08T20:06:34.344 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-05-08T20:06:34.345 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-05-08T20:06:34.346 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-05-08T20:06:34.348 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-05-08T20:06:34.349 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-05-08T20:06:34.350 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-05-08T20:06:34.350 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-05-08T20:06:34.351 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-05-08T20:06:34.352 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-05-08T20:06:34.353 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-05-08T20:06:34.354 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-05-08T20:06:34.354 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-05-08T20:06:34.355 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-05-08T20:06:34.356 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-05-08T20:06:34.357 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-05-08T20:06:34.358 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-05-08T20:06:34.359 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-05-08T20:06:34.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-05-08T20:06:34.361 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-05-08T20:06:34.362 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-05-08T20:06:34.363 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-05-08T20:06:34.364 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-05-08T20:06:34.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-05-08T20:06:34.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-05-08T20:06:34.366 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-05-08T20:06:34.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-05-08T20:06:34.368 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-05-08T20:06:34.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-05-08T20:06:34.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-05-08T20:06:34.370 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-05-08T20:06:34.371 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-05-08T20:06:34.371 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-05-08T20:06:34.372 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-05-08T20:06:34.373 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-05-08T20:06:34.373 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-05-08T20:06:34.374 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-05-08T20:06:34.375 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-05-08T20:06:34.376 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-05-08T20:06:34.376 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-05-08T20:06:34.377 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-05-08T20:06:34.378 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-05-08T20:06:34.379 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-05-08T20:06:34.380 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-05-08T20:06:34.381 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-05-08T20:06:34.382 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-05-08T20:06:34.383 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-05-08T20:06:34.384 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-05-08T20:06:34.385 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-05-08T20:06:34.385 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-05-08T20:06:34.386 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-05-08T20:06:34.387 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-05-08T20:06:34.388 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-05-08T20:06:34.389 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-05-08T20:06:34.390 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-05-08T20:06:34.391 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-05-08T20:06:34.392 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-05-08T20:06:34.393 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-05-08T20:06:34.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-05-08T20:06:34.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-05-08T20:06:34.395 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-05-08T20:06:34.396 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-05-08T20:06:34.397 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-05-08T20:06:34.398 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-05-08T20:06:34.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-05-08T20:06:34.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-05-08T20:06:34.400 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-05-08T20:06:34.401 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-05-08T20:06:34.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-05-08T20:06:34.403 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-05-08T20:06:34.404 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-05-08T20:06:34.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-05-08T20:06:34.406 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-05-08T20:06:34.407 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-05-08T20:06:34.408 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-05-08T20:06:34.409 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-05-08T20:06:34.410 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-05-08T20:06:34.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-05-08T20:06:34.412 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-05-08T20:06:34.413 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-05-08T20:06:34.414 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-05-08T20:06:34.415 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-05-08T20:06:34.416 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-05-08T20:06:34.417 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-05-08T20:06:34.418 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-05-08T20:06:34.421 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-05-08T20:06:34.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-05-08T20:06:34.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-05-08T20:06:34.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-05-08T20:06:34.423 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-05-08T20:06:34.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-05-08T20:06:34.425 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-05-08T20:06:34.425 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-05-08T20:06:34.426 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-05-08T20:06:34.427 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-05-08T20:06:34.428 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-05-08T20:06:34.430 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-05-08T20:06:34.431 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-05-08T20:06:34.432 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-05-08T20:06:34.432 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-05-08T20:06:34.433 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-05-08T20:06:34.434 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-05-08T20:06:34.435 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-05-08T20:06:34.436 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-05-08T20:06:34.437 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-05-08T20:06:34.438 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-05-08T20:06:34.439 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-05-08T20:06:34.440 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-05-08T20:06:34.441 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-05-08T20:06:34.442 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-05-08T20:06:34.594 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-05-08T20:06:34.594 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-05-08T20:06:34.595 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-05-08T20:06:34.596 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-05-08T20:06:34.597 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-05-08T20:06:34.599 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-05-08T20:06:34.600 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-05-08T20:06:34.601 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-05-08T20:06:34.602 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-05-08T20:06:34.603 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-05-08T20:06:34.604 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-05-08T20:06:34.604 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-05-08T20:06:34.605 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-05-08T20:06:34.607 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-05-08T20:06:34.608 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-05-08T20:06:34.608 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-05-08T20:06:34.609 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-05-08T20:06:34.610 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-05-08T20:06:34.610 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-05-08T20:06:34.611 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-05-08T20:06:34.612 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-05-08T20:06:34.613 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-05-08T20:06:34.614 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-05-08T20:06:34.615 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-05-08T20:06:34.616 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-05-08T20:06:34.617 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-05-08T20:06:34.618 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-05-08T20:06:34.619 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-05-08T20:06:34.620 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-05-08T20:06:34.621 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-05-08T20:06:34.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:34 smithi082 ceph-mon[46774]: pgmap v60: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 13 op/s 2024-05-08T20:06:34.622 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-05-08T20:06:34.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:34 smithi132 ceph-mon[47484]: pgmap v60: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 13 op/s 2024-05-08T20:06:34.626 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-05-08T20:06:34.626 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-05-08T20:06:34.626 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-05-08T20:06:34.626 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-05-08T20:06:34.627 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-05-08T20:06:34.628 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-05-08T20:06:34.628 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-05-08T20:06:34.629 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-05-08T20:06:34.630 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-05-08T20:06:34.631 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-05-08T20:06:34.632 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-05-08T20:06:34.633 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-05-08T20:06:34.634 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-05-08T20:06:34.635 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-05-08T20:06:34.636 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-05-08T20:06:34.637 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-05-08T20:06:34.638 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-05-08T20:06:34.639 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-05-08T20:06:34.640 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-05-08T20:06:34.641 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-05-08T20:06:34.642 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-05-08T20:06:34.643 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-05-08T20:06:34.644 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-05-08T20:06:34.646 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-05-08T20:06:34.647 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-05-08T20:06:34.648 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-05-08T20:06:34.650 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-05-08T20:06:34.651 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-05-08T20:06:34.653 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-05-08T20:06:34.654 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-05-08T20:06:34.655 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-05-08T20:06:34.657 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-05-08T20:06:34.658 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-05-08T20:06:34.660 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-05-08T20:06:34.661 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-05-08T20:06:34.662 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-05-08T20:06:34.663 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-05-08T20:06:34.665 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-05-08T20:06:34.666 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-05-08T20:06:34.667 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-05-08T20:06:34.669 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-05-08T20:06:34.670 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-05-08T20:06:34.671 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-05-08T20:06:34.672 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-05-08T20:06:34.673 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-05-08T20:06:34.674 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-05-08T20:06:34.676 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-05-08T20:06:34.676 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-05-08T20:06:34.677 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-05-08T20:06:34.678 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-05-08T20:06:34.679 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-05-08T20:06:34.679 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-05-08T20:06:34.680 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-05-08T20:06:34.681 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-05-08T20:06:34.682 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-05-08T20:06:34.683 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-05-08T20:06:34.684 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-05-08T20:06:34.685 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-05-08T20:06:34.685 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-05-08T20:06:34.686 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-05-08T20:06:34.687 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-05-08T20:06:34.688 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-05-08T20:06:34.689 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-05-08T20:06:34.690 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-05-08T20:06:34.691 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-05-08T20:06:34.691 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-05-08T20:06:34.692 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-05-08T20:06:34.693 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-05-08T20:06:34.694 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-05-08T20:06:34.695 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-05-08T20:06:34.696 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-05-08T20:06:34.697 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-05-08T20:06:34.697 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-05-08T20:06:34.698 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-05-08T20:06:34.699 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-05-08T20:06:34.700 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-05-08T20:06:34.701 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-05-08T20:06:34.702 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-05-08T20:06:34.703 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-05-08T20:06:34.704 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-05-08T20:06:34.705 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-05-08T20:06:34.706 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-05-08T20:06:34.709 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-05-08T20:06:34.710 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-05-08T20:06:34.711 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-05-08T20:06:34.712 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-05-08T20:06:34.713 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-05-08T20:06:34.713 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-05-08T20:06:34.714 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-05-08T20:06:34.715 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-05-08T20:06:34.716 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-05-08T20:06:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-05-08T20:06:34.717 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-05-08T20:06:34.718 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-05-08T20:06:34.719 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-05-08T20:06:34.720 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-05-08T20:06:34.721 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-05-08T20:06:34.722 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-05-08T20:06:34.723 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-05-08T20:06:34.724 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-05-08T20:06:34.725 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-05-08T20:06:34.726 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-05-08T20:06:34.727 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-05-08T20:06:34.728 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-05-08T20:06:34.728 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-05-08T20:06:34.729 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-05-08T20:06:34.730 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-05-08T20:06:34.731 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-05-08T20:06:34.732 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-05-08T20:06:34.733 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-05-08T20:06:34.734 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-05-08T20:06:34.735 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-05-08T20:06:34.736 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-05-08T20:06:34.737 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-05-08T20:06:34.738 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-05-08T20:06:34.739 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-05-08T20:06:34.740 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-05-08T20:06:34.741 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-05-08T20:06:34.742 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-05-08T20:06:34.743 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-05-08T20:06:34.745 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-05-08T20:06:34.746 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-05-08T20:06:34.747 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-05-08T20:06:34.748 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-05-08T20:06:34.749 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-05-08T20:06:34.751 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-05-08T20:06:34.752 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-05-08T20:06:34.753 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-05-08T20:06:34.755 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-05-08T20:06:34.756 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-05-08T20:06:34.757 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-05-08T20:06:34.758 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-05-08T20:06:34.759 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-05-08T20:06:34.760 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-05-08T20:06:34.761 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-05-08T20:06:34.762 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-05-08T20:06:34.764 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-05-08T20:06:34.765 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-05-08T20:06:34.766 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-05-08T20:06:34.767 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-05-08T20:06:34.768 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-05-08T20:06:34.769 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-05-08T20:06:34.771 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-05-08T20:06:34.772 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-05-08T20:06:34.773 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-05-08T20:06:34.774 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-05-08T20:06:34.775 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-05-08T20:06:34.776 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-05-08T20:06:34.778 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-05-08T20:06:34.779 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-05-08T20:06:34.781 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-05-08T20:06:34.782 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-05-08T20:06:34.783 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-05-08T20:06:34.784 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-05-08T20:06:34.786 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-05-08T20:06:34.787 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-05-08T20:06:34.788 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-05-08T20:06:34.789 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-05-08T20:06:34.790 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-05-08T20:06:34.793 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-05-08T20:06:34.793 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-05-08T20:06:34.793 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-05-08T20:06:34.794 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-05-08T20:06:34.795 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-05-08T20:06:34.797 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-05-08T20:06:34.798 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-05-08T20:06:34.799 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-05-08T20:06:34.800 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-05-08T20:06:34.802 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-05-08T20:06:34.803 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-05-08T20:06:34.804 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-05-08T20:06:34.805 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-05-08T20:06:34.806 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-05-08T20:06:34.807 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-05-08T20:06:34.808 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-05-08T20:06:34.809 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-05-08T20:06:34.811 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-05-08T20:06:34.812 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-05-08T20:06:34.813 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-05-08T20:06:34.814 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-05-08T20:06:34.816 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-05-08T20:06:34.817 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-05-08T20:06:34.818 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-05-08T20:06:34.819 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-05-08T20:06:34.821 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-05-08T20:06:34.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:34 smithi033 ceph-mon[42490]: pgmap v60: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 13 op/s 2024-05-08T20:06:34.822 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-05-08T20:06:34.822 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-05-08T20:06:34.823 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-05-08T20:06:34.824 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-05-08T20:06:34.825 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-05-08T20:06:34.825 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-05-08T20:06:34.827 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-05-08T20:06:34.827 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-05-08T20:06:34.829 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-05-08T20:06:34.830 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-05-08T20:06:34.830 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-05-08T20:06:34.831 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-05-08T20:06:34.832 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-05-08T20:06:34.833 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-05-08T20:06:34.834 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-05-08T20:06:34.835 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-05-08T20:06:34.837 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-05-08T20:06:34.838 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-05-08T20:06:34.839 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-05-08T20:06:34.840 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-05-08T20:06:34.841 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-05-08T20:06:34.842 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-05-08T20:06:34.843 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-05-08T20:06:34.844 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-05-08T20:06:34.846 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-05-08T20:06:34.847 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-05-08T20:06:34.848 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-05-08T20:06:34.849 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-05-08T20:06:34.851 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-05-08T20:06:34.852 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-05-08T20:06:34.853 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-05-08T20:06:34.854 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-05-08T20:06:34.856 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-05-08T20:06:34.857 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-05-08T20:06:34.857 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-05-08T20:06:34.858 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-05-08T20:06:34.859 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-05-08T20:06:34.859 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-05-08T20:06:34.861 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-05-08T20:06:34.861 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-05-08T20:06:34.862 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-05-08T20:06:34.863 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-05-08T20:06:34.864 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-05-08T20:06:34.865 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-05-08T20:06:34.866 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-05-08T20:06:34.867 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-05-08T20:06:34.868 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-05-08T20:06:34.869 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-05-08T20:06:34.870 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-05-08T20:06:34.871 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-05-08T20:06:34.871 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-05-08T20:06:34.872 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-05-08T20:06:34.873 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-05-08T20:06:34.874 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-05-08T20:06:34.875 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-05-08T20:06:34.876 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-05-08T20:06:34.877 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-05-08T20:06:34.878 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-05-08T20:06:34.879 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-05-08T20:06:34.880 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-05-08T20:06:34.881 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-05-08T20:06:34.882 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-05-08T20:06:34.883 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-05-08T20:06:34.884 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-05-08T20:06:34.885 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-05-08T20:06:34.886 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-05-08T20:06:34.887 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-05-08T20:06:34.888 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-05-08T20:06:34.889 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-05-08T20:06:34.890 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-05-08T20:06:34.891 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-05-08T20:06:34.892 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-05-08T20:06:34.893 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-05-08T20:06:34.893 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-05-08T20:06:34.894 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-05-08T20:06:34.895 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-05-08T20:06:34.896 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-05-08T20:06:34.897 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-05-08T20:06:34.898 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-05-08T20:06:34.899 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-05-08T20:06:34.900 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-05-08T20:06:34.901 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-05-08T20:06:34.902 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-05-08T20:06:34.903 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-05-08T20:06:34.905 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-05-08T20:06:34.905 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-05-08T20:06:34.906 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-05-08T20:06:34.907 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-05-08T20:06:34.908 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-05-08T20:06:34.909 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-05-08T20:06:34.910 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-05-08T20:06:34.911 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-05-08T20:06:34.912 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-05-08T20:06:34.913 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-05-08T20:06:34.914 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-05-08T20:06:34.915 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-05-08T20:06:34.915 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-05-08T20:06:34.916 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-05-08T20:06:34.917 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-05-08T20:06:34.918 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-05-08T20:06:34.919 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-05-08T20:06:34.920 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-05-08T20:06:34.921 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-05-08T20:06:34.921 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-05-08T20:06:34.922 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-05-08T20:06:34.923 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-05-08T20:06:34.924 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-05-08T20:06:34.925 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-05-08T20:06:34.926 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-05-08T20:06:34.927 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-05-08T20:06:34.928 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-05-08T20:06:34.929 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-05-08T20:06:34.930 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-05-08T20:06:34.931 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-05-08T20:06:34.931 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-05-08T20:06:34.932 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-05-08T20:06:34.933 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-05-08T20:06:34.934 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-05-08T20:06:34.935 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-05-08T20:06:34.936 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-05-08T20:06:34.937 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-05-08T20:06:34.938 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-05-08T20:06:34.939 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-05-08T20:06:34.940 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-05-08T20:06:34.941 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-05-08T20:06:34.942 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-05-08T20:06:34.943 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-05-08T20:06:34.944 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-05-08T20:06:34.944 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-05-08T20:06:34.945 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-05-08T20:06:34.946 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-05-08T20:06:34.947 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-05-08T20:06:34.948 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-05-08T20:06:34.948 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-05-08T20:06:34.949 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-05-08T20:06:34.950 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-05-08T20:06:34.951 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-05-08T20:06:34.952 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-05-08T20:06:34.954 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-05-08T20:06:34.955 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-05-08T20:06:34.957 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-05-08T20:06:34.957 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-05-08T20:06:34.958 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-05-08T20:06:34.960 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-05-08T20:06:34.960 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-05-08T20:06:34.961 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-05-08T20:06:34.963 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-05-08T20:06:34.964 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-05-08T20:06:34.964 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-05-08T20:06:34.965 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-05-08T20:06:34.966 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-05-08T20:06:34.967 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-05-08T20:06:34.969 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-05-08T20:06:34.969 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-05-08T20:06:34.970 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-05-08T20:06:34.971 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-05-08T20:06:34.972 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-05-08T20:06:34.973 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-05-08T20:06:34.974 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-05-08T20:06:34.976 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-05-08T20:06:34.977 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-05-08T20:06:34.979 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-05-08T20:06:34.980 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-05-08T20:06:34.981 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-05-08T20:06:34.982 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-05-08T20:06:34.983 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-05-08T20:06:34.984 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-05-08T20:06:34.985 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-05-08T20:06:34.986 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-05-08T20:06:34.987 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-05-08T20:06:34.988 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-05-08T20:06:34.989 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-05-08T20:06:34.990 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-05-08T20:06:34.991 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-05-08T20:06:34.992 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-05-08T20:06:34.993 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-05-08T20:06:34.994 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-05-08T20:06:34.995 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-05-08T20:06:34.996 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-05-08T20:06:34.997 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-05-08T20:06:34.998 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-05-08T20:06:34.999 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-05-08T20:06:35.000 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-05-08T20:06:35.001 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-05-08T20:06:35.002 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-05-08T20:06:35.003 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-05-08T20:06:35.006 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-05-08T20:06:35.006 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-05-08T20:06:35.006 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-05-08T20:06:35.007 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-05-08T20:06:35.008 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-05-08T20:06:35.009 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-05-08T20:06:35.010 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-05-08T20:06:35.011 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-05-08T20:06:35.012 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-05-08T20:06:35.013 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-05-08T20:06:35.014 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-05-08T20:06:35.015 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-05-08T20:06:35.016 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-05-08T20:06:35.017 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-05-08T20:06:35.018 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-05-08T20:06:35.019 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-05-08T20:06:35.020 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-05-08T20:06:35.021 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-05-08T20:06:35.022 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-05-08T20:06:35.022 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-05-08T20:06:35.023 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-05-08T20:06:35.024 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-05-08T20:06:35.025 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-05-08T20:06:35.026 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-05-08T20:06:35.027 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-05-08T20:06:35.028 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-05-08T20:06:35.029 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-05-08T20:06:35.030 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-05-08T20:06:35.031 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-05-08T20:06:35.033 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-05-08T20:06:35.033 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-05-08T20:06:35.034 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-05-08T20:06:35.035 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-05-08T20:06:35.036 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-05-08T20:06:35.038 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-05-08T20:06:35.039 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-05-08T20:06:35.040 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-05-08T20:06:35.041 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-05-08T20:06:35.042 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-05-08T20:06:35.043 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-05-08T20:06:35.044 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-05-08T20:06:35.045 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-05-08T20:06:35.046 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-05-08T20:06:35.047 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-05-08T20:06:35.048 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-05-08T20:06:35.049 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-05-08T20:06:35.050 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-05-08T20:06:35.051 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-05-08T20:06:35.052 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-05-08T20:06:35.054 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-05-08T20:06:35.055 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-05-08T20:06:35.056 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-05-08T20:06:35.056 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-05-08T20:06:35.058 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-05-08T20:06:35.058 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-05-08T20:06:35.059 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-05-08T20:06:35.060 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-05-08T20:06:35.061 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-05-08T20:06:35.062 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-05-08T20:06:35.063 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-05-08T20:06:35.063 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-05-08T20:06:35.064 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-05-08T20:06:35.065 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-05-08T20:06:35.066 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-05-08T20:06:35.067 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-05-08T20:06:35.067 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-05-08T20:06:35.068 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-05-08T20:06:35.069 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-05-08T20:06:35.070 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-05-08T20:06:35.071 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-05-08T20:06:35.073 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-05-08T20:06:35.074 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-05-08T20:06:35.075 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-05-08T20:06:35.076 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-05-08T20:06:35.077 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-05-08T20:06:35.077 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-05-08T20:06:35.078 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-05-08T20:06:35.079 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-05-08T20:06:35.080 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-05-08T20:06:35.082 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-05-08T20:06:35.083 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-05-08T20:06:35.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-05-08T20:06:35.085 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-05-08T20:06:35.087 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-05-08T20:06:35.088 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-05-08T20:06:35.090 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-05-08T20:06:35.090 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-05-08T20:06:35.091 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-05-08T20:06:35.092 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-05-08T20:06:35.093 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-05-08T20:06:35.094 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-05-08T20:06:35.095 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-05-08T20:06:35.096 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-05-08T20:06:35.097 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-05-08T20:06:35.098 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-05-08T20:06:35.099 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-05-08T20:06:35.100 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-05-08T20:06:35.101 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-05-08T20:06:35.102 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-05-08T20:06:35.103 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-05-08T20:06:35.104 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-05-08T20:06:35.105 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-05-08T20:06:35.106 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-05-08T20:06:35.107 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-05-08T20:06:35.108 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-05-08T20:06:35.109 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-05-08T20:06:35.110 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-05-08T20:06:35.111 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-05-08T20:06:35.112 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-05-08T20:06:35.113 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-05-08T20:06:35.114 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-05-08T20:06:35.115 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-05-08T20:06:35.116 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-05-08T20:06:35.117 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-05-08T20:06:35.118 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-05-08T20:06:35.118 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-05-08T20:06:35.119 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-05-08T20:06:35.120 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-05-08T20:06:35.121 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-05-08T20:06:35.122 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-05-08T20:06:35.123 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-05-08T20:06:35.124 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-05-08T20:06:35.125 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-05-08T20:06:35.126 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-05-08T20:06:35.127 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-05-08T20:06:35.128 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-05-08T20:06:35.129 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-05-08T20:06:35.132 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-05-08T20:06:35.132 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-05-08T20:06:35.133 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-05-08T20:06:35.134 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-05-08T20:06:35.135 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-05-08T20:06:35.136 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-05-08T20:06:35.137 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-05-08T20:06:35.138 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-05-08T20:06:35.138 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-05-08T20:06:35.139 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-05-08T20:06:35.140 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-05-08T20:06:35.141 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-05-08T20:06:35.142 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-05-08T20:06:35.143 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-05-08T20:06:35.144 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-05-08T20:06:35.145 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-05-08T20:06:35.146 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-05-08T20:06:35.147 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-05-08T20:06:35.147 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-05-08T20:06:35.148 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-05-08T20:06:35.149 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-05-08T20:06:35.150 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-05-08T20:06:35.151 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-05-08T20:06:35.152 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-05-08T20:06:35.152 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-05-08T20:06:35.153 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-05-08T20:06:35.154 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-05-08T20:06:35.155 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-05-08T20:06:35.156 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-05-08T20:06:35.157 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-05-08T20:06:35.158 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-05-08T20:06:35.159 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-05-08T20:06:35.160 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-05-08T20:06:35.162 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-05-08T20:06:35.163 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-05-08T20:06:35.164 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-05-08T20:06:35.165 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-05-08T20:06:35.166 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-05-08T20:06:35.167 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-05-08T20:06:35.168 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-05-08T20:06:35.169 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-05-08T20:06:35.169 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-05-08T20:06:35.170 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-05-08T20:06:35.171 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-05-08T20:06:35.172 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-05-08T20:06:35.173 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-05-08T20:06:35.174 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-05-08T20:06:35.174 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-05-08T20:06:35.175 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-05-08T20:06:35.176 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-05-08T20:06:35.177 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-05-08T20:06:35.178 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-05-08T20:06:35.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-05-08T20:06:35.180 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-05-08T20:06:35.180 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-05-08T20:06:35.181 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-05-08T20:06:35.182 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-05-08T20:06:35.183 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-05-08T20:06:35.184 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-05-08T20:06:35.185 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-05-08T20:06:35.186 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-05-08T20:06:35.187 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-05-08T20:06:35.187 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-05-08T20:06:35.188 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-05-08T20:06:35.189 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-05-08T20:06:35.190 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-05-08T20:06:35.191 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-05-08T20:06:35.192 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-05-08T20:06:35.193 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-05-08T20:06:35.194 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-05-08T20:06:35.195 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-05-08T20:06:35.196 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-05-08T20:06:35.197 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-05-08T20:06:35.198 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-05-08T20:06:35.199 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-05-08T20:06:35.200 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-05-08T20:06:35.201 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-05-08T20:06:35.202 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-05-08T20:06:35.203 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-05-08T20:06:35.204 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-05-08T20:06:35.204 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-05-08T20:06:35.205 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-05-08T20:06:35.206 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-05-08T20:06:35.207 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-05-08T20:06:35.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-05-08T20:06:35.209 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-05-08T20:06:35.210 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-05-08T20:06:35.211 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-05-08T20:06:35.212 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-05-08T20:06:35.213 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-05-08T20:06:35.213 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-05-08T20:06:35.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-05-08T20:06:35.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-05-08T20:06:35.216 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-05-08T20:06:35.217 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-05-08T20:06:35.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-05-08T20:06:35.219 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-05-08T20:06:35.219 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-05-08T20:06:35.220 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-05-08T20:06:35.221 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-05-08T20:06:35.222 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-05-08T20:06:35.223 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-05-08T20:06:35.224 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-05-08T20:06:35.224 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-05-08T20:06:35.225 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-05-08T20:06:35.226 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-05-08T20:06:35.227 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-05-08T20:06:35.228 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-05-08T20:06:35.228 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-05-08T20:06:35.229 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-05-08T20:06:35.229 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-05-08T20:06:35.230 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-05-08T20:06:35.231 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-05-08T20:06:35.232 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-05-08T20:06:35.233 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-05-08T20:06:35.233 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-05-08T20:06:35.234 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-05-08T20:06:35.235 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-05-08T20:06:35.237 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-05-08T20:06:35.238 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-05-08T20:06:35.238 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-05-08T20:06:35.240 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-05-08T20:06:35.241 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-05-08T20:06:35.242 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-05-08T20:06:35.242 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-05-08T20:06:35.243 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-05-08T20:06:35.243 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-05-08T20:06:35.244 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-05-08T20:06:35.245 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-05-08T20:06:35.246 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-05-08T20:06:35.246 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-05-08T20:06:35.247 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-05-08T20:06:35.248 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-05-08T20:06:35.249 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-05-08T20:06:35.250 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-05-08T20:06:35.251 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-05-08T20:06:35.252 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-05-08T20:06:35.253 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-05-08T20:06:35.254 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-05-08T20:06:35.254 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-05-08T20:06:35.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-05-08T20:06:35.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-05-08T20:06:35.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-05-08T20:06:35.258 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-05-08T20:06:35.259 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-05-08T20:06:35.260 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-05-08T20:06:35.261 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-05-08T20:06:35.262 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-05-08T20:06:35.263 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-05-08T20:06:35.264 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-05-08T20:06:35.265 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-05-08T20:06:35.266 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-05-08T20:06:35.266 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-05-08T20:06:35.267 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-05-08T20:06:35.268 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-05-08T20:06:35.269 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-05-08T20:06:35.270 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-05-08T20:06:35.271 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-05-08T20:06:35.272 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-05-08T20:06:35.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-05-08T20:06:35.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-05-08T20:06:35.275 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-05-08T20:06:35.276 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-05-08T20:06:35.277 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-05-08T20:06:35.278 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-05-08T20:06:35.279 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-05-08T20:06:35.280 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-05-08T20:06:35.281 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-05-08T20:06:35.282 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-05-08T20:06:35.283 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-05-08T20:06:35.284 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-05-08T20:06:35.285 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-05-08T20:06:35.287 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-05-08T20:06:35.288 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-05-08T20:06:35.289 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-05-08T20:06:35.290 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-05-08T20:06:35.291 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-05-08T20:06:35.292 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-05-08T20:06:35.293 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-05-08T20:06:35.294 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-05-08T20:06:35.294 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-05-08T20:06:35.295 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-05-08T20:06:35.296 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-05-08T20:06:35.297 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-05-08T20:06:35.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-05-08T20:06:35.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-05-08T20:06:35.299 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-05-08T20:06:35.300 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-05-08T20:06:35.301 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-05-08T20:06:35.302 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-05-08T20:06:35.303 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-05-08T20:06:35.304 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-05-08T20:06:35.305 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-05-08T20:06:35.306 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-05-08T20:06:35.307 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-05-08T20:06:35.308 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-05-08T20:06:35.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-05-08T20:06:35.310 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-05-08T20:06:35.311 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-05-08T20:06:35.312 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-05-08T20:06:35.313 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-05-08T20:06:35.314 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-05-08T20:06:35.315 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-05-08T20:06:35.316 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-05-08T20:06:35.317 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-05-08T20:06:35.318 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-05-08T20:06:35.318 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-05-08T20:06:35.319 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-05-08T20:06:35.320 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-05-08T20:06:35.321 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-05-08T20:06:35.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-05-08T20:06:35.323 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-05-08T20:06:35.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-05-08T20:06:35.325 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-05-08T20:06:35.326 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-05-08T20:06:35.327 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-05-08T20:06:35.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-05-08T20:06:35.329 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-05-08T20:06:35.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-05-08T20:06:35.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-05-08T20:06:35.331 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-05-08T20:06:35.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-05-08T20:06:35.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-05-08T20:06:35.334 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-05-08T20:06:35.335 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-05-08T20:06:35.336 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-05-08T20:06:35.337 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-05-08T20:06:35.337 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-05-08T20:06:35.338 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-05-08T20:06:35.339 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-05-08T20:06:35.340 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-05-08T20:06:35.341 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-05-08T20:06:35.342 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-05-08T20:06:35.342 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-05-08T20:06:35.343 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-05-08T20:06:35.344 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-05-08T20:06:35.345 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-05-08T20:06:35.346 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-05-08T20:06:35.347 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-05-08T20:06:35.348 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-05-08T20:06:35.349 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-05-08T20:06:35.350 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-05-08T20:06:35.351 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-05-08T20:06:35.352 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-05-08T20:06:35.352 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-05-08T20:06:35.353 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-05-08T20:06:35.354 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-05-08T20:06:35.355 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-05-08T20:06:35.355 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-05-08T20:06:35.356 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-05-08T20:06:35.357 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-05-08T20:06:35.358 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-05-08T20:06:35.358 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-05-08T20:06:35.359 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-05-08T20:06:35.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-05-08T20:06:35.361 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-05-08T20:06:35.362 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-05-08T20:06:35.363 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-05-08T20:06:35.364 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-05-08T20:06:35.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-05-08T20:06:35.366 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-05-08T20:06:35.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-05-08T20:06:35.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-05-08T20:06:35.368 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-05-08T20:06:35.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-05-08T20:06:35.370 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-05-08T20:06:35.371 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-05-08T20:06:35.372 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-05-08T20:06:35.373 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-05-08T20:06:35.374 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-05-08T20:06:35.375 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-05-08T20:06:35.376 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-05-08T20:06:35.377 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-05-08T20:06:35.378 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-05-08T20:06:35.379 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-05-08T20:06:35.380 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-05-08T20:06:35.381 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-05-08T20:06:35.382 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-05-08T20:06:35.383 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-05-08T20:06:35.384 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-05-08T20:06:35.385 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-05-08T20:06:35.386 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-05-08T20:06:35.387 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-05-08T20:06:35.388 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-05-08T20:06:35.388 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-05-08T20:06:35.389 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-05-08T20:06:35.390 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-05-08T20:06:35.391 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-05-08T20:06:35.391 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-05-08T20:06:35.392 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-05-08T20:06:35.393 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-05-08T20:06:35.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-05-08T20:06:35.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-05-08T20:06:35.395 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-05-08T20:06:35.396 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-05-08T20:06:35.397 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-05-08T20:06:35.397 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-05-08T20:06:35.398 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-05-08T20:06:35.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-05-08T20:06:35.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-05-08T20:06:35.400 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-05-08T20:06:35.401 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-05-08T20:06:35.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-05-08T20:06:35.403 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-05-08T20:06:35.404 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-05-08T20:06:35.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-05-08T20:06:35.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-05-08T20:06:35.406 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-05-08T20:06:35.407 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-05-08T20:06:35.408 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-05-08T20:06:35.408 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-05-08T20:06:35.409 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-05-08T20:06:35.410 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-05-08T20:06:35.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-05-08T20:06:35.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-05-08T20:06:35.412 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-05-08T20:06:35.413 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-05-08T20:06:35.413 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-05-08T20:06:35.414 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-05-08T20:06:35.415 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-05-08T20:06:35.416 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-05-08T20:06:35.416 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-05-08T20:06:35.417 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-05-08T20:06:35.418 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-05-08T20:06:35.419 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-05-08T20:06:35.419 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-05-08T20:06:35.420 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-05-08T20:06:35.421 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-05-08T20:06:35.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-05-08T20:06:35.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-05-08T20:06:35.423 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-05-08T20:06:35.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-05-08T20:06:35.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-05-08T20:06:35.425 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-05-08T20:06:35.426 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-05-08T20:06:35.426 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-05-08T20:06:35.427 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-05-08T20:06:35.428 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-05-08T20:06:35.429 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-05-08T20:06:35.429 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-05-08T20:06:35.430 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-05-08T20:06:35.431 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-05-08T20:06:35.432 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-05-08T20:06:35.433 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-05-08T20:06:35.434 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-05-08T20:06:35.435 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-05-08T20:06:35.436 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-05-08T20:06:35.437 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-05-08T20:06:35.437 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-05-08T20:06:35.438 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-05-08T20:06:35.439 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-05-08T20:06:35.440 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-05-08T20:06:35.441 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-05-08T20:06:35.442 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-05-08T20:06:35.442 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-05-08T20:06:35.443 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-05-08T20:06:35.444 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-05-08T20:06:35.444 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-05-08T20:06:35.445 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-05-08T20:06:35.446 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-05-08T20:06:35.446 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-05-08T20:06:35.447 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-05-08T20:06:35.448 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-05-08T20:06:35.449 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-05-08T20:06:35.449 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-05-08T20:06:35.450 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-05-08T20:06:35.451 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-05-08T20:06:35.452 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-05-08T20:06:35.453 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-05-08T20:06:35.453 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-05-08T20:06:35.454 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-05-08T20:06:35.455 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-05-08T20:06:35.455 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-05-08T20:06:35.456 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-05-08T20:06:35.457 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-05-08T20:06:35.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-05-08T20:06:35.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-05-08T20:06:35.459 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-05-08T20:06:35.460 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-05-08T20:06:35.460 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-05-08T20:06:35.461 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-05-08T20:06:35.462 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-05-08T20:06:35.462 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-05-08T20:06:35.463 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-05-08T20:06:35.464 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-05-08T20:06:35.465 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-05-08T20:06:35.465 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-05-08T20:06:35.466 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-05-08T20:06:35.467 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-05-08T20:06:35.467 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-05-08T20:06:35.468 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-05-08T20:06:35.469 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-05-08T20:06:35.470 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-05-08T20:06:35.471 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-05-08T20:06:35.472 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-05-08T20:06:35.473 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-05-08T20:06:35.474 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-05-08T20:06:35.474 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-05-08T20:06:35.475 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-05-08T20:06:35.476 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-05-08T20:06:35.476 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-05-08T20:06:35.477 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-05-08T20:06:35.478 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-05-08T20:06:35.478 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-05-08T20:06:35.479 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-05-08T20:06:35.481 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-05-08T20:06:35.481 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-05-08T20:06:35.481 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-05-08T20:06:35.482 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-05-08T20:06:35.483 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-05-08T20:06:35.483 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-05-08T20:06:35.484 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-05-08T20:06:35.485 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-05-08T20:06:35.485 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-05-08T20:06:35.486 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-05-08T20:06:35.487 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-05-08T20:06:35.488 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-05-08T20:06:35.488 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-05-08T20:06:35.489 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-05-08T20:06:35.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-05-08T20:06:35.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-05-08T20:06:35.491 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-05-08T20:06:35.492 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-05-08T20:06:35.493 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-05-08T20:06:35.493 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-05-08T20:06:35.494 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-05-08T20:06:35.495 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-05-08T20:06:35.495 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-05-08T20:06:35.496 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-05-08T20:06:35.497 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-05-08T20:06:35.497 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-05-08T20:06:35.498 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-05-08T20:06:35.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-05-08T20:06:35.502 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-05-08T20:06:35.502 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-05-08T20:06:35.503 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-05-08T20:06:35.504 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-05-08T20:06:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 -- 172.21.15.33:0/3922214645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c1011a0 msgr2=0x7fa17c10d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 --2- 172.21.15.33:0/3922214645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c1011a0 0x7fa17c10d3b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa170009990 tx=0x7fa170009ca0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 -- 172.21.15.33:0/3922214645 shutdown_connections 2024-05-08T20:06:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 --2- 172.21.15.33:0/3922214645 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c10d8f0 0x7fa17c10fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 --2- 172.21.15.33:0/3922214645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa17c100880 0x7fa17c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.505 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 --2- 172.21.15.33:0/3922214645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c1011a0 0x7fa17c10d3b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 -- 172.21.15.33:0/3922214645 >> 172.21.15.33:0/3922214645 conn(0x7fa17c076f10 msgr2=0x7fa17c077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 -- 172.21.15.33:0/3922214645 shutdown_connections 2024-05-08T20:06:35.506 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.515+0000 7fa181cee700 1 -- 172.21.15.33:0/3922214645 wait complete. 2024-05-08T20:06:35.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-05-08T20:06:35.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-05-08T20:06:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 Processor -- start 2024-05-08T20:06:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 -- start start 2024-05-08T20:06:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c100880 0x7fa17c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.507 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c1011a0 0x7fa17c199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa17c10d8f0 0x7fa17c19dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19e5f0 con 0x7fa17c100880 2024-05-08T20:06:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19e760 con 0x7fa17c1011a0 2024-05-08T20:06:35.508 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.516+0000 7fa181cee700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa17c19e920 con 0x7fa17c10d8f0 2024-05-08T20:06:35.508 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-05-08T20:06:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c1011a0 0x7fa17c199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c100880 0x7fa17c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.509 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c1011a0 0x7fa17c199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:48504/0 (socket says 172.21.15.33:48504) 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 -- 172.21.15.33:0/2714560248 learned_addr learned my addr 172.21.15.33:0/2714560248 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17bfff700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa17c10d8f0 0x7fa17c19dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 -- 172.21.15.33:0/2714560248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa17c10d8f0 msgr2=0x7fa17c19dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa17c10d8f0 0x7fa17c19dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 -- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c100880 msgr2=0x7fa17c1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c100880 0x7fa17c1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 -- 172.21.15.33:0/2714560248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa174009c40 con 0x7fa17c1011a0 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa17affd700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c1011a0 0x7fa17c199c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa170000c00 tx=0x7fa170004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa178ff9700 1 -- 172.21.15.33:0/2714560248 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17001d070 con 0x7fa17c1011a0 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1700095f0 con 0x7fa17c1011a0 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa178ff9700 1 -- 172.21.15.33:0/2714560248 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa170021410 con 0x7fa17c1011a0 2024-05-08T20:06:35.510 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa178ff9700 1 -- 172.21.15.33:0/2714560248 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170017650 con 0x7fa17c1011a0 2024-05-08T20:06:35.511 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-05-08T20:06:35.511 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.517+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c19ee30 con 0x7fa17c1011a0 2024-05-08T20:06:35.511 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-05-08T20:06:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.520+0000 7fa178ff9700 1 -- 172.21.15.33:0/2714560248 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fa1700218f0 con 0x7fa17c1011a0 2024-05-08T20:06:35.512 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-05-08T20:06:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.520+0000 7fa178ff9700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fa1640a1290 0x7fa1640a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.512 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.520+0000 7fa178ff9700 1 -- 172.21.15.33:0/2714560248 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7fa1700cdeb0 con 0x7fa17c1011a0 2024-05-08T20:06:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.520+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fa1640a1290 0x7fa1640a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.513 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-05-08T20:06:35.513 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.521+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fa1640a1290 0x7fa1640a3750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa16c004630 tx=0x7fa16c00b3c0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:35.513 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.521+0000 7fa18dea8b80 1 Processor -- start 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.521+0000 7fa18dea8b80 1 -- start start 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df629d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6297750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df62980b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df61e60f0 con 0x562df629da80 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df61e3ab0 con 0x562df629d160 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df61df3a0 con 0x562df6297c90 2024-05-08T20:06:35.515 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6297750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.516 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df629d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6297750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34192/0 (socket says 172.21.15.33:34192) 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17affd700 1 -- 172.21.15.33:0/3537316234 learned_addr learned my addr 172.21.15.33:0/3537316234 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17bfff700 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df62980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17b7fe700 1 -- 172.21.15.33:0/3537316234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 msgr2=0x562df62980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df62980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17b7fe700 1 -- 172.21.15.33:0/3537316234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 msgr2=0x562df6297750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6297750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17b7fe700 1 -- 172.21.15.33:0/3537316234 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df6060350 con 0x562df629d160 2024-05-08T20:06:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17affd700 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6297750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.522+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df629d540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa16c003a60 tx=0x7fa16c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74161afdde3586be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa161ffb700 1 -- 172.21.15.33:0/3537316234 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0118d0 con 0x562df629d160 2024-05-08T20:06:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa161ffb700 1 -- 172.21.15.33:0/3537316234 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa16c015070 con 0x562df629d160 2024-05-08T20:06:35.518 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa161ffb700 1 -- 172.21.15.33:0/3537316234 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c005330 con 0x562df629d160 2024-05-08T20:06:35.518 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 -- 172.21.15.33:0/3537316234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 msgr2=0x562df629d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df629d540 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa16c003a60 tx=0x7fa16c013000 comp rx=0 tx=0).stop 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 -- 172.21.15.33:0/3537316234 shutdown_connections 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df62980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df629d540 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/3537316234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6297750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 -- 172.21.15.33:0/3537316234 >> 172.21.15.33:0/3537316234 conn(0x562df61ed1b0 msgr2=0x562df6289840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.523+0000 7fa18dea8b80 1 -- 172.21.15.33:0/3537316234 shutdown_connections 2024-05-08T20:06:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 -- 172.21.15.33:0/3537316234 wait complete. 2024-05-08T20:06:35.520 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-05-08T20:06:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 -- start start 2024-05-08T20:06:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 Processor -- start 2024-05-08T20:06:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df6297c90 0x562df62a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629d160 0x562df62a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.521 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df62a1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.521 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-05-08T20:06:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df617b500 con 0x562df629da80 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df617b1a0 con 0x562df6297c90 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6062640 con 0x562df629d160 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.524+0000 7fa18dea8b80 10 client.0 _ll_register_callbacks cb 0x562df6184ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df6297c90 0x562df62a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df6297c90 0x562df62a3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:48524/0 (socket says 172.21.15.33:48524) 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df62a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 -- 172.21.15.33:0/1352974155 learned_addr learned my addr 172.21.15.33:0/1352974155 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17affd700 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629d160 0x562df62a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 -- 172.21.15.33:0/1352974155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629d160 msgr2=0x562df62a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629d160 0x562df62a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 -- 172.21.15.33:0/1352974155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 msgr2=0x562df62a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df62a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 -- 172.21.15.33:0/1352974155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa17c19ee30 con 0x562df6297c90 2024-05-08T20:06:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df6297c90 0x562df62a3990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa16c004ef0 tx=0x7fa16c004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37656e796adad7be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa15affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:06:35.524 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-05-08T20:06:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa15affd700 1 -- 172.21.15.33:0/1352974155 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c011ad0 con 0x562df6297c90 2024-05-08T20:06:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa15affd700 1 -- 172.21.15.33:0/1352974155 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7fa16c017070 con 0x562df6297c90 2024-05-08T20:06:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562df6138210 con 0x562df6297c90 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa15affd700 1 -- 172.21.15.33:0/1352974155 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa16c011c30 con 0x562df6297c90 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.525+0000 7fa18dea8b80 10 client.25373 fetch_fsmap learned FSMap version 26 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fa16c003740 con 0x562df6297c90 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa15affd700 1 -- 172.21.15.33:0/1352974155 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562df6138210 con 0x562df6297c90 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa15affd700 1 -- 172.21.15.33:0/1352974155 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa16c024070 con 0x562df6297c90 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa18dea8b80 10 client.25373 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa18dea8b80 10 client.25373 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa18dea8b80 20 client.25373 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df62b1370 0x562df62b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa18dea8b80 4 client.25373 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:06:35.526 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562df625e7b0 con 0x562df62b1370 2024-05-08T20:06:35.527 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-05-08T20:06:35.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa17affd700 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df62b1370 0x562df62b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa17affd700 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df62b1370 0x562df62b3790 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60eacd7bab0743db server_cookie=76595ba3efbb2b0c in_seq=0 out_seq=0 2024-05-08T20:06:35.527 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.526+0000 7fa15affd700 10 client.25373 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:35.527 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-05-08T20:06:35.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa15affd700 1 -- 172.21.15.33:0/1352974155 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562df625e7b0 con 0x562df62b1370 2024-05-08T20:06:35.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa15affd700 10 client.25373 handle_command_reply: tid=0 2024-05-08T20:06:35.528 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 client.25373 shutdown 2024-05-08T20:06:35.528 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-05-08T20:06:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df6297c90 msgr2=0x562df62a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df6297c90 0x562df62a3990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa16c004ef0 tx=0x7fa16c004710 comp rx=0 tx=0).stop 2024-05-08T20:06:35.529 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 shutdown_connections 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df62b1370 0x562df62b3790 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df62a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df6297c90 0x562df62a3990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1352974155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629d160 0x562df62a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa15affd700 0 client.25373 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 >> 172.21.15.33:0/1352974155 conn(0x562df61ed1b0 msgr2=0x562df6296740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.527+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 shutdown_connections 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.528+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1352974155 wait complete. 2024-05-08T20:06:35.530 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.528+0000 7fa18dea8b80 20 client.25373 trim_cache size 0 max 16384 2024-05-08T20:06:35.532 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-05-08T20:06:35.532 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-05-08T20:06:35.532 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-05-08T20:06:35.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-05-08T20:06:35.534 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-05-08T20:06:35.534 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 Processor -- start 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 -- start start 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df629ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df6289910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6298070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6298600 con 0x562df629da80 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df628a760 con 0x562df629d160 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df62a14e0 con 0x562df6297c90 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa17bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6298070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa17bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6298070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34212/0 (socket says 172.21.15.33:34212) 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa17bfff700 1 -- 172.21.15.33:0/1619792390 learned_addr learned my addr 172.21.15.33:0/1619792390 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.544+0000 7fa17affd700 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df6289910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df629ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17bfff700 1 -- 172.21.15.33:0/1619792390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 msgr2=0x562df629ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17bfff700 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df629ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17bfff700 1 -- 172.21.15.33:0/1619792390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 msgr2=0x562df6289910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17bfff700 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df6289910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17bfff700 1 -- 172.21.15.33:0/1619792390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df600cb00 con 0x562df629da80 2024-05-08T20:06:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17affd700 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df6289910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:35.537 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-05-08T20:06:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa17bfff700 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6298070 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa174007850 tx=0x7fa17400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c627cf71a6d3200 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa1627fc700 1 -- 172.21.15.33:0/1619792390 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17400e040 con 0x562df629da80 2024-05-08T20:06:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa1627fc700 1 -- 172.21.15.33:0/1619792390 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa17400f040 con 0x562df629da80 2024-05-08T20:06:35.538 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.545+0000 7fa1627fc700 1 -- 172.21.15.33:0/1619792390 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa174005590 con 0x562df629da80 2024-05-08T20:06:35.539 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1619792390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 msgr2=0x562df6298070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6298070 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa174007850 tx=0x7fa17400b040 comp rx=0 tx=0).stop 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1619792390 shutdown_connections 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df629da80 0x562df6298070 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df6297c90 0x562df629ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/1619792390 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df6289910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1619792390 >> 172.21.15.33:0/1619792390 conn(0x562df61ed1b0 msgr2=0x562df6296740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1619792390 shutdown_connections 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 -- 172.21.15.33:0/1619792390 wait complete. 2024-05-08T20:06:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 -- start start 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.546+0000 7fa18dea8b80 1 Processor -- start 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df6297c90 0x562df62a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df62a6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa18dea8b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629da80 0x562df62a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6306830 con 0x562df6297c90 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6306970 con 0x562df629d160 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa18dea8b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6306ab0 con 0x562df629da80 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa18dea8b80 10 client.0 _ll_register_callbacks cb 0x562df6184ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df6297c90 0x562df62a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df6297c90 0x562df62a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34226/0 (socket says 172.21.15.33:34226) 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17affd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df62a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17b7fe700 1 -- 172.21.15.33:0/4106297403 learned_addr learned my addr 172.21.15.33:0/4106297403 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17bfff700 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629da80 0x562df62a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17affd700 1 -- 172.21.15.33:0/4106297403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629da80 msgr2=0x562df62a6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17affd700 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629da80 0x562df62a6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17affd700 1 -- 172.21.15.33:0/4106297403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df6297c90 msgr2=0x562df62a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17affd700 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df6297c90 0x562df62a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17affd700 1 -- 172.21.15.33:0/4106297403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1700095f0 con 0x562df629d160 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.547+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df6297c90 0x562df62a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa17affd700 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df62a6970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1700974e0 tx=0x7fa170009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9dcd934fd14dc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa15affd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa15affd700 1 -- 172.21.15.33:0/4106297403 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17009afe0 con 0x562df629d160 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa15affd700 1 -- 172.21.15.33:0/4106297403 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7fa17009ee10 con 0x562df629d160 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa16c015070 con 0x562df629d160 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa15affd700 1 -- 172.21.15.33:0/4106297403 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1700a33d0 con 0x562df629d160 2024-05-08T20:06:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 10 client.25379 fetch_fsmap learned FSMap version 26 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fa174007500 con 0x562df629d160 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa15affd700 1 -- 172.21.15.33:0/4106297403 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa1700a7080 con 0x562df629d160 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa15affd700 1 -- 172.21.15.33:0/4106297403 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 26) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa17009b240 con 0x562df629d160 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 10 client.25379 fetch_fsmap finished waiting for FSMap version 26 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 10 client.25379 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 20 client.25379 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df6307e90 0x562df630a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 4 client.25379 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.548+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562df61d7e60 con 0x562df6307e90 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.549+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df6307e90 0x562df630a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.549+0000 7fa15affd700 10 client.25379 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:35.549+0000 7fa17b7fe700 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df6307e90 0x562df630a2b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f052c847d46e8576 server_cookie=7dd0809b101688c0 in_seq=0 out_seq=0 2024-05-08T20:06:35.743 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-05-08T20:06:36.005 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-05-08T20:06:36.010 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-05-08T20:06:36.014 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-05-08T20:06:36.019 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-05-08T20:06:36.022 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-05-08T20:06:36.032 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-05-08T20:06:36.035 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-05-08T20:06:36.041 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-05-08T20:06:36.045 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-05-08T20:06:36.062 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-05-08T20:06:36.066 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-05-08T20:06:36.068 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-05-08T20:06:36.074 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-05-08T20:06:36.078 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-05-08T20:06:36.082 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-05-08T20:06:36.086 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-05-08T20:06:36.093 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-05-08T20:06:36.099 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-05-08T20:06:36.100 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-05-08T20:06:36.101 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-05-08T20:06:36.103 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-05-08T20:06:36.104 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-05-08T20:06:36.109 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-05-08T20:06:36.199 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-05-08T20:06:36.200 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-05-08T20:06:36.202 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-05-08T20:06:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.212+0000 7fa15affd700 1 -- 172.21.15.33:0/4106297403 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562df61d7e60 con 0x562df6307e90 2024-05-08T20:06:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.212+0000 7fa15affd700 10 client.25379 handle_command_reply: tid=0 2024-05-08T20:06:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 client.25379 shutdown 2024-05-08T20:06:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 msgr2=0x562df62a6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:36.203 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df62a6970 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1700974e0 tx=0x7fa170009ca0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 shutdown_connections 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x562df6307e90 0x562df630a2b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x562df629da80 0x562df62a6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562df6297c90 0x562df62a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 --2- 172.21.15.33:0/4106297403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562df629d160 0x562df62a6970 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa15affd700 0 client.25379 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 >> 172.21.15.33:0/4106297403 conn(0x562df61ed1b0 msgr2=0x562df629ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 shutdown_connections 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 1 -- 172.21.15.33:0/4106297403 wait complete. 2024-05-08T20:06:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.213+0000 7fa18dea8b80 20 client.25379 trim_cache size 0 max 16384 2024-05-08T20:06:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:06:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:06:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:06:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:06:36.205 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-05-08T20:06:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fa1640a1290 msgr2=0x7fa1640a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fa1640a1290 0x7fa1640a3750 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa16c004630 tx=0x7fa16c00b3c0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c1011a0 msgr2=0x7fa17c199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c1011a0 0x7fa17c199c10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa170000c00 tx=0x7fa170004730 comp rx=0 tx=0).stop 2024-05-08T20:06:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 shutdown_connections 2024-05-08T20:06:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa17c10d8f0 0x7fa17c19dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.206 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fa1640a1290 0x7fa1640a3750 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa17c100880 0x7fa17c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 --2- 172.21.15.33:0/2714560248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa17c1011a0 0x7fa17c199c10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 >> 172.21.15.33:0/2714560248 conn(0x7fa17c076f10 msgr2=0x7fa17c10f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 shutdown_connections 2024-05-08T20:06:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:36.214+0000 7fa181cee700 1 -- 172.21.15.33:0/2714560248 wait complete. 2024-05-08T20:06:36.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-05-08T20:06:36.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-05-08T20:06:36.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-05-08T20:06:36.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-05-08T20:06:36.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-05-08T20:06:36.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-05-08T20:06:36.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-05-08T20:06:36.209 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-05-08T20:06:36.210 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-05-08T20:06:36.210 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-05-08T20:06:36.211 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-05-08T20:06:36.212 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-05-08T20:06:36.212 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-05-08T20:06:36.213 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-05-08T20:06:36.214 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-05-08T20:06:36.214 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-05-08T20:06:36.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-05-08T20:06:36.216 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-05-08T20:06:36.216 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-05-08T20:06:36.217 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-05-08T20:06:36.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-05-08T20:06:36.219 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-05-08T20:06:36.220 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-05-08T20:06:36.220 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-05-08T20:06:36.221 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-05-08T20:06:36.222 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-05-08T20:06:36.223 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-05-08T20:06:36.224 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-05-08T20:06:36.224 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-05-08T20:06:36.225 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-05-08T20:06:36.226 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-05-08T20:06:36.227 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-05-08T20:06:36.228 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-05-08T20:06:36.229 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-05-08T20:06:36.230 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-05-08T20:06:36.231 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-05-08T20:06:36.232 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-05-08T20:06:36.233 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-05-08T20:06:36.234 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-05-08T20:06:36.235 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-05-08T20:06:36.236 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-05-08T20:06:36.237 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-05-08T20:06:36.237 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/digsig.txt 2024-05-08T20:06:36.238 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-05-08T20:06:36.239 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-05-08T20:06:36.240 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-05-08T20:06:36.241 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-05-08T20:06:36.242 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-05-08T20:06:36.242 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-05-08T20:06:36.243 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dontdiff 2024-05-08T20:06:36.244 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/ 2024-05-08T20:06:36.245 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-05-08T20:06:36.246 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-05-08T20:06:36.248 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-05-08T20:06:36.249 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-05-08T20:06:36.250 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-05-08T20:06:36.251 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-05-08T20:06:36.252 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-05-08T20:06:36.253 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-05-08T20:06:36.254 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-05-08T20:06:36.255 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-05-08T20:06:36.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/ 2024-05-08T20:06:36.258 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-05-08T20:06:36.259 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-05-08T20:06:36.260 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-05-08T20:06:36.262 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-05-08T20:06:36.263 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-05-08T20:06:36.264 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-05-08T20:06:36.265 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-05-08T20:06:36.266 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-05-08T20:06:36.267 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-05-08T20:06:36.269 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-05-08T20:06:36.270 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-05-08T20:06:36.271 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-05-08T20:06:36.272 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-05-08T20:06:36.273 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-05-08T20:06:36.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-05-08T20:06:36.276 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-05-08T20:06:36.277 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-05-08T20:06:36.279 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-05-08T20:06:36.280 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/edac.txt 2024-05-08T20:06:36.280 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-05-08T20:06:36.281 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/eisa.txt 2024-05-08T20:06:36.282 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-05-08T20:06:36.283 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/extcon/ 2024-05-08T20:06:36.284 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-05-08T20:06:36.285 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-05-08T20:06:36.286 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-05-08T20:06:36.287 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-05-08T20:06:36.288 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-05-08T20:06:36.289 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/ 2024-05-08T20:06:36.290 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-05-08T20:06:36.291 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-05-08T20:06:36.292 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-05-08T20:06:36.293 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-05-08T20:06:36.294 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-05-08T20:06:36.295 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-05-08T20:06:36.295 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-05-08T20:06:36.297 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-05-08T20:06:36.297 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-05-08T20:06:36.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-05-08T20:06:36.299 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-05-08T20:06:36.300 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-05-08T20:06:36.301 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-05-08T20:06:36.302 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-05-08T20:06:36.303 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-05-08T20:06:36.303 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-05-08T20:06:36.304 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-05-08T20:06:36.305 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-05-08T20:06:36.306 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-05-08T20:06:36.307 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-05-08T20:06:36.308 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-05-08T20:06:36.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-05-08T20:06:36.310 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-05-08T20:06:36.311 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-05-08T20:06:36.312 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-05-08T20:06:36.313 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-05-08T20:06:36.314 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-05-08T20:06:36.314 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-05-08T20:06:36.315 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-05-08T20:06:36.316 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-05-08T20:06:36.317 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-05-08T20:06:36.318 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-05-08T20:06:36.319 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-05-08T20:06:36.320 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-05-08T20:06:36.321 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-05-08T20:06:36.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ 2024-05-08T20:06:36.323 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-05-08T20:06:36.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-05-08T20:06:36.325 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-05-08T20:06:36.326 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-05-08T20:06:36.327 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-05-08T20:06:36.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-05-08T20:06:36.329 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-05-08T20:06:36.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-05-08T20:06:36.331 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-05-08T20:06:36.332 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-05-08T20:06:36.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-05-08T20:06:36.334 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-05-08T20:06:36.335 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-05-08T20:06:36.336 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-05-08T20:06:36.337 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-05-08T20:06:36.338 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-05-08T20:06:36.339 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-05-08T20:06:36.340 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-05-08T20:06:36.341 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-05-08T20:06:36.343 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-05-08T20:06:36.343 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-05-08T20:06:36.344 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-05-08T20:06:36.345 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-05-08T20:06:36.346 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-05-08T20:06:36.347 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-05-08T20:06:36.348 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-05-08T20:06:36.349 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-05-08T20:06:36.350 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-05-08T20:06:36.351 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-05-08T20:06:36.352 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-05-08T20:06:36.353 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-05-08T20:06:36.356 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-05-08T20:06:36.357 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-05-08T20:06:36.358 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-05-08T20:06:36.359 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-05-08T20:06:36.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-05-08T20:06:36.361 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-05-08T20:06:36.361 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-05-08T20:06:36.362 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-05-08T20:06:36.363 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-05-08T20:06:36.364 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-05-08T20:06:36.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-05-08T20:06:36.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-05-08T20:06:36.366 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-05-08T20:06:36.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-05-08T20:06:36.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-05-08T20:06:36.368 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-05-08T20:06:36.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-05-08T20:06:36.370 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-05-08T20:06:36.371 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-05-08T20:06:36.372 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-05-08T20:06:36.373 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-05-08T20:06:36.374 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-05-08T20:06:36.375 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-05-08T20:06:36.375 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-05-08T20:06:36.376 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-05-08T20:06:36.377 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-05-08T20:06:36.378 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-05-08T20:06:36.379 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-05-08T20:06:36.379 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-05-08T20:06:36.380 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-05-08T20:06:36.381 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-05-08T20:06:36.382 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-05-08T20:06:36.383 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-05-08T20:06:36.384 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-05-08T20:06:36.385 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-05-08T20:06:36.386 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-05-08T20:06:36.387 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-05-08T20:06:36.388 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-05-08T20:06:36.389 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-05-08T20:06:36.389 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-05-08T20:06:36.390 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-05-08T20:06:36.391 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-05-08T20:06:36.392 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-05-08T20:06:36.393 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-05-08T20:06:36.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-05-08T20:06:36.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-05-08T20:06:36.395 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-05-08T20:06:36.396 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-05-08T20:06:36.397 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-05-08T20:06:36.398 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-05-08T20:06:36.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-05-08T20:06:36.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-05-08T20:06:36.400 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-05-08T20:06:36.401 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-05-08T20:06:36.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-05-08T20:06:36.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-05-08T20:06:36.403 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-05-08T20:06:36.404 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-05-08T20:06:36.406 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-05-08T20:06:36.406 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-05-08T20:06:36.407 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-05-08T20:06:36.408 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-05-08T20:06:36.409 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-05-08T20:06:36.410 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-05-08T20:06:36.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-05-08T20:06:36.412 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-05-08T20:06:36.413 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-05-08T20:06:36.414 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-05-08T20:06:36.415 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-05-08T20:06:36.416 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-05-08T20:06:36.416 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-05-08T20:06:36.417 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-05-08T20:06:36.418 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-05-08T20:06:36.419 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-05-08T20:06:36.420 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-05-08T20:06:36.421 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-05-08T20:06:36.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-05-08T20:06:36.423 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-05-08T20:06:36.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-05-08T20:06:36.425 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-05-08T20:06:36.425 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-05-08T20:06:36.426 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-05-08T20:06:36.427 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-05-08T20:06:36.428 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-05-08T20:06:36.429 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-05-08T20:06:36.430 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-05-08T20:06:36.431 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-05-08T20:06:36.432 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-05-08T20:06:36.433 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/ 2024-05-08T20:06:36.434 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-05-08T20:06:36.435 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-05-08T20:06:36.436 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-05-08T20:06:36.437 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-05-08T20:06:36.438 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-05-08T20:06:36.439 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-05-08T20:06:36.440 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-05-08T20:06:36.441 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-05-08T20:06:36.442 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-05-08T20:06:36.443 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-05-08T20:06:36.444 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-05-08T20:06:36.444 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/ 2024-05-08T20:06:36.446 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-05-08T20:06:36.447 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-05-08T20:06:36.447 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-05-08T20:06:36.448 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-05-08T20:06:36.449 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-05-08T20:06:36.450 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-05-08T20:06:36.451 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-05-08T20:06:36.452 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-05-08T20:06:36.453 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-05-08T20:06:36.454 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-05-08T20:06:36.455 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-05-08T20:06:36.455 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gcov.txt 2024-05-08T20:06:36.456 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-05-08T20:06:36.457 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/ 2024-05-08T20:06:36.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-05-08T20:06:36.459 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-05-08T20:06:36.461 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-05-08T20:06:36.461 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-05-08T20:06:36.462 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-05-08T20:06:36.463 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-05-08T20:06:36.463 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-05-08T20:06:36.464 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hid/ 2024-05-08T20:06:36.465 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-05-08T20:06:36.466 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-05-08T20:06:36.467 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-05-08T20:06:36.468 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-05-08T20:06:36.469 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-05-08T20:06:36.470 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/highuid.txt 2024-05-08T20:06:36.471 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hsi.txt 2024-05-08T20:06:36.472 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-05-08T20:06:36.473 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ 2024-05-08T20:06:36.474 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-05-08T20:06:36.475 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-05-08T20:06:36.476 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-05-08T20:06:36.477 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-05-08T20:06:36.477 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-05-08T20:06:36.478 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-05-08T20:06:36.479 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-05-08T20:06:36.480 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-05-08T20:06:36.481 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-05-08T20:06:36.482 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-05-08T20:06:36.483 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-05-08T20:06:36.484 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-05-08T20:06:36.485 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-05-08T20:06:36.486 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-05-08T20:06:36.487 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-05-08T20:06:36.487 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-05-08T20:06:36.488 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-05-08T20:06:36.489 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-05-08T20:06:36.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-05-08T20:06:36.491 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-05-08T20:06:36.492 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-05-08T20:06:36.493 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-05-08T20:06:36.494 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-05-08T20:06:36.494 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-05-08T20:06:36.495 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-05-08T20:06:36.496 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-05-08T20:06:36.497 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-05-08T20:06:36.498 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-05-08T20:06:36.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-05-08T20:06:36.500 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-05-08T20:06:36.501 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-05-08T20:06:36.501 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-05-08T20:06:36.502 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-05-08T20:06:36.503 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-05-08T20:06:36.504 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-05-08T20:06:36.505 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-05-08T20:06:36.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-05-08T20:06:36.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-05-08T20:06:36.507 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-05-08T20:06:36.508 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-05-08T20:06:36.509 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-05-08T20:06:36.510 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-05-08T20:06:36.511 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-05-08T20:06:36.512 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-05-08T20:06:36.512 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-05-08T20:06:36.513 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-05-08T20:06:36.514 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-05-08T20:06:36.515 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-05-08T20:06:36.516 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-05-08T20:06:36.517 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-05-08T20:06:36.518 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-05-08T20:06:36.519 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-05-08T20:06:36.519 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-05-08T20:06:36.520 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-05-08T20:06:36.521 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-05-08T20:06:36.522 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-05-08T20:06:36.523 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-05-08T20:06:36.524 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-05-08T20:06:36.525 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-05-08T20:06:36.526 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-05-08T20:06:36.526 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-05-08T20:06:36.527 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-05-08T20:06:36.528 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-05-08T20:06:36.529 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-05-08T20:06:36.530 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-05-08T20:06:36.531 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-05-08T20:06:36.531 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-05-08T20:06:36.532 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-05-08T20:06:36.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-05-08T20:06:36.534 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-05-08T20:06:36.535 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-05-08T20:06:36.536 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-05-08T20:06:36.537 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-05-08T20:06:36.538 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-05-08T20:06:36.538 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-05-08T20:06:36.539 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-05-08T20:06:36.540 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-05-08T20:06:36.541 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-05-08T20:06:36.542 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-05-08T20:06:36.543 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-05-08T20:06:36.544 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-05-08T20:06:36.545 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-05-08T20:06:36.545 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-05-08T20:06:36.546 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-05-08T20:06:36.548 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-05-08T20:06:36.548 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-05-08T20:06:36.548 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-05-08T20:06:36.549 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-05-08T20:06:36.550 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-05-08T20:06:36.551 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-05-08T20:06:36.552 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-05-08T20:06:36.553 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-05-08T20:06:36.554 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-05-08T20:06:36.555 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-05-08T20:06:36.556 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-05-08T20:06:36.557 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-05-08T20:06:36.558 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-05-08T20:06:36.558 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-05-08T20:06:36.559 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-05-08T20:06:36.560 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-05-08T20:06:36.561 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-05-08T20:06:36.562 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-05-08T20:06:36.563 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-05-08T20:06:36.564 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-05-08T20:06:36.564 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-05-08T20:06:36.565 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-05-08T20:06:36.566 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-05-08T20:06:36.567 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-05-08T20:06:36.568 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-05-08T20:06:36.568 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-05-08T20:06:36.569 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-05-08T20:06:36.570 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-05-08T20:06:36.571 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-05-08T20:06:36.572 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-05-08T20:06:36.573 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-05-08T20:06:36.574 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-05-08T20:06:36.574 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-05-08T20:06:36.575 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-05-08T20:06:36.576 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-05-08T20:06:36.577 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-05-08T20:06:36.578 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-05-08T20:06:36.579 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-05-08T20:06:36.580 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-05-08T20:06:36.581 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-05-08T20:06:36.581 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-05-08T20:06:36.582 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-05-08T20:06:36.583 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-05-08T20:06:36.583 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-05-08T20:06:36.584 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-05-08T20:06:36.585 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-05-08T20:06:36.586 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-05-08T20:06:36.586 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-05-08T20:06:36.587 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-05-08T20:06:36.588 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-05-08T20:06:36.589 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-05-08T20:06:36.590 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-05-08T20:06:36.591 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-05-08T20:06:36.592 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/ 2024-05-08T20:06:36.593 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-05-08T20:06:36.594 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-05-08T20:06:36.595 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-05-08T20:06:36.596 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-05-08T20:06:36.596 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-05-08T20:06:36.597 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-05-08T20:06:36.598 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-05-08T20:06:36.599 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-05-08T20:06:36.599 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-05-08T20:06:36.600 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-05-08T20:06:36.601 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-05-08T20:06:36.601 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-05-08T20:06:36.602 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-05-08T20:06:36.603 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-05-08T20:06:36.603 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-05-08T20:06:36.604 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-05-08T20:06:36.605 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-05-08T20:06:36.606 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-05-08T20:06:36.607 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-05-08T20:06:36.607 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-05-08T20:06:36.608 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-05-08T20:06:36.609 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-05-08T20:06:36.609 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-05-08T20:06:36.611 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-05-08T20:06:36.611 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-05-08T20:06:36.612 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-05-08T20:06:36.613 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-05-08T20:06:36.614 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-05-08T20:06:36.615 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-05-08T20:06:36.616 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-05-08T20:06:36.617 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-05-08T20:06:36.617 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-05-08T20:06:36.618 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/summary 2024-05-08T20:06:36.619 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-05-08T20:06:36.620 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-05-08T20:06:36.621 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-05-08T20:06:36.621 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:36 smithi082 ceph-mon[46774]: pgmap v61: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 13 op/s 2024-05-08T20:06:36.622 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2o/ 2024-05-08T20:06:36.623 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2o/README 2024-05-08T20:06:36.624 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-05-08T20:06:36.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:36 smithi132 ceph-mon[47484]: pgmap v61: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 13 op/s 2024-05-08T20:06:36.625 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/ 2024-05-08T20:06:36.626 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-05-08T20:06:36.627 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-05-08T20:06:36.628 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-05-08T20:06:36.629 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/README 2024-05-08T20:06:36.630 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-05-08T20:06:36.630 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-05-08T20:06:36.631 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-05-08T20:06:36.632 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-05-08T20:06:36.633 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-05-08T20:06:36.634 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-05-08T20:06:36.635 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-05-08T20:06:36.636 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-05-08T20:06:36.636 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/ 2024-05-08T20:06:36.637 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-05-08T20:06:36.639 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-05-08T20:06:36.639 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-05-08T20:06:36.640 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-05-08T20:06:36.641 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-05-08T20:06:36.642 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-05-08T20:06:36.642 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-05-08T20:06:36.643 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/infiniband/ 2024-05-08T20:06:36.644 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-05-08T20:06:36.645 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-05-08T20:06:36.646 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-05-08T20:06:36.647 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-05-08T20:06:36.648 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-05-08T20:06:36.648 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/init.txt 2024-05-08T20:06:36.649 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/initrd.txt 2024-05-08T20:06:36.650 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/ 2024-05-08T20:06:36.651 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-05-08T20:06:36.652 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-05-08T20:06:36.653 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-05-08T20:06:36.654 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-05-08T20:06:36.655 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-05-08T20:06:36.656 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-05-08T20:06:36.656 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-05-08T20:06:36.657 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-05-08T20:06:36.658 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-05-08T20:06:36.659 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-05-08T20:06:36.659 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-05-08T20:06:36.660 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-05-08T20:06:36.661 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-05-08T20:06:36.661 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-05-08T20:06:36.662 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-05-08T20:06:36.663 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-05-08T20:06:36.663 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-05-08T20:06:36.665 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/input.txt 2024-05-08T20:06:36.665 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-05-08T20:06:36.666 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-05-08T20:06:36.666 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-05-08T20:06:36.667 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-05-08T20:06:36.668 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-05-08T20:06:36.669 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-05-08T20:06:36.670 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-05-08T20:06:36.671 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-05-08T20:06:36.671 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-05-08T20:06:36.672 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-05-08T20:06:36.673 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-05-08T20:06:36.674 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-05-08T20:06:36.674 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-05-08T20:06:36.675 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-05-08T20:06:36.676 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-05-08T20:06:36.677 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-05-08T20:06:36.678 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ioctl/ 2024-05-08T20:06:36.679 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-05-08T20:06:36.680 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-05-08T20:06:36.681 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-05-08T20:06:36.682 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-05-08T20:06:36.682 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-05-08T20:06:36.683 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-05-08T20:06:36.684 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/iostats.txt 2024-05-08T20:06:36.685 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-05-08T20:06:36.686 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-05-08T20:06:36.687 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/ 2024-05-08T20:06:36.688 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-05-08T20:06:36.689 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-05-08T20:06:36.690 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-05-08T20:06:36.691 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-05-08T20:06:36.692 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-05-08T20:06:36.693 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-05-08T20:06:36.694 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README 2024-05-08T20:06:36.695 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-05-08T20:06:36.696 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-05-08T20:06:36.697 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-05-08T20:06:36.698 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-05-08T20:06:36.699 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-05-08T20:06:36.701 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-05-08T20:06:36.702 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-05-08T20:06:36.703 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-05-08T20:06:36.704 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-05-08T20:06:36.705 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-05-08T20:06:36.707 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-05-08T20:06:36.708 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-05-08T20:06:36.709 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-05-08T20:06:36.710 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-05-08T20:06:36.711 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-05-08T20:06:36.712 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-05-08T20:06:36.713 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-05-08T20:06:36.714 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-05-08T20:06:36.715 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-05-08T20:06:36.717 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-05-08T20:06:36.719 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-05-08T20:06:36.720 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-05-08T20:06:36.721 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-05-08T20:06:36.722 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-05-08T20:06:36.723 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/java.txt 2024-05-08T20:06:36.725 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kasan.txt 2024-05-08T20:06:36.726 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/ 2024-05-08T20:06:36.728 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-05-08T20:06:36.729 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-05-08T20:06:36.730 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-05-08T20:06:36.731 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-05-08T20:06:36.732 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-05-08T20:06:36.733 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-05-08T20:06:36.735 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-05-08T20:06:36.736 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kdump/ 2024-05-08T20:06:36.737 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-05-08T20:06:36.739 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-05-08T20:06:36.740 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-05-08T20:06:36.741 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-05-08T20:06:36.742 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-05-08T20:06:36.745 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-05-08T20:06:36.745 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-05-08T20:06:36.746 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-05-08T20:06:36.747 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-05-08T20:06:36.748 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-05-08T20:06:36.749 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-05-08T20:06:36.750 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kobject.txt 2024-05-08T20:06:36.751 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-05-08T20:06:36.752 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kref.txt 2024-05-08T20:06:36.752 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-05-08T20:06:36.753 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/ 2024-05-08T20:06:36.754 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-05-08T20:06:36.755 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-05-08T20:06:36.756 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-05-08T20:06:36.757 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-05-08T20:06:36.758 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-05-08T20:06:36.759 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-05-08T20:06:36.760 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-05-08T20:06:36.761 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-05-08T20:06:36.761 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-05-08T20:06:36.762 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-05-08T20:06:36.763 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-05-08T20:06:36.765 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-05-08T20:06:36.765 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ldm.txt 2024-05-08T20:06:36.766 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/ 2024-05-08T20:06:36.767 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-05-08T20:06:36.768 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-05-08T20:06:36.769 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-05-08T20:06:36.770 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-05-08T20:06:36.771 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-05-08T20:06:36.772 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-05-08T20:06:36.773 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-05-08T20:06:36.774 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-05-08T20:06:36.775 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-05-08T20:06:36.776 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-05-08T20:06:36.777 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-05-08T20:06:36.778 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-05-08T20:06:36.779 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/ 2024-05-08T20:06:36.780 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-05-08T20:06:36.781 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-05-08T20:06:36.782 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-05-08T20:06:36.783 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-05-08T20:06:36.784 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-05-08T20:06:36.785 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-05-08T20:06:36.786 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-05-08T20:06:36.787 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-05-08T20:06:36.788 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-05-08T20:06:36.789 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-05-08T20:06:36.790 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-05-08T20:06:36.791 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/logo.gif 2024-05-08T20:06:36.792 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/logo.txt 2024-05-08T20:06:36.793 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/lzo.txt 2024-05-08T20:06:36.794 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/m68k/ 2024-05-08T20:06:36.795 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-05-08T20:06:36.796 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-05-08T20:06:36.797 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-05-08T20:06:36.798 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-05-08T20:06:36.799 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-05-08T20:06:36.800 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/md.txt 2024-05-08T20:06:36.802 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-05-08T20:06:36.802 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-05-08T20:06:36.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:36 smithi033 ceph-mon[42490]: pgmap v61: 97 pgs: 97 active+clean; 80 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 13 op/s 2024-05-08T20:06:37.004 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-05-08T20:06:37.006 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-05-08T20:06:37.007 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-05-08T20:06:37.008 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/metag/ 2024-05-08T20:06:37.009 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-05-08T20:06:37.010 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-05-08T20:06:37.011 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/ 2024-05-08T20:06:37.012 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-05-08T20:06:37.013 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-05-08T20:06:37.014 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-05-08T20:06:37.015 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-05-08T20:06:37.016 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-05-08T20:06:37.017 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-05-08T20:06:37.017 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-05-08T20:06:37.018 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-05-08T20:06:37.018 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-05-08T20:06:37.019 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-05-08T20:06:37.020 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mips/ 2024-05-08T20:06:37.021 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-05-08T20:06:37.022 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-05-08T20:06:37.023 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-05-08T20:06:37.024 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-05-08T20:06:37.025 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-05-08T20:06:37.026 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-05-08T20:06:37.027 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-05-08T20:06:37.028 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-05-08T20:06:37.028 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-05-08T20:06:37.029 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-05-08T20:06:37.029 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-05-08T20:06:37.030 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-05-08T20:06:37.031 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-05-08T20:06:37.032 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-05-08T20:06:37.033 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-05-08T20:06:37.034 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-05-08T20:06:37.035 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-05-08T20:06:37.036 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-05-08T20:06:37.037 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-05-08T20:06:37.038 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-05-08T20:06:37.039 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-05-08T20:06:37.040 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mmc/ 2024-05-08T20:06:37.041 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-05-08T20:06:37.042 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-05-08T20:06:37.043 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-05-08T20:06:37.044 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-05-08T20:06:37.045 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mn10300/ 2024-05-08T20:06:37.046 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-05-08T20:06:37.047 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-05-08T20:06:37.048 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-05-08T20:06:37.049 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mono.txt 2024-05-08T20:06:37.050 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mtd/ 2024-05-08T20:06:37.051 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-05-08T20:06:37.052 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-05-08T20:06:37.053 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-05-08T20:06:37.054 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-05-08T20:06:37.055 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/namespaces/ 2024-05-08T20:06:37.056 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-05-08T20:06:37.057 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-05-08T20:06:37.058 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/netlabel/ 2024-05-08T20:06:37.059 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-05-08T20:06:37.060 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-05-08T20:06:37.061 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-05-08T20:06:37.062 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-05-08T20:06:37.063 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-05-08T20:06:37.064 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ 2024-05-08T20:06:37.065 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-05-08T20:06:37.066 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-05-08T20:06:37.067 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-05-08T20:06:37.068 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-05-08T20:06:37.069 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-05-08T20:06:37.069 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-05-08T20:06:37.070 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-05-08T20:06:37.071 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-05-08T20:06:37.072 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-05-08T20:06:37.073 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-05-08T20:06:37.074 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-05-08T20:06:37.084 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-05-08T20:06:37.085 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-05-08T20:06:37.085 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-05-08T20:06:37.085 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-05-08T20:06:37.086 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-05-08T20:06:37.087 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-05-08T20:06:37.088 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-05-08T20:06:37.089 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-05-08T20:06:37.090 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-05-08T20:06:37.090 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-05-08T20:06:37.091 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-05-08T20:06:37.092 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-05-08T20:06:37.093 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-05-08T20:06:37.093 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-05-08T20:06:37.094 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-05-08T20:06:37.095 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-05-08T20:06:37.096 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-05-08T20:06:37.097 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-05-08T20:06:37.098 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-05-08T20:06:37.099 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-05-08T20:06:37.100 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-05-08T20:06:37.101 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-05-08T20:06:37.102 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-05-08T20:06:37.103 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-05-08T20:06:37.104 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-05-08T20:06:37.105 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-05-08T20:06:37.106 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-05-08T20:06:37.106 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-05-08T20:06:37.107 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-05-08T20:06:37.108 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-05-08T20:06:37.109 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-05-08T20:06:37.110 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-05-08T20:06:37.111 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-05-08T20:06:37.112 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-05-08T20:06:37.113 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-05-08T20:06:37.113 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-05-08T20:06:37.114 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-05-08T20:06:37.115 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-05-08T20:06:37.116 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-05-08T20:06:37.117 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-05-08T20:06:37.118 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-05-08T20:06:37.119 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-05-08T20:06:37.119 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-05-08T20:06:37.120 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-05-08T20:06:37.121 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-05-08T20:06:37.122 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-05-08T20:06:37.123 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-05-08T20:06:37.123 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-05-08T20:06:37.125 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-05-08T20:06:37.125 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-05-08T20:06:37.126 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-05-08T20:06:37.127 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-05-08T20:06:37.128 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-05-08T20:06:37.129 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-05-08T20:06:37.130 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-05-08T20:06:37.131 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-05-08T20:06:37.132 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-05-08T20:06:37.133 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-05-08T20:06:37.134 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-05-08T20:06:37.136 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-05-08T20:06:37.136 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-05-08T20:06:37.137 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-05-08T20:06:37.138 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-05-08T20:06:37.139 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-05-08T20:06:37.140 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-05-08T20:06:37.141 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-05-08T20:06:37.142 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-05-08T20:06:37.143 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-05-08T20:06:37.144 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-05-08T20:06:37.145 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-05-08T20:06:37.146 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-05-08T20:06:37.147 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-05-08T20:06:37.148 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-05-08T20:06:37.149 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-05-08T20:06:37.150 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-05-08T20:06:37.151 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-05-08T20:06:37.152 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-05-08T20:06:37.152 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-05-08T20:06:37.153 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-05-08T20:06:37.154 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-05-08T20:06:37.155 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-05-08T20:06:37.156 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-05-08T20:06:37.157 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-05-08T20:06:37.158 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-05-08T20:06:37.159 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-05-08T20:06:37.160 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-05-08T20:06:37.161 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-05-08T20:06:37.162 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-05-08T20:06:37.163 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-05-08T20:06:37.164 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-05-08T20:06:37.164 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-05-08T20:06:37.165 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-05-08T20:06:37.166 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-05-08T20:06:37.167 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-05-08T20:06:37.168 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-05-08T20:06:37.169 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-05-08T20:06:37.170 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-05-08T20:06:37.171 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-05-08T20:06:37.172 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-05-08T20:06:37.173 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-05-08T20:06:37.174 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-05-08T20:06:37.175 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-05-08T20:06:37.175 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-05-08T20:06:37.176 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-05-08T20:06:37.177 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-05-08T20:06:37.178 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-05-08T20:06:37.179 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-05-08T20:06:37.180 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-05-08T20:06:37.181 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-05-08T20:06:37.182 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-05-08T20:06:37.183 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-05-08T20:06:37.184 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-05-08T20:06:37.185 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-05-08T20:06:37.186 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-05-08T20:06:37.187 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-05-08T20:06:37.188 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-05-08T20:06:37.189 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-05-08T20:06:37.190 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/nfc/ 2024-05-08T20:06:37.191 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-05-08T20:06:37.192 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-05-08T20:06:37.193 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/nios2/ 2024-05-08T20:06:37.194 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/nios2/README 2024-05-08T20:06:37.195 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-05-08T20:06:37.196 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/numastat.txt 2024-05-08T20:06:37.197 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-05-08T20:06:37.198 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/padata.txt 2024-05-08T20:06:37.199 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/parisc/ 2024-05-08T20:06:37.200 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-05-08T20:06:37.201 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-05-08T20:06:37.202 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/parisc/registers 2024-05-08T20:06:37.203 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-05-08T20:06:37.204 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/parport.txt 2024-05-08T20:06:37.205 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-05-08T20:06:37.206 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-05-08T20:06:37.207 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-05-08T20:06:37.208 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-05-08T20:06:37.209 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-05-08T20:06:37.210 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-05-08T20:06:37.211 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-05-08T20:06:37.212 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-05-08T20:06:37.213 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-05-08T20:06:37.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/phy.txt 2024-05-08T20:06:37.215 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/phy/ 2024-05-08T20:06:37.217 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-05-08T20:06:37.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-05-08T20:06:37.218 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-05-08T20:06:37.219 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/platform/ 2024-05-08T20:06:37.220 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-05-08T20:06:37.221 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pnp.txt 2024-05-08T20:06:37.222 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/ 2024-05-08T20:06:37.223 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-05-08T20:06:37.224 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-05-08T20:06:37.225 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-05-08T20:06:37.226 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-05-08T20:06:37.227 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-05-08T20:06:37.228 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-05-08T20:06:37.229 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-05-08T20:06:37.230 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-05-08T20:06:37.231 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-05-08T20:06:37.232 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-05-08T20:06:37.233 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-05-08T20:06:37.234 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-05-08T20:06:37.235 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-05-08T20:06:37.236 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-05-08T20:06:37.237 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-05-08T20:06:37.238 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-05-08T20:06:37.239 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-05-08T20:06:37.240 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-05-08T20:06:37.241 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-05-08T20:06:37.242 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-05-08T20:06:37.243 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-05-08T20:06:37.244 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-05-08T20:06:37.245 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-05-08T20:06:37.245 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/states.txt 2024-05-08T20:06:37.246 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-05-08T20:06:37.247 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-05-08T20:06:37.248 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-05-08T20:06:37.249 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-05-08T20:06:37.250 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-05-08T20:06:37.251 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-05-08T20:06:37.252 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-05-08T20:06:37.253 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/power/video.txt 2024-05-08T20:06:37.254 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/ 2024-05-08T20:06:37.255 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-05-08T20:06:37.256 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-05-08T20:06:37.257 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-05-08T20:06:37.258 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-05-08T20:06:37.259 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-05-08T20:06:37.260 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-05-08T20:06:37.261 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-05-08T20:06:37.262 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-05-08T20:06:37.263 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-05-08T20:06:37.264 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-05-08T20:06:37.265 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-05-08T20:06:37.266 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-05-08T20:06:37.267 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-05-08T20:06:37.268 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pps/ 2024-05-08T20:06:37.269 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-05-08T20:06:37.270 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/ 2024-05-08T20:06:37.271 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-05-08T20:06:37.273 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-05-08T20:06:37.274 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-05-08T20:06:37.275 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-05-08T20:06:37.276 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-05-08T20:06:37.277 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-05-08T20:06:37.278 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-05-08T20:06:37.279 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-05-08T20:06:37.281 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-05-08T20:06:37.282 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pti/ 2024-05-08T20:06:37.283 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-05-08T20:06:37.285 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ptp/ 2024-05-08T20:06:37.286 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-05-08T20:06:37.288 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-05-08T20:06:37.289 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-05-08T20:06:37.290 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-05-08T20:06:37.291 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-05-08T20:06:37.293 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/pwm.txt 2024-05-08T20:06:37.294 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-05-08T20:06:37.295 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rapidio/ 2024-05-08T20:06:37.296 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-05-08T20:06:37.298 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-05-08T20:06:37.299 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-05-08T20:06:37.300 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-05-08T20:06:37.301 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-05-08T20:06:37.303 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-05-08T20:06:37.304 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-05-08T20:06:37.305 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-05-08T20:06:37.306 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-05-08T20:06:37.308 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/rtc.txt 2024-05-08T20:06:37.309 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/ 2024-05-08T20:06:37.311 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-05-08T20:06:37.312 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-05-08T20:06:37.313 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-05-08T20:06:37.314 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-05-08T20:06:37.315 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/DASD 2024-05-08T20:06:37.316 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-05-08T20:06:37.318 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-05-08T20:06:37.319 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-05-08T20:06:37.320 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-05-08T20:06:37.321 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-05-08T20:06:37.322 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-05-08T20:06:37.324 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-05-08T20:06:37.325 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-05-08T20:06:37.326 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-05-08T20:06:37.327 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/ 2024-05-08T20:06:37.328 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-05-08T20:06:37.330 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-05-08T20:06:37.331 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-05-08T20:06:37.332 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-05-08T20:06:37.333 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-05-08T20:06:37.334 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-05-08T20:06:37.335 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-05-08T20:06:37.336 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-05-08T20:06:37.337 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-05-08T20:06:37.338 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-05-08T20:06:37.339 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ 2024-05-08T20:06:37.341 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-05-08T20:06:37.342 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-05-08T20:06:37.343 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-05-08T20:06:37.344 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-05-08T20:06:37.345 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-05-08T20:06:37.346 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-05-08T20:06:37.347 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-05-08T20:06:37.349 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-05-08T20:06:37.350 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-05-08T20:06:37.351 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-05-08T20:06:37.352 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-05-08T20:06:37.354 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-05-08T20:06:37.354 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-05-08T20:06:37.355 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-05-08T20:06:37.356 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-05-08T20:06:37.357 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-05-08T20:06:37.358 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-05-08T20:06:37.359 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-05-08T20:06:37.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-05-08T20:06:37.360 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-05-08T20:06:37.361 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-05-08T20:06:37.362 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-05-08T20:06:37.363 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-05-08T20:06:37.364 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-05-08T20:06:37.365 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-05-08T20:06:37.366 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-05-08T20:06:37.367 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-05-08T20:06:37.368 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-05-08T20:06:37.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-05-08T20:06:37.369 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-05-08T20:06:37.370 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-05-08T20:06:37.371 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-05-08T20:06:37.372 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-05-08T20:06:37.373 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-05-08T20:06:37.374 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-05-08T20:06:37.375 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-05-08T20:06:37.376 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-05-08T20:06:37.377 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-05-08T20:06:37.378 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-05-08T20:06:37.379 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-05-08T20:06:37.380 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-05-08T20:06:37.381 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-05-08T20:06:37.382 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-05-08T20:06:37.383 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-05-08T20:06:37.384 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-05-08T20:06:37.385 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-05-08T20:06:37.386 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-05-08T20:06:37.387 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-05-08T20:06:37.388 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-05-08T20:06:37.389 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-05-08T20:06:37.390 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-05-08T20:06:37.391 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-05-08T20:06:37.392 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-05-08T20:06:37.393 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-05-08T20:06:37.394 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-05-08T20:06:37.395 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-05-08T20:06:37.396 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-05-08T20:06:37.397 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-05-08T20:06:37.398 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-05-08T20:06:37.398 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/ 2024-05-08T20:06:37.399 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-05-08T20:06:37.400 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-05-08T20:06:37.401 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-05-08T20:06:37.402 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-05-08T20:06:37.403 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-05-08T20:06:37.404 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-05-08T20:06:37.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-05-08T20:06:37.405 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-05-08T20:06:37.406 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-05-08T20:06:37.407 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-05-08T20:06:37.408 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-05-08T20:06:37.409 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-05-08T20:06:37.410 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-05-08T20:06:37.411 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-05-08T20:06:37.412 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/ 2024-05-08T20:06:37.413 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-05-08T20:06:37.414 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-05-08T20:06:37.415 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/driver 2024-05-08T20:06:37.416 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-05-08T20:06:37.417 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-05-08T20:06:37.418 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-05-08T20:06:37.419 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-05-08T20:06:37.420 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-05-08T20:06:37.421 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-05-08T20:06:37.422 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sh/ 2024-05-08T20:06:37.423 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-05-08T20:06:37.424 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-05-08T20:06:37.425 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-05-08T20:06:37.426 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/ 2024-05-08T20:06:37.427 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-05-08T20:06:37.428 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-05-08T20:06:37.430 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-05-08T20:06:37.430 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-05-08T20:06:37.431 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-05-08T20:06:37.432 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-05-08T20:06:37.433 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-05-08T20:06:37.434 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-05-08T20:06:37.434 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-05-08T20:06:37.435 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-05-08T20:06:37.436 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-05-08T20:06:37.437 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-05-08T20:06:37.438 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-05-08T20:06:37.439 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-05-08T20:06:37.439 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-05-08T20:06:37.440 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-05-08T20:06:37.441 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-05-08T20:06:37.442 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-05-08T20:06:37.443 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-05-08T20:06:37.443 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-05-08T20:06:37.444 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-05-08T20:06:37.445 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-05-08T20:06:37.446 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-05-08T20:06:37.446 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-05-08T20:06:37.447 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-05-08T20:06:37.448 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-05-08T20:06:37.449 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-05-08T20:06:37.450 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-05-08T20:06:37.451 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-05-08T20:06:37.452 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-05-08T20:06:37.453 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-05-08T20:06:37.454 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-05-08T20:06:37.454 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-05-08T20:06:37.455 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-05-08T20:06:37.456 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-05-08T20:06:37.457 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-05-08T20:06:37.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-05-08T20:06:37.458 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-05-08T20:06:37.459 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-05-08T20:06:37.460 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-05-08T20:06:37.461 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-05-08T20:06:37.462 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-05-08T20:06:37.463 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-05-08T20:06:37.463 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-05-08T20:06:37.464 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-05-08T20:06:37.465 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-05-08T20:06:37.466 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-05-08T20:06:37.467 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-05-08T20:06:37.467 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-05-08T20:06:37.468 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-05-08T20:06:37.469 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-05-08T20:06:37.470 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-05-08T20:06:37.471 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-05-08T20:06:37.472 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-05-08T20:06:37.473 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-05-08T20:06:37.474 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-05-08T20:06:37.474 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-05-08T20:06:37.475 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-05-08T20:06:37.476 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-05-08T20:06:37.477 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-05-08T20:06:37.478 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-05-08T20:06:37.479 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-05-08T20:06:37.479 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sparse.txt 2024-05-08T20:06:37.480 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/ 2024-05-08T20:06:37.481 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-05-08T20:06:37.482 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-05-08T20:06:37.483 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-05-08T20:06:37.484 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-05-08T20:06:37.485 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-05-08T20:06:37.486 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-05-08T20:06:37.489 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-05-08T20:06:37.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-05-08T20:06:37.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-05-08T20:06:37.490 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/spidev 2024-05-08T20:06:37.492 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-05-08T20:06:37.493 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-05-08T20:06:37.494 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-05-08T20:06:37.496 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-05-08T20:06:37.497 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-05-08T20:06:37.498 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/svga.txt 2024-05-08T20:06:37.499 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/ 2024-05-08T20:06:37.501 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-05-08T20:06:37.503 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/README 2024-05-08T20:06:37.504 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-05-08T20:06:37.505 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-05-08T20:06:37.506 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-05-08T20:06:37.507 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-05-08T20:06:37.508 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-05-08T20:06:37.509 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-05-08T20:06:37.510 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-05-08T20:06:37.512 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-05-08T20:06:37.513 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/target/ 2024-05-08T20:06:37.515 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-05-08T20:06:37.516 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-05-08T20:06:37.517 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-05-08T20:06:37.518 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/ 2024-05-08T20:06:37.520 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-05-08T20:06:37.521 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-05-08T20:06:37.522 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-05-08T20:06:37.524 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-05-08T20:06:37.525 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-05-08T20:06:37.526 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-05-08T20:06:37.527 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-05-08T20:06:37.528 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-05-08T20:06:37.529 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/ 2024-05-08T20:06:37.531 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-05-08T20:06:37.532 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-05-08T20:06:37.533 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-05-08T20:06:37.534 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-05-08T20:06:37.535 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-05-08T20:06:37.537 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-05-08T20:06:37.538 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-05-08T20:06:37.539 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-05-08T20:06:37.540 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-05-08T20:06:37.541 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-05-08T20:06:37.542 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-05-08T20:06:37.543 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/tpm/ 2024-05-08T20:06:37.544 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-05-08T20:06:37.546 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/ 2024-05-08T20:06:37.548 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-05-08T20:06:37.549 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-05-08T20:06:37.550 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-05-08T20:06:37.551 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-05-08T20:06:37.552 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-05-08T20:06:37.553 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-05-08T20:06:37.554 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-05-08T20:06:37.556 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-05-08T20:06:37.557 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-05-08T20:06:37.558 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-05-08T20:06:37.559 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-05-08T20:06:37.560 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-05-08T20:06:37.562 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-05-08T20:06:37.563 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-05-08T20:06:37.564 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-05-08T20:06:37.565 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-05-08T20:06:37.566 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-05-08T20:06:37.567 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-05-08T20:06:37.569 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/unicode.txt 2024-05-08T20:06:37.569 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/unshare.txt 2024-05-08T20:06:37.571 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/ 2024-05-08T20:06:37.572 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-05-08T20:06:37.574 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-05-08T20:06:37.575 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-05-08T20:06:37.576 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-05-08T20:06:37.577 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-05-08T20:06:37.578 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-05-08T20:06:37.579 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-05-08T20:06:37.580 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-05-08T20:06:37.581 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-05-08T20:06:37.582 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-05-08T20:06:37.583 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-05-08T20:06:37.585 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-05-08T20:06:37.586 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-05-08T20:06:37.587 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-05-08T20:06:37.588 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-05-08T20:06:37.589 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-05-08T20:06:37.590 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-05-08T20:06:37.591 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-05-08T20:06:37.592 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-05-08T20:06:37.593 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-05-08T20:06:37.594 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-05-08T20:06:37.595 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-05-08T20:06:37.596 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-05-08T20:06:37.597 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-05-08T20:06:37.598 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-05-08T20:06:37.599 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-05-08T20:06:37.599 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-05-08T20:06:37.600 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-05-08T20:06:37.601 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-05-08T20:06:37.602 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-05-08T20:06:37.603 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-05-08T20:06:37.604 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-05-08T20:06:37.605 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-05-08T20:06:37.606 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-05-08T20:06:37.607 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-05-08T20:06:37.609 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-05-08T20:06:37.610 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vDSO/ 2024-05-08T20:06:37.611 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-05-08T20:06:37.612 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-05-08T20:06:37.614 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-05-08T20:06:37.614 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-05-08T20:06:37.615 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-05-08T20:06:37.616 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vfio.txt 2024-05-08T20:06:37.617 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-05-08T20:06:37.618 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video-output.txt 2024-05-08T20:06:37.620 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/ 2024-05-08T20:06:37.621 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-05-08T20:06:37.622 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-05-08T20:06:37.623 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-05-08T20:06:37.624 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-05-08T20:06:37.625 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-05-08T20:06:37.626 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-05-08T20:06:37.627 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-05-08T20:06:37.628 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-05-08T20:06:37.629 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-05-08T20:06:37.630 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-05-08T20:06:37.631 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-05-08T20:06:37.632 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-05-08T20:06:37.633 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-05-08T20:06:37.634 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-05-08T20:06:37.635 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-05-08T20:06:37.636 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-05-08T20:06:37.637 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-05-08T20:06:37.638 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-05-08T20:06:37.639 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-05-08T20:06:37.640 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-05-08T20:06:37.641 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-05-08T20:06:37.642 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-05-08T20:06:37.643 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-05-08T20:06:37.644 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-05-08T20:06:37.645 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-05-08T20:06:37.647 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-05-08T20:06:37.647 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-05-08T20:06:37.649 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-05-08T20:06:37.650 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-05-08T20:06:37.651 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-05-08T20:06:37.652 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-05-08T20:06:37.653 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-05-08T20:06:37.654 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-05-08T20:06:37.655 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-05-08T20:06:37.656 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-05-08T20:06:37.657 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-05-08T20:06:37.658 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-05-08T20:06:37.659 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-05-08T20:06:37.660 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-05-08T20:06:37.661 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-05-08T20:06:37.662 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-05-08T20:06:37.663 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-05-08T20:06:37.664 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-05-08T20:06:37.665 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-05-08T20:06:37.666 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-05-08T20:06:37.668 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-05-08T20:06:37.668 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-05-08T20:06:37.669 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-05-08T20:06:37.670 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-05-08T20:06:37.671 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-05-08T20:06:37.672 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-05-08T20:06:37.673 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-05-08T20:06:37.674 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-05-08T20:06:37.675 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-05-08T20:06:37.676 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-05-08T20:06:37.677 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-05-08T20:06:37.679 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-05-08T20:06:37.679 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-05-08T20:06:37.680 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-05-08T20:06:37.681 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-05-08T20:06:37.682 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-05-08T20:06:37.683 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-05-08T20:06:37.684 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-05-08T20:06:37.685 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-05-08T20:06:37.686 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-05-08T20:06:37.687 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-05-08T20:06:37.688 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-05-08T20:06:37.689 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-05-08T20:06:37.690 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-05-08T20:06:37.691 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-05-08T20:06:37.694 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-05-08T20:06:37.694 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-05-08T20:06:37.694 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-05-08T20:06:37.695 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-05-08T20:06:37.696 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-05-08T20:06:37.697 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-05-08T20:06:37.698 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-05-08T20:06:37.700 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-05-08T20:06:37.700 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/ 2024-05-08T20:06:37.701 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-05-08T20:06:37.703 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-05-08T20:06:37.705 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-05-08T20:06:37.707 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-05-08T20:06:37.710 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-05-08T20:06:37.712 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-05-08T20:06:37.714 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-05-08T20:06:37.716 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-05-08T20:06:37.718 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-05-08T20:06:37.719 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-05-08T20:06:37.721 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-05-08T20:06:37.723 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-05-08T20:06:37.724 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-05-08T20:06:37.726 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-05-08T20:06:37.727 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-05-08T20:06:37.728 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-05-08T20:06:37.730 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-05-08T20:06:37.731 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-05-08T20:06:37.732 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-05-08T20:06:37.734 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-05-08T20:06:37.735 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-05-08T20:06:37.735 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-05-08T20:06:37.737 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-05-08T20:06:37.737 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-05-08T20:06:37.739 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-05-08T20:06:37.741 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/ 2024-05-08T20:06:37.742 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-05-08T20:06:37.743 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-05-08T20:06:37.745 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-05-08T20:06:37.746 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/balance 2024-05-08T20:06:37.747 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-05-08T20:06:37.748 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-05-08T20:06:37.748 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-05-08T20:06:37.749 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-05-08T20:06:37.750 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-05-08T20:06:37.751 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-05-08T20:06:37.752 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/numa 2024-05-08T20:06:37.753 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-05-08T20:06:37.754 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-05-08T20:06:37.755 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-05-08T20:06:37.757 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-05-08T20:06:37.758 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-05-08T20:06:37.758 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-05-08T20:06:37.759 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-05-08T20:06:37.760 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-05-08T20:06:37.761 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-05-08T20:06:37.762 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-05-08T20:06:37.763 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-05-08T20:06:37.764 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-05-08T20:06:37.765 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-05-08T20:06:37.766 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-05-08T20:06:37.767 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/ 2024-05-08T20:06:37.768 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-05-08T20:06:37.769 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-05-08T20:06:37.771 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-05-08T20:06:37.772 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-05-08T20:06:37.773 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-05-08T20:06:37.774 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-05-08T20:06:37.775 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-05-08T20:06:37.776 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-05-08T20:06:37.777 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-05-08T20:06:37.778 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-05-08T20:06:37.779 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-05-08T20:06:37.780 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-05-08T20:06:37.781 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-05-08T20:06:37.782 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-05-08T20:06:37.783 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-05-08T20:06:37.784 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-05-08T20:06:37.785 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/ 2024-05-08T20:06:37.786 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-05-08T20:06:37.787 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-05-08T20:06:37.789 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-05-08T20:06:37.790 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-05-08T20:06:37.791 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-05-08T20:06:37.792 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-05-08T20:06:37.793 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-05-08T20:06:37.795 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-05-08T20:06:37.796 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-05-08T20:06:37.797 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-05-08T20:06:37.798 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-05-08T20:06:37.799 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-05-08T20:06:37.800 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-05-08T20:06:37.801 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/wimax/ 2024-05-08T20:06:37.802 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-05-08T20:06:37.803 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-05-08T20:06:37.805 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-05-08T20:06:37.806 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/ 2024-05-08T20:06:37.807 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-05-08T20:06:37.809 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-05-08T20:06:37.811 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-05-08T20:06:37.812 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-05-08T20:06:37.813 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-05-08T20:06:37.814 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-05-08T20:06:37.815 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-05-08T20:06:37.816 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-05-08T20:06:37.817 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-05-08T20:06:37.818 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-05-08T20:06:37.819 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-05-08T20:06:37.820 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-05-08T20:06:37.821 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-05-08T20:06:37.822 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-05-08T20:06:37.823 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-05-08T20:06:37.824 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-05-08T20:06:37.825 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-05-08T20:06:37.826 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-05-08T20:06:37.827 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-05-08T20:06:37.828 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-05-08T20:06:37.829 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-05-08T20:06:37.830 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-05-08T20:06:37.831 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-05-08T20:06:37.832 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-05-08T20:06:37.834 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/xtensa/ 2024-05-08T20:06:37.835 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-05-08T20:06:37.836 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-05-08T20:06:37.838 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/xz.txt 2024-05-08T20:06:37.839 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-05-08T20:06:37.840 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-05-08T20:06:37.842 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-05-08T20:06:37.844 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-05-08T20:06:37.844 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-05-08T20:06:37.845 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-05-08T20:06:37.846 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-05-08T20:06:37.848 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-05-08T20:06:37.849 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-05-08T20:06:37.850 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-05-08T20:06:37.852 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-05-08T20:06:37.853 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-05-08T20:06:37.854 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-05-08T20:06:37.858 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-05-08T20:06:37.858 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-05-08T20:06:37.858 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-05-08T20:06:37.858 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-05-08T20:06:37.859 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-05-08T20:06:37.860 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-05-08T20:06:37.862 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-05-08T20:06:37.863 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-05-08T20:06:37.864 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-05-08T20:06:37.865 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-05-08T20:06:37.866 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-05-08T20:06:37.868 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-05-08T20:06:37.868 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-05-08T20:06:37.869 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-05-08T20:06:37.870 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-05-08T20:06:37.871 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-05-08T20:06:37.872 INFO:tasks.workunit.client.0.smithi033.stdout:linux-4.0.5/Documentation/zorro.txt 2024-05-08T20:06:38.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:38 smithi082 ceph-mon[46774]: pgmap v62: 97 pgs: 97 active+clean; 81 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 7.1 MiB/s wr, 477 op/s 2024-05-08T20:06:38.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:38 smithi132 ceph-mon[47484]: pgmap v62: 97 pgs: 97 active+clean; 81 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 7.1 MiB/s wr, 477 op/s 2024-05-08T20:06:38.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:38 smithi033 ceph-mon[42490]: pgmap v62: 97 pgs: 97 active+clean; 81 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 7.1 MiB/s wr, 477 op/s 2024-05-08T20:06:39.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:39 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:06:39.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:39 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:06:39.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:39 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:06:40.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:40 smithi082 ceph-mon[46774]: pgmap v63: 97 pgs: 97 active+clean; 81 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 604 KiB/s wr, 470 op/s 2024-05-08T20:06:40.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:40 smithi132 ceph-mon[47484]: pgmap v63: 97 pgs: 97 active+clean; 81 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 604 KiB/s wr, 470 op/s 2024-05-08T20:06:40.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:40 smithi033 ceph-mon[42490]: pgmap v63: 97 pgs: 97 active+clean; 81 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 604 KiB/s wr, 470 op/s 2024-05-08T20:06:42.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:42 smithi082 ceph-mon[46774]: pgmap v64: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 947 KiB/s wr, 482 op/s 2024-05-08T20:06:42.624 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:42 smithi132 ceph-mon[47484]: pgmap v64: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 947 KiB/s wr, 482 op/s 2024-05-08T20:06:42.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:42 smithi033 ceph-mon[42490]: pgmap v64: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 768 KiB/s rd, 947 KiB/s wr, 482 op/s 2024-05-08T20:06:44.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:44 smithi132 ceph-mon[47484]: pgmap v65: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 908 KiB/s wr, 477 op/s 2024-05-08T20:06:44.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:44 smithi033 ceph-mon[42490]: pgmap v65: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 908 KiB/s wr, 477 op/s 2024-05-08T20:06:44.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:44 smithi082 ceph-mon[46774]: pgmap v65: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 908 KiB/s wr, 477 op/s 2024-05-08T20:06:46.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:46 smithi033 ceph-mon[42490]: pgmap v66: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 907 KiB/s wr, 476 op/s 2024-05-08T20:06:46.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:46 smithi082 ceph-mon[46774]: pgmap v66: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 907 KiB/s wr, 476 op/s 2024-05-08T20:06:46.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:46 smithi132 ceph-mon[47484]: pgmap v66: 97 pgs: 97 active+clean; 85 MiB data, 598 MiB used, 1.0 TiB / 1.0 TiB avail; 736 KiB/s rd, 907 KiB/s wr, 476 op/s 2024-05-08T20:06:48.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:48 smithi033 ceph-mon[42490]: pgmap v67: 97 pgs: 97 active+clean; 88 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 513 op/s 2024-05-08T20:06:48.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:48 smithi082 ceph-mon[46774]: pgmap v67: 97 pgs: 97 active+clean; 88 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 513 op/s 2024-05-08T20:06:48.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:48 smithi132 ceph-mon[47484]: pgmap v67: 97 pgs: 97 active+clean; 88 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1010 KiB/s rd, 1.2 MiB/s wr, 513 op/s 2024-05-08T20:06:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.347+0000 7f343e1b0700 1 -- 172.21.15.33:0/3152826616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 msgr2=0x7f343810d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.347+0000 7f343e1b0700 1 --2- 172.21.15.33:0/3152826616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f343810d940 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f343000b0a0 tx=0x7f343000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 -- 172.21.15.33:0/3152826616 shutdown_connections 2024-05-08T20:06:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 --2- 172.21.15.33:0/3152826616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f343810d940 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 --2- 172.21.15.33:0/3152826616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34381020d0 0x7f34381024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 --2- 172.21.15.33:0/3152826616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381029f0 0x7f343810aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 -- 172.21.15.33:0/3152826616 >> 172.21.15.33:0/3152826616 conn(0x7f34380fb870 msgr2=0x7f34380fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 -- 172.21.15.33:0/3152826616 shutdown_connections 2024-05-08T20:06:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 -- 172.21.15.33:0/3152826616 wait complete. 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.348+0000 7f343e1b0700 1 Processor -- start 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f343e1b0700 1 -- start start 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f343e1b0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381020d0 0x7f34380ffd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f343e1b0700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34381029f0 0x7f3438100260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f343e1b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f34381007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f343e1b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34381a58d0 con 0x7f343810b4a0 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f343e1b0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34381a5a40 con 0x7f34381020d0 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f343e1b0700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34381a5c00 con 0x7f34381029f0 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f34381007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f34377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381020d0 0x7f34380ffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f34381007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48396/0 (socket says 172.21.15.33:48396) 2024-05-08T20:06:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f34377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381020d0 0x7f34380ffd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:42974/0 (socket says 172.21.15.33:42974) 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 -- 172.21.15.33:0/1446709215 learned_addr learned my addr 172.21.15.33:0/1446709215 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3436ffd700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34381029f0 0x7f3438100260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 -- 172.21.15.33:0/1446709215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34381029f0 msgr2=0x7f3438100260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34381029f0 0x7f3438100260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 -- 172.21.15.33:0/1446709215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381020d0 msgr2=0x7f34380ffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381020d0 0x7f34380ffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 -- 172.21.15.33:0/1446709215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009d00 con 0x7f343810b4a0 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f34377fe700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381020d0 0x7f34380ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.349+0000 7f3437fff700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f34381007a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f343000b070 tx=0x7f3430004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.350+0000 7f3434ff9700 1 -- 172.21.15.33:0/1446709215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343000e040 con 0x7f343810b4a0 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.350+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34381a5e80 con 0x7f343810b4a0 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.350+0000 7f3434ff9700 1 -- 172.21.15.33:0/1446709215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f34300079d0 con 0x7f343810b4a0 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.350+0000 7f3434ff9700 1 -- 172.21.15.33:0/1446709215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300052a0 con 0x7f343810b4a0 2024-05-08T20:06:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.350+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34381a6360 con 0x7f343810b4a0 2024-05-08T20:06:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.353+0000 7f3434ff9700 1 -- 172.21.15.33:0/1446709215 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f343001d470 con 0x7f343810b4a0 2024-05-08T20:06:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.353+0000 7f3434ff9700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f34200a1290 0x7f34200a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f34377fe700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f34200a1290 0x7f34200a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f3434ff9700 1 -- 172.21.15.33:0/1446709215 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f34300ce1f0 con 0x7f343810b4a0 2024-05-08T20:06:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f34377fe700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f34200a1290 0x7f34200a3750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3428007fd0 tx=0x7f34280073d0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 Processor -- start 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 -- start start 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d3270 0x56159e0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0cd480 0x56159e0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e0240f0 con 0x56159e0cd480 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e021ab0 con 0x56159e0d2950 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.354+0000 7f344a36ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e01d3a0 con 0x56159e0d3270 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:42980/0 (socket says 172.21.15.33:42980) 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0cd480 0x56159e0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 -- 172.21.15.33:0/2019807731 learned_addr learned my addr 172.21.15.33:0/2019807731 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f3436ffd700 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d3270 0x56159e0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 -- 172.21.15.33:0/2019807731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d3270 msgr2=0x56159e0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d3270 0x56159e0ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 -- 172.21.15.33:0/2019807731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0cd480 msgr2=0x56159e0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0cd480 0x56159e0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 -- 172.21.15.33:0/2019807731 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56159de9e350 con 0x56159e0d2950 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f3436ffd700 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d3270 0x56159e0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f34377fe700 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d2d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3428004350 tx=0x7f3428013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f81e0189137f433 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f341dffb700 1 -- 172.21.15.33:0/2019807731 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428003900 con 0x56159e0d2950 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f341dffb700 1 -- 172.21.15.33:0/2019807731 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3428011440 con 0x56159e0d2950 2024-05-08T20:06:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.355+0000 7f341dffb700 1 -- 172.21.15.33:0/2019807731 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342801f690 con 0x56159e0d2950 2024-05-08T20:06:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 -- 172.21.15.33:0/2019807731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 msgr2=0x56159e0d2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d2d30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3428004350 tx=0x7f3428013000 comp rx=0 tx=0).stop 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 -- 172.21.15.33:0/2019807731 shutdown_connections 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0cd480 0x56159e0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d2d30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 --2- 172.21.15.33:0/2019807731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d3270 0x56159e0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 -- 172.21.15.33:0/2019807731 >> 172.21.15.33:0/2019807731 conn(0x56159e02b1b0 msgr2=0x56159e0c7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 -- 172.21.15.33:0/2019807731 shutdown_connections 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.356+0000 7f344a36ab80 1 -- 172.21.15.33:0/2019807731 wait complete. 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 -- start start 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 Processor -- start 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0cd480 0x56159e0d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159dfb9500 con 0x56159e0d3270 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159dfb91a0 con 0x56159e0d2950 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159dea0640 con 0x56159e0cd480 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f344a36ab80 10 client.0 _ll_register_callbacks cb 0x56159dfc2ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f3436ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48406/0 (socket says 172.21.15.33:48406) 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.357+0000 7f3437fff700 1 -- 172.21.15.33:0/3957948432 learned_addr learned my addr 172.21.15.33:0/3957948432 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f34377fe700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0cd480 0x56159e0d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3436ffd700 1 -- 172.21.15.33:0/3957948432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0cd480 msgr2=0x56159e0d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3436ffd700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0cd480 0x56159e0d9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3436ffd700 1 -- 172.21.15.33:0/3957948432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 msgr2=0x56159e0d6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3436ffd700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3436ffd700 1 -- 172.21.15.33:0/3957948432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3428004030 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f34377fe700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0cd480 0x56159e0d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3437fff700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3436ffd700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d6550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3438101400 tx=0x7f342c003f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e243503059817819 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3416ffd700 1 -- 172.21.15.33:0/3957948432 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c01b640 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3416ffd700 1 -- 172.21.15.33:0/3957948432 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f342c009e30 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56159df76210 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3416ffd700 1 -- 172.21.15.33:0/3957948432 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f342c01b7a0 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f344a36ab80 10 client.25391 fetch_fsmap learned FSMap version 27 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56159de4ab00 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.358+0000 7f3416ffd700 1 -- 172.21.15.33:0/3957948432 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f342c027080 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f3416ffd700 1 -- 172.21.15.33:0/3957948432 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f342c011b70 con 0x56159e0d2950 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f344a36ab80 10 client.25391 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T20:06:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f344a36ab80 10 client.25391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f344a36ab80 20 client.25391 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e0e6c70 0x56159e0e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f344a36ab80 4 client.25391 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:06:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56159e09c7b0 con 0x56159e0e6c70 2024-05-08T20:06:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f34377fe700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e0e6c70 0x56159e0e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f3416ffd700 10 client.25391 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.359+0000 7f34377fe700 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e0e6c70 0x56159e0e9090 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11b135ea4bd0e916 server_cookie=8c2a185e0ea5807d in_seq=0 out_seq=0 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f3416ffd700 1 -- 172.21.15.33:0/3957948432 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56159e09c7b0 con 0x56159e0e6c70 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f3416ffd700 10 client.25391 handle_command_reply: tid=0 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 client.25391 shutdown 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 msgr2=0x56159e0d6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d6550 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3438101400 tx=0x7f342c003f00 comp rx=0 tx=0).stop 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 shutdown_connections 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e0e6c70 0x56159e0e9090 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0cd480 0x56159e0d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3957948432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0d2950 0x56159e0d6550 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f3416ffd700 0 client.25391 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 >> 172.21.15.33:0/3957948432 conn(0x56159e02b1b0 msgr2=0x56159e0cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 shutdown_connections 2024-05-08T20:06:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 1 -- 172.21.15.33:0/3957948432 wait complete. 2024-05-08T20:06:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.362+0000 7f344a36ab80 20 client.25391 trim_cache size 0 max 16384 2024-05-08T20:06:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 Processor -- start 2024-05-08T20:06:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 -- start start 2024-05-08T20:06:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e0d0fd0 con 0x56159e0d3270 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e0d7b00 con 0x56159e0cd480 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f344a36ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e0c90f0 con 0x56159e0d2950 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48410/0 (socket says 172.21.15.33:48410) 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f3437fff700 1 -- 172.21.15.33:0/4039476911 learned_addr learned my addr 172.21.15.33:0/4039476911 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.379+0000 7f34377fe700 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f3437fff700 1 -- 172.21.15.33:0/4039476911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 msgr2=0x56159e0d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f3437fff700 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f3437fff700 1 -- 172.21.15.33:0/4039476911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 msgr2=0x56159e0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f3437fff700 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f3437fff700 1 -- 172.21.15.33:0/4039476911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56159dfe3500 con 0x56159e0d3270 2024-05-08T20:06:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f3437fff700 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d8d40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3430007b40 tx=0x7f34300099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba6fde952353632 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f341e7fc700 1 -- 172.21.15.33:0/4039476911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343009ac20 con 0x56159e0d3270 2024-05-08T20:06:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f341e7fc700 1 -- 172.21.15.33:0/4039476911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f343009b9c0 con 0x56159e0d3270 2024-05-08T20:06:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.380+0000 7f341e7fc700 1 -- 172.21.15.33:0/4039476911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343009b520 con 0x56159e0d3270 2024-05-08T20:06:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 -- 172.21.15.33:0/4039476911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 msgr2=0x56159e0d8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d8d40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3430007b40 tx=0x7f34300099e0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 -- 172.21.15.33:0/4039476911 shutdown_connections 2024-05-08T20:06:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0d8d40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 --2- 172.21.15.33:0/4039476911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 -- 172.21.15.33:0/4039476911 >> 172.21.15.33:0/4039476911 conn(0x56159e02b1b0 msgr2=0x56159e0d0380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 -- 172.21.15.33:0/4039476911 shutdown_connections 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 -- 172.21.15.33:0/4039476911 wait complete. 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.381+0000 7f344a36ab80 1 -- start start 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 1 Processor -- start 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0dbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0dc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e0de530 con 0x56159e0d3270 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e13c170 con 0x56159e0cd480 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x56159e13c2b0 con 0x56159e0d2950 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f344a36ab80 10 client.0 _ll_register_callbacks cb 0x56159dfc2ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:06:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0dbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f3437fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0dbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:43000/0 (socket says 172.21.15.33:43000) 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 -- 172.21.15.33:0/3845520419 learned_addr learned my addr 172.21.15.33:0/3845520419 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f3436ffd700 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0dc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 -- 172.21.15.33:0/3845520419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 msgr2=0x56159e0dc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0dc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 -- 172.21.15.33:0/3845520419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 msgr2=0x56159e0dc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0dc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f34377fe700 1 -- 172.21.15.33:0/3845520419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34381a6360 con 0x56159e0cd480 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.382+0000 7f3436ffd700 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0dc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f34377fe700 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0dbc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3428011de0 tx=0x7f3428011cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=165ceeaf0500e42d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f3416ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f3416ffd700 1 -- 172.21.15.33:0/3845520419 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3428010af0 con 0x56159e0cd480 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f3416ffd700 1 -- 172.21.15.33:0/3845520419 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f3428017070 con 0x56159e0cd480 2024-05-08T20:06:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3428011440 con 0x56159e0cd480 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f3416ffd700 1 -- 172.21.15.33:0/3845520419 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f342802f130 con 0x56159e0cd480 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f344a36ab80 10 client.25397 fetch_fsmap learned FSMap version 27 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56159dea2c70 con 0x56159e0cd480 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f3416ffd700 1 -- 172.21.15.33:0/3845520419 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3428011440 con 0x56159e0cd480 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f3416ffd700 1 -- 172.21.15.33:0/3845520419 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f342801d040 con 0x56159e0cd480 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f344a36ab80 10 client.25397 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.383+0000 7f344a36ab80 10 client.25397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.384+0000 7f344a36ab80 20 client.25397 populate_metadata read hostname 'smithi033' 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.384+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e13d920 0x56159e13fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.384+0000 7f344a36ab80 4 client.25397 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.384+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56159e015e60 con 0x56159e13d920 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.384+0000 7f3436ffd700 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e13d920 0x56159e13fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.384+0000 7f3416ffd700 10 client.25397 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:49.384+0000 7f3436ffd700 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e13d920 0x56159e13fd40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16289948ae2d027c server_cookie=3fab606299dd4a3a in_seq=0 out_seq=0 2024-05-08T20:06:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.568+0000 7f3416ffd700 1 -- 172.21.15.33:0/3845520419 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56159e015e60 con 0x56159e13d920 2024-05-08T20:06:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.568+0000 7f3416ffd700 10 client.25397 handle_command_reply: tid=0 2024-05-08T20:06:50.558 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.568+0000 7f344a36ab80 1 client.25397 shutdown 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.568+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 msgr2=0x56159e0dbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.568+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0dbc20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3428011de0 tx=0x7f3428011cb0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 shutdown_connections 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x56159e13d920 0x56159e13fd40 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x56159e0d3270 0x56159e0dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56159e0cd480 0x56159e0dbc20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f3416ffd700 0 client.25397 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 --2- 172.21.15.33:0/3845520419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x56159e0d2950 0x56159e0dc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 >> 172.21.15.33:0/3845520419 conn(0x56159e02b1b0 msgr2=0x56159e0d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 shutdown_connections 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 1 -- 172.21.15.33:0/3845520419 wait complete. 2024-05-08T20:06:50.559 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f344a36ab80 20 client.25397 trim_cache size 0 max 16384 2024-05-08T20:06:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:06:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:06:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:06:50.560 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f34200a1290 msgr2=0x7f34200a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f34200a1290 0x7f34200a3750 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3428007fd0 tx=0x7f34280073d0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 msgr2=0x7f34381007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f34381007a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f343000b070 tx=0x7f3430004c80 comp rx=0 tx=0).stop 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 shutdown_connections 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f34200a1290 0x7f34200a3750 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343810b4a0 0x7f34381007a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f34381020d0 0x7f34380ffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 --2- 172.21.15.33:0/1446709215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34381029f0 0x7f3438100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.569+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 >> 172.21.15.33:0/1446709215 conn(0x7f34380fb870 msgr2=0x7f34380fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:06:50.561 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.570+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 shutdown_connections 2024-05-08T20:06:50.562 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:06:50.570+0000 7f343e1b0700 1 -- 172.21.15.33:0/1446709215 wait complete. 2024-05-08T20:06:50.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:50 smithi033 ceph-mon[42490]: pgmap v68: 97 pgs: 97 active+clean; 88 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 658 KiB/s wr, 48 op/s 2024-05-08T20:06:50.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:50 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:06:50.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:50 smithi082 ceph-mon[46774]: pgmap v68: 97 pgs: 97 active+clean; 88 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 658 KiB/s wr, 48 op/s 2024-05-08T20:06:50.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:50 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:06:50.874 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:50 smithi132 ceph-mon[47484]: pgmap v68: 97 pgs: 97 active+clean; 88 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 606 KiB/s rd, 658 KiB/s wr, 48 op/s 2024-05-08T20:06:50.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:50 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:06:51.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:51 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:06:51.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:51 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:06:51.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:51 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:06:51.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:51 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:06:51.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:51 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:06:51.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:51 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:06:51.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:51 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:06:51.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:51 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:06:51.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:51 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:06:52.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:52 smithi033 ceph-mon[42490]: pgmap v69: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 845 op/s 2024-05-08T20:06:52.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:52 smithi082 ceph-mon[46774]: pgmap v69: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 845 op/s 2024-05-08T20:06:52.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:52 smithi132 ceph-mon[47484]: pgmap v69: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 845 op/s 2024-05-08T20:06:54.821 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:54 smithi033 ceph-mon[42490]: pgmap v70: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-05-08T20:06:54.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:54 smithi082 ceph-mon[46774]: pgmap v70: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-05-08T20:06:54.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:54 smithi132 ceph-mon[47484]: pgmap v70: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-05-08T20:06:55.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:55 smithi033 ceph-mon[42490]: pgmap v71: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-05-08T20:06:55.872 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:55 smithi082 ceph-mon[46774]: pgmap v71: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-05-08T20:06:55.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:55 smithi132 ceph-mon[47484]: pgmap v71: 97 pgs: 97 active+clean; 85 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 925 KiB/s rd, 1.3 MiB/s wr, 833 op/s 2024-05-08T20:06:58.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:06:58 smithi033 ceph-mon[42490]: pgmap v72: 97 pgs: 97 active+clean; 137 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 1.17k op/s 2024-05-08T20:06:58.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:06:58 smithi082 ceph-mon[46774]: pgmap v72: 97 pgs: 97 active+clean; 137 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 1.17k op/s 2024-05-08T20:06:58.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:06:58 smithi132 ceph-mon[47484]: pgmap v72: 97 pgs: 97 active+clean; 137 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 1.17k op/s 2024-05-08T20:07:00.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:00 smithi082 ceph-mon[46774]: pgmap v73: 97 pgs: 97 active+clean; 137 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.6 MiB/s wr, 1.13k op/s 2024-05-08T20:07:00.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:00 smithi132 ceph-mon[47484]: pgmap v73: 97 pgs: 97 active+clean; 137 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.6 MiB/s wr, 1.13k op/s 2024-05-08T20:07:00.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:00 smithi033 ceph-mon[42490]: pgmap v73: 97 pgs: 97 active+clean; 137 MiB data, 749 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.6 MiB/s wr, 1.13k op/s 2024-05-08T20:07:02.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:02 smithi082 ceph-mon[46774]: pgmap v74: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.6 MiB/s wr, 1.60k op/s 2024-05-08T20:07:02.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:02 smithi132 ceph-mon[47484]: pgmap v74: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.6 MiB/s wr, 1.60k op/s 2024-05-08T20:07:02.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:02 smithi033 ceph-mon[42490]: pgmap v74: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 7.6 MiB/s wr, 1.60k op/s 2024-05-08T20:07:03.690 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 -- 172.21.15.33:0/3472897814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4924068ca0 msgr2=0x7f492410dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 --2- 172.21.15.33:0/3472897814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4924068ca0 0x7f492410dca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b0a0 tx=0x7f491c00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 -- 172.21.15.33:0/3472897814 shutdown_connections 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 --2- 172.21.15.33:0/3472897814 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4924068ca0 0x7f492410dca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 --2- 172.21.15.33:0/3472897814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4924107000 0x7f49241073e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 --2- 172.21.15.33:0/3472897814 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49240682e0 0x7f4924068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 -- 172.21.15.33:0/3472897814 >> 172.21.15.33:0/3472897814 conn(0x7f4924076f10 msgr2=0x7f4924077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 -- 172.21.15.33:0/3472897814 shutdown_connections 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.697+0000 7f492a6e8700 1 -- 172.21.15.33:0/3472897814 wait complete. 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.698+0000 7f492a6e8700 1 Processor -- start 2024-05-08T20:07:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.698+0000 7f492a6e8700 1 -- start start 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f492a6e8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240682e0 0x7f49240ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f492a6e8700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4924068ca0 0x7f4924100350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f492a6e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4924107000 0x7f4924100890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f492a6e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241a58b0 con 0x7f4924107000 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f492a6e8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241a5a20 con 0x7f49240682e0 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f492a6e8700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49241a5be0 con 0x7f4924068ca0 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240682e0 0x7f49240ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4928c85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4924107000 0x7f4924100890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240682e0 0x7f49240ffe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:52250/0 (socket says 172.21.15.33:52250) 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 -- 172.21.15.33:0/1402422789 learned_addr learned my addr 172.21.15.33:0/1402422789 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f49237fe700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4924068ca0 0x7f4924100350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 -- 172.21.15.33:0/1402422789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4924068ca0 msgr2=0x7f4924100350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4924068ca0 0x7f4924100350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 -- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4924107000 msgr2=0x7f4924100890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4924107000 0x7f4924100890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 -- 172.21.15.33:0/1402422789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c009d00 con 0x7f49240682e0 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f4923fff700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240682e0 0x7f49240ffe10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f491400d950 tx=0x7f491400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.699+0000 7f49217fa700 1 -- 172.21.15.33:0/1402422789 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400f890 con 0x7f49240682e0 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.700+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49241a5ec0 con 0x7f49240682e0 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.700+0000 7f49217fa700 1 -- 172.21.15.33:0/1402422789 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4914010460 con 0x7f49240682e0 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.700+0000 7f49217fa700 1 -- 172.21.15.33:0/1402422789 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400e610 con 0x7f49240682e0 2024-05-08T20:07:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.700+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49241a6340 con 0x7f49240682e0 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.702+0000 7f49217fa700 1 -- 172.21.15.33:0/1402422789 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4914010960 con 0x7f49240682e0 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.703+0000 7f49217fa700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f490c0a1290 0x7f490c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.703+0000 7f49237fe700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f490c0a1290 0x7f490c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.703+0000 7f49217fa700 1 -- 172.21.15.33:0/1402422789 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f49140ccad0 con 0x7f49240682e0 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.703+0000 7f49237fe700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f490c0a1290 0x7f490c0a3750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f49241014f0 tx=0x7f4918009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 Processor -- start 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 -- start start 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c85d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c7ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c808a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542bd70f0 con 0x558542c86270 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542bd4ab0 con 0x558542c85950 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49368a2b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542bd03a0 con 0x558542c80480 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c7ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f4923fff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c85d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c7ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48320/0 (socket says 172.21.15.33:48320) 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f49237fe700 1 -- 172.21.15.33:0/498705615 learned_addr learned my addr 172.21.15.33:0/498705615 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.704+0000 7f4928c85700 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f4923fff700 1 -- 172.21.15.33:0/498705615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 msgr2=0x558542c808a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f4923fff700 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c808a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f4923fff700 1 -- 172.21.15.33:0/498705615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 msgr2=0x558542c7ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f4923fff700 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c7ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f4923fff700 1 -- 172.21.15.33:0/498705615 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558542a51350 con 0x558542c85950 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f49237fe700 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c7ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f4928c85700 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f4923fff700 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c85d30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49140ca150 tx=0x7f4914099a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=638040b6643184ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f490a7fc700 1 -- 172.21.15.33:0/498705615 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491409d940 con 0x558542c85950 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f490a7fc700 1 -- 172.21.15.33:0/498705615 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f49140a1f90 con 0x558542c85950 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.705+0000 7f490a7fc700 1 -- 172.21.15.33:0/498705615 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914099240 con 0x558542c85950 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 -- 172.21.15.33:0/498705615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 msgr2=0x558542c85d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c85d30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49140ca150 tx=0x7f4914099a10 comp rx=0 tx=0).stop 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 -- 172.21.15.33:0/498705615 shutdown_connections 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c85d30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 --2- 172.21.15.33:0/498705615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c7ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 -- 172.21.15.33:0/498705615 >> 172.21.15.33:0/498705615 conn(0x558542bde1b0 msgr2=0x558542c7a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 -- 172.21.15.33:0/498705615 shutdown_connections 2024-05-08T20:07:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 -- 172.21.15.33:0/498705615 wait complete. 2024-05-08T20:07:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 -- start start 2024-05-08T20:07:03.700 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.706+0000 7f49368a2b80 1 Processor -- start 2024-05-08T20:07:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c8c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c895f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c89d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49368a2b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542b6c500 con 0x558542c85950 2024-05-08T20:07:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49368a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542b6c1a0 con 0x558542c86270 2024-05-08T20:07:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49368a2b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542a53640 con 0x558542c80480 2024-05-08T20:07:03.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49368a2b80 10 client.0 _ll_register_callbacks cb 0x558542b75ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c895f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c895f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48322/0 (socket says 172.21.15.33:48322) 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f4928c85700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c89d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 -- 172.21.15.33:0/2414889573 learned_addr learned my addr 172.21.15.33:0/2414889573 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f4923fff700 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c8c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 -- 172.21.15.33:0/2414889573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 msgr2=0x558542c8c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c8c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 -- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 msgr2=0x558542c89d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c89d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.707+0000 7f49237fe700 1 -- 172.21.15.33:0/2414889573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4918017070 con 0x558542c85950 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f4928c85700 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c89d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49237fe700 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c895f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f49180044f0 tx=0x7f49180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1a57663a572605 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:03.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49037fe700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49037fe700 1 -- 172.21.15.33:0/2414889573 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918022070 con 0x558542c85950 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49037fe700 1 -- 172.21.15.33:0/2414889573 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f4918004520 con 0x558542c85950 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558542b29210 con 0x558542c85950 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49037fe700 1 -- 172.21.15.33:0/2414889573 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f491801d620 con 0x558542c85950 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49368a2b80 10 client.15537 fetch_fsmap learned FSMap version 27 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f49241a6340 con 0x558542c85950 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49037fe700 1 -- 172.21.15.33:0/2414889573 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4918032020 con 0x558542c85950 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49037fe700 1 -- 172.21.15.33:0/2414889573 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f491802e7f0 con 0x558542c85950 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49368a2b80 10 client.15537 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.708+0000 7f49368a2b80 10 client.15537 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.709+0000 7f49368a2b80 20 client.15537 populate_metadata read hostname 'smithi033' 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.709+0000 7f49368a2b80 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542c99c50 0x558542c9c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.709+0000 7f49368a2b80 4 client.15537 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.709+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558542c4f7b0 con 0x558542c99c50 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.709+0000 7f4923fff700 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542c99c50 0x558542c9c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.709+0000 7f4923fff700 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542c99c50 0x558542c9c070 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2454aa29d3c123c server_cookie=b49fca07fa9544c7 in_seq=0 out_seq=0 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.709+0000 7f49037fe700 10 client.15537 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49037fe700 1 -- 172.21.15.33:0/2414889573 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558542c4f7b0 con 0x558542c99c50 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49037fe700 10 client.15537 handle_command_reply: tid=0 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 client.15537 shutdown 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 msgr2=0x558542c895f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c895f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f49180044f0 tx=0x7f49180047c0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 shutdown_connections 2024-05-08T20:07:03.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542c99c50 0x558542c9c070 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c89d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c8c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 --2- 172.21.15.33:0/2414889573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c895f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 >> 172.21.15.33:0/2414889573 conn(0x558542bde1b0 msgr2=0x558542c7ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49037fe700 0 client.15537 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 shutdown_connections 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 1 -- 172.21.15.33:0/2414889573 wait complete. 2024-05-08T20:07:03.708 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.711+0000 7f49368a2b80 20 client.15537 trim_cache size 0 max 16384 2024-05-08T20:07:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.727+0000 7f49368a2b80 1 Processor -- start 2024-05-08T20:07:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.727+0000 7f49368a2b80 1 -- start start 2024-05-08T20:07:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c89590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c89cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c7a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49368a2b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542ca1260 con 0x558542c85950 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49368a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542c84230 con 0x558542c86270 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49368a2b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542c80860 con 0x558542c80480 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c89cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c89cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:48332/0 (socket says 172.21.15.33:48332) 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 -- 172.21.15.33:0/3399153000 learned_addr learned my addr 172.21.15.33:0/3399153000 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f4928c85700 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c7a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f4923fff700 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c89590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 -- 172.21.15.33:0/3399153000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 msgr2=0x558542c89590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c89590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 -- 172.21.15.33:0/3399153000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 msgr2=0x558542c7a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c7a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 -- 172.21.15.33:0/3399153000 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585429fdb00 con 0x558542c85950 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.728+0000 7f49237fe700 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c89cd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4918000c00 tx=0x7f4918003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd141e2cf34595bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:03.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f490affd700 1 -- 172.21.15.33:0/3399153000 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918022070 con 0x558542c85950 2024-05-08T20:07:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f490affd700 1 -- 172.21.15.33:0/3399153000 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4918032070 con 0x558542c85950 2024-05-08T20:07:03.721 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f490affd700 1 -- 172.21.15.33:0/3399153000 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491801d9c0 con 0x558542c85950 2024-05-08T20:07:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 -- 172.21.15.33:0/3399153000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 msgr2=0x558542c89cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c89cd0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4918000c00 tx=0x7f4918003ee0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 -- 172.21.15.33:0/3399153000 shutdown_connections 2024-05-08T20:07:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c86270 0x558542c7a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c89590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.724 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3399153000 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c85950 0x558542c89cd0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 -- 172.21.15.33:0/3399153000 >> 172.21.15.33:0/3399153000 conn(0x558542bde1b0 msgr2=0x558542c88e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 -- 172.21.15.33:0/3399153000 shutdown_connections 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.729+0000 7f49368a2b80 1 -- 172.21.15.33:0/3399153000 wait complete. 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 -- start start 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 Processor -- start 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c90f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c8eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c8f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542c8f7c0 con 0x558542c86270 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542c8f930 con 0x558542c85950 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x558542cef150 con 0x558542c80480 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49368a2b80 10 client.0 _ll_register_callbacks cb 0x558542b75ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:07:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49237fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c8eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f4928c85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c8f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49237fe700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c8eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:52292/0 (socket says 172.21.15.33:52292) 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.730+0000 7f49237fe700 1 -- 172.21.15.33:0/3100011268 learned_addr learned my addr 172.21.15.33:0/3100011268 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f4923fff700 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c90f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49237fe700 1 -- 172.21.15.33:0/3100011268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 msgr2=0x558542c90f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49237fe700 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c90f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49237fe700 1 -- 172.21.15.33:0/3100011268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 msgr2=0x558542c8f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49237fe700 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c8f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49237fe700 1 -- 172.21.15.33:0/3100011268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49241a6340 con 0x558542c85950 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49237fe700 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c8eb90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f491802eb50 tx=0x7f4918014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c078c8dd71da63a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49037fe700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49037fe700 1 -- 172.21.15.33:0/3100011268 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918022070 con 0x558542c85950 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49037fe700 1 -- 172.21.15.33:0/3100011268 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f4918033080 con 0x558542c85950 2024-05-08T20:07:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49140a1f90 con 0x558542c85950 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49037fe700 1 -- 172.21.15.33:0/3100011268 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4918005260 con 0x558542c85950 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49368a2b80 10 client.25415 fetch_fsmap learned FSMap version 27 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.731+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558542b96500 con 0x558542c85950 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49037fe700 1 -- 172.21.15.33:0/3100011268 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f49140a1f90 con 0x558542c85950 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49037fe700 1 -- 172.21.15.33:0/3100011268 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 27) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f491801d6c0 con 0x558542c85950 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49368a2b80 10 client.25415 fetch_fsmap finished waiting for FSMap version 27 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49368a2b80 10 client.25415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49368a2b80 20 client.25415 populate_metadata read hostname 'smithi033' 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542cf03d0 0x558542cf27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49368a2b80 4 client.25415 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558542bc8e60 con 0x558542cf03d0 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f4923fff700 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542cf03d0 0x558542cf27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f4923fff700 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542cf03d0 0x558542cf27c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36cd6fc577951b1a server_cookie=2f1a398d09087d5f in_seq=0 out_seq=0 2024-05-08T20:07:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:03.732+0000 7f49037fe700 10 client.25415 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:04.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:04 smithi082 ceph-mon[46774]: pgmap v75: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 805 op/s 2024-05-08T20:07:04.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:04 smithi132 ceph-mon[47484]: pgmap v75: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 805 op/s 2024-05-08T20:07:04.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:04 smithi033 ceph-mon[42490]: pgmap v75: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 805 op/s 2024-05-08T20:07:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.018+0000 7f49037fe700 1 -- 172.21.15.33:0/3100011268 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558542bc8e60 con 0x558542cf03d0 2024-05-08T20:07:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.018+0000 7f49037fe700 10 client.25415 handle_command_reply: tid=0 2024-05-08T20:07:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.018+0000 7f49368a2b80 1 client.25415 shutdown 2024-05-08T20:07:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.018+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 msgr2=0x558542c8eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:06.009 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.018+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c8eb90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f491802eb50 tx=0x7f4918014000 comp rx=0 tx=0).stop 2024-05-08T20:07:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 shutdown_connections 2024-05-08T20:07:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x558542cf03d0 0x558542cf27c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x558542c86270 0x558542c8f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x558542c80480 0x558542c90f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 --2- 172.21.15.33:0/3100011268 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558542c85950 0x558542c8eb90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49037fe700 0 client.25415 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 >> 172.21.15.33:0/3100011268 conn(0x558542bde1b0 msgr2=0x558542c83380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 shutdown_connections 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.019+0000 7f49368a2b80 1 -- 172.21.15.33:0/3100011268 wait complete. 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f49368a2b80 20 client.25415 trim_cache size 0 max 16384 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:07:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:07:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f490c0a1290 msgr2=0x7f490c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f490c0a1290 0x7f490c0a3750 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f49241014f0 tx=0x7f4918009260 comp rx=0 tx=0).stop 2024-05-08T20:07:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240682e0 msgr2=0x7f49240ffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240682e0 0x7f49240ffe10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f491400d950 tx=0x7f491400dc60 comp rx=0 tx=0).stop 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 shutdown_connections 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f490c0a1290 0x7f490c0a3750 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4924107000 0x7f4924100890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f49240682e0 0x7f49240ffe10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 --2- 172.21.15.33:0/1402422789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4924068ca0 0x7f4924100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.020+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 >> 172.21.15.33:0/1402422789 conn(0x7f4924076f10 msgr2=0x7f49240feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.021+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 shutdown_connections 2024-05-08T20:07:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:06.021+0000 7f492a6e8700 1 -- 172.21.15.33:0/1402422789 wait complete. 2024-05-08T20:07:06.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:06 smithi082 ceph-mon[46774]: pgmap v76: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 805 op/s 2024-05-08T20:07:06.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:06 smithi132 ceph-mon[47484]: pgmap v76: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 805 op/s 2024-05-08T20:07:06.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:06 smithi033 ceph-mon[42490]: pgmap v76: 97 pgs: 97 active+clean; 146 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 6.6 MiB/s wr, 805 op/s 2024-05-08T20:07:08.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:08 smithi082 ceph-mon[46774]: pgmap v77: 97 pgs: 97 active+clean; 132 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 1.41k op/s 2024-05-08T20:07:08.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:08 smithi132 ceph-mon[47484]: pgmap v77: 97 pgs: 97 active+clean; 132 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 1.41k op/s 2024-05-08T20:07:08.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:08 smithi033 ceph-mon[42490]: pgmap v77: 97 pgs: 97 active+clean; 132 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.6 MiB/s wr, 1.41k op/s 2024-05-08T20:07:10.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:10 smithi082 ceph-mon[46774]: pgmap v78: 97 pgs: 97 active+clean; 132 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 1.08k op/s 2024-05-08T20:07:10.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:10 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:10.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:10 smithi132 ceph-mon[47484]: pgmap v78: 97 pgs: 97 active+clean; 132 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 1.08k op/s 2024-05-08T20:07:10.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:10 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:10.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:10 smithi033 ceph-mon[42490]: pgmap v78: 97 pgs: 97 active+clean; 132 MiB data, 842 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 1.08k op/s 2024-05-08T20:07:10.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:10 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:11.622 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:11 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:11.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:11 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:11.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:11 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:12.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:12 smithi082 ceph-mon[46774]: pgmap v79: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 1.16k op/s 2024-05-08T20:07:12.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:12 smithi132 ceph-mon[47484]: pgmap v79: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 1.16k op/s 2024-05-08T20:07:12.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:12 smithi033 ceph-mon[42490]: pgmap v79: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 4.8 MiB/s wr, 1.16k op/s 2024-05-08T20:07:14.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:14 smithi082 ceph-mon[46774]: pgmap v80: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 691 op/s 2024-05-08T20:07:14.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:14 smithi132 ceph-mon[47484]: pgmap v80: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 691 op/s 2024-05-08T20:07:14.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:14 smithi033 ceph-mon[42490]: pgmap v80: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 691 op/s 2024-05-08T20:07:16.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:16 smithi033 ceph-mon[42490]: pgmap v81: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 691 op/s 2024-05-08T20:07:16.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:16 smithi082 ceph-mon[46774]: pgmap v81: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 691 op/s 2024-05-08T20:07:16.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:16 smithi132 ceph-mon[47484]: pgmap v81: 97 pgs: 97 active+clean; 141 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.7 MiB/s wr, 691 op/s 2024-05-08T20:07:18.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:18 smithi033 ceph-mon[42490]: pgmap v82: 97 pgs: 97 active+clean; 152 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 851 op/s 2024-05-08T20:07:18.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:18 smithi082 ceph-mon[46774]: pgmap v82: 97 pgs: 97 active+clean; 152 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 851 op/s 2024-05-08T20:07:18.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:18 smithi132 ceph-mon[47484]: pgmap v82: 97 pgs: 97 active+clean; 152 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.6 MiB/s wr, 851 op/s 2024-05-08T20:07:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 -- 172.21.15.33:0/2708755600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e20107000 msgr2=0x7f4e201073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 --2- 172.21.15.33:0/2708755600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e20107000 0x7f4e201073e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009990 tx=0x7f4e1c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 -- 172.21.15.33:0/2708755600 shutdown_connections 2024-05-08T20:07:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 --2- 172.21.15.33:0/2708755600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e20068ca0 0x7f4e2010dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 --2- 172.21.15.33:0/2708755600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e20107000 0x7f4e201073e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 --2- 172.21.15.33:0/2708755600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e200682e0 0x7f4e20068760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 -- 172.21.15.33:0/2708755600 >> 172.21.15.33:0/2708755600 conn(0x7f4e20076f10 msgr2=0x7f4e20077320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 -- 172.21.15.33:0/2708755600 shutdown_connections 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.152+0000 7f4e27647700 1 -- 172.21.15.33:0/2708755600 wait complete. 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 Processor -- start 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 -- start start 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200682e0 0x7f4e201973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e20068ca0 0x7f4e20197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e20107000 0x7f4e2019bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2019c290 con 0x7f4e200682e0 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2019c400 con 0x7f4e20107000 2024-05-08T20:07:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e27647700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2019c5c0 con 0x7f4e20068ca0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e253e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200682e0 0x7f4e201973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e253e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200682e0 0x7f4e201973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60788/0 (socket says 172.21.15.33:60788) 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e253e3700 1 -- 172.21.15.33:0/2951479851 learned_addr learned my addr 172.21.15.33:0/2951479851 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e24be2700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e20068ca0 0x7f4e20197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e25be4700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e20107000 0x7f4e2019bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e253e3700 1 -- 172.21.15.33:0/2951479851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e20068ca0 msgr2=0x7f4e20197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e253e3700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e20068ca0 0x7f4e20197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e253e3700 1 -- 172.21.15.33:0/2951479851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e20107000 msgr2=0x7f4e2019bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.153+0000 7f4e253e3700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e20107000 0x7f4e2019bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.154+0000 7f4e253e3700 1 -- 172.21.15.33:0/2951479851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e1c0095f0 con 0x7f4e200682e0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.154+0000 7f4e253e3700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200682e0 0x7f4e201973c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c000c00 tx=0x7f4e1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.154+0000 7f4e167fc700 1 -- 172.21.15.33:0/2951479851 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c01d070 con 0x7f4e200682e0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.154+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e2019c840 con 0x7f4e200682e0 2024-05-08T20:07:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.154+0000 7f4e167fc700 1 -- 172.21.15.33:0/2951479851 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4e1c022470 con 0x7f4e200682e0 2024-05-08T20:07:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.154+0000 7f4e167fc700 1 -- 172.21.15.33:0/2951479851 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c017650 con 0x7f4e200682e0 2024-05-08T20:07:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.154+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e201a40e0 con 0x7f4e200682e0 2024-05-08T20:07:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.156+0000 7f4e167fc700 1 -- 172.21.15.33:0/2951479851 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f4e1c0225e0 con 0x7f4e200682e0 2024-05-08T20:07:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.157+0000 7f4e167fc700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4e0c0a1290 0x7f4e0c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.157+0000 7f4e167fc700 1 -- 172.21.15.33:0/2951479851 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f4e1c0ce100 con 0x7f4e200682e0 2024-05-08T20:07:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.157+0000 7f4e24be2700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4e0c0a1290 0x7f4e0c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e24be2700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4e0c0a1290 0x7f4e0c0a3750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4e201988c0 tx=0x7f4e1000b410 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 Processor -- start 2024-05-08T20:07:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 -- start start 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f248d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f242f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f2438a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f19a0f0 con 0x55ec1f249270 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f197ab0 con 0x55ec1f243480 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.158+0000 7f4e33801b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f1933a0 con 0x55ec1f248950 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e24be2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f242f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f2438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e24be2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f242f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60800/0 (socket says 172.21.15.33:60800) 2024-05-08T20:07:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f2438a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:42314/0 (socket says 172.21.15.33:42314) 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e24be2700 1 -- 172.21.15.33:0/2191321169 learned_addr learned my addr 172.21.15.33:0/2191321169 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e253e3700 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f248d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 -- 172.21.15.33:0/2191321169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 msgr2=0x55ec1f248d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f248d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 -- 172.21.15.33:0/2191321169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 msgr2=0x55ec1f242f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f242f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 -- 172.21.15.33:0/2191321169 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec1f014350 con 0x55ec1f243480 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e25be4700 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f2438a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011580 tx=0x7f4e18009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c553057285cc857e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e0b7fe700 1 -- 172.21.15.33:0/2191321169 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800e040 con 0x55ec1f243480 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e0b7fe700 1 -- 172.21.15.33:0/2191321169 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4e1800f040 con 0x55ec1f243480 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.159+0000 7f4e0b7fe700 1 -- 172.21.15.33:0/2191321169 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18004330 con 0x55ec1f243480 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 -- 172.21.15.33:0/2191321169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 msgr2=0x55ec1f2438a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f2438a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011580 tx=0x7f4e18009920 comp rx=0 tx=0).stop 2024-05-08T20:07:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 -- 172.21.15.33:0/2191321169 shutdown_connections 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f2438a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f248d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 --2- 172.21.15.33:0/2191321169 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f242f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 -- 172.21.15.33:0/2191321169 >> 172.21.15.33:0/2191321169 conn(0x55ec1f1a11b0 msgr2=0x55ec1f23d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 -- 172.21.15.33:0/2191321169 shutdown_connections 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.160+0000 7f4e33801b80 1 -- 172.21.15.33:0/2191321169 wait complete. 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 -- start start 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 Processor -- start 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f24f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f24c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f12f500 con 0x55ec1f249270 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f12f1a0 con 0x55ec1f243480 2024-05-08T20:07:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f016640 con 0x55ec1f248950 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e33801b80 10 client.0 _ll_register_callbacks cb 0x55ec1f138ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e25be4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e253e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f24f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e25be4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60816/0 (socket says 172.21.15.33:60816) 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e253e3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f24f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.33:42322/0 (socket says 172.21.15.33:42322) 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.161+0000 7f4e25be4700 1 -- 172.21.15.33:0/1635447375 learned_addr learned my addr 172.21.15.33:0/1635447375 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e24be2700 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f24c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e253e3700 1 -- 172.21.15.33:0/1635447375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 msgr2=0x55ec1f24c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f24c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e253e3700 1 -- 172.21.15.33:0/1635447375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 msgr2=0x55ec1f24cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e253e3700 1 -- 172.21.15.33:0/1635447375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e18011230 con 0x55ec1f243480 2024-05-08T20:07:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f24f2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0cb780 tx=0x7f4e1c09ab30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=becf933f605cdfc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e08ff9700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1635447375 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c0a12b0 con 0x55ec1f243480 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec1f0ec210 con 0x55ec1f243480 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1635447375 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f4e1c09f000 con 0x55ec1f243480 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1635447375 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e1c0a35c0 con 0x55ec1f243480 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e33801b80 10 client.25427 fetch_fsmap learned FSMap version 29 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ec1efc0b00 con 0x55ec1f243480 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.162+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1635447375 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ec1f0ec210 con 0x55ec1f243480 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1635447375 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4e1c09a6c0 con 0x55ec1f243480 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e33801b80 10 client.25427 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e33801b80 10 client.25427 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e33801b80 20 client.25427 populate_metadata read hostname 'smithi033' 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f25c8a0 0x55ec1f25ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e33801b80 4 client.25427 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:07:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec1f2127b0 con 0x55ec1f25c8a0 2024-05-08T20:07:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e24be2700 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f25c8a0 0x55ec1f25ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e24be2700 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f25c8a0 0x55ec1f25ecc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47eb27a21f42ab32 server_cookie=13ff73a180036759 in_seq=0 out_seq=0 2024-05-08T20:07:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.163+0000 7f4e08ff9700 10 client.25427 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1635447375 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ec1f2127b0 con 0x55ec1f25c8a0 2024-05-08T20:07:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e08ff9700 10 client.25427 handle_command_reply: tid=0 2024-05-08T20:07:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 client.25427 shutdown 2024-05-08T20:07:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 msgr2=0x55ec1f24f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f24f2a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c0cb780 tx=0x7f4e1c09ab30 comp rx=0 tx=0).stop 2024-05-08T20:07:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 shutdown_connections 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f25c8a0 0x55ec1f25ecc0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f24f2a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e08ff9700 0 client.25427 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1635447375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f24c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 >> 172.21.15.33:0/1635447375 conn(0x55ec1f1a11b0 msgr2=0x55ec1f2474a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 shutdown_connections 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.165+0000 7f4e33801b80 1 -- 172.21.15.33:0/1635447375 wait complete. 2024-05-08T20:07:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.166+0000 7f4e33801b80 20 client.25427 trim_cache size 0 max 16384 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 Processor -- start 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 -- start start 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f248d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f23f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f242240 con 0x55ec1f249270 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f258fb0 con 0x55ec1f243480 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e33801b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f259590 con 0x55ec1f248950 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.175 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60822/0 (socket says 172.21.15.33:60822) 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 -- 172.21.15.33:0/1817199527 learned_addr learned my addr 172.21.15.33:0/1817199527 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f248d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e24be2700 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f23f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 -- 172.21.15.33:0/1817199527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 msgr2=0x55ec1f23f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f23f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 -- 172.21.15.33:0/1817199527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 msgr2=0x55ec1f248d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f248d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.182+0000 7f4e25be4700 1 -- 172.21.15.33:0/1817199527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec1f159500 con 0x55ec1f249270 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.183+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f248d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.183+0000 7f4e25be4700 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24c5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4e18012010 tx=0x7f4e180098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87ce6219de16acb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.183+0000 7f4e0bfff700 1 -- 172.21.15.33:0/1817199527 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800e040 con 0x55ec1f249270 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.183+0000 7f4e0bfff700 1 -- 172.21.15.33:0/1817199527 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4e18022070 con 0x55ec1f249270 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.183+0000 7f4e0bfff700 1 -- 172.21.15.33:0/1817199527 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e18007e80 con 0x55ec1f249270 2024-05-08T20:07:19.176 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 -- 172.21.15.33:0/1817199527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 msgr2=0x55ec1f24c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24c5f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4e18012010 tx=0x7f4e180098a0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 -- 172.21.15.33:0/1817199527 shutdown_connections 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f249270 0x55ec1f24c5f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f243480 0x55ec1f248d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1817199527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f248950 0x55ec1f23f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 -- 172.21.15.33:0/1817199527 >> 172.21.15.33:0/1817199527 conn(0x55ec1f1a11b0 msgr2=0x55ec1f24bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 -- 172.21.15.33:0/1817199527 shutdown_connections 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 -- 172.21.15.33:0/1817199527 wait complete. 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 -- start start 2024-05-08T20:07:19.177 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.184+0000 7f4e33801b80 1 Processor -- start 2024-05-08T20:07:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f243480 0x55ec1f253e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.180 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f248950 0x55ec1f2463f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e33801b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f249270 0x55ec1f246930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e33801b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f254510 con 0x55ec1f248950 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e33801b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f246e70 con 0x55ec1f249270 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e33801b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec1f247030 con 0x55ec1f243480 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e33801b80 10 client.0 _ll_register_callbacks cb 0x55ec1f138ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f248950 0x55ec1f2463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f248950 0x55ec1f2463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60830/0 (socket says 172.21.15.33:60830) 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e253e3700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f243480 0x55ec1f253e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 -- 172.21.15.33:0/1770989001 learned_addr learned my addr 172.21.15.33:0/1770989001 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e25be4700 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f249270 0x55ec1f246930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 -- 172.21.15.33:0/1770989001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f243480 msgr2=0x55ec1f253e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.181 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f243480 0x55ec1f253e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 -- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f249270 msgr2=0x55ec1f246930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f249270 0x55ec1f246930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 -- 172.21.15.33:0/1770989001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec1efc0b00 con 0x55ec1f248950 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f243480 0x55ec1f253e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e24be2700 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f248950 0x55ec1f2463f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4e10005950 tx=0x7f4e100047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0feab80bb9746e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e08ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.185+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1770989001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10011870 con 0x55ec1f248950 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1770989001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f4e10017070 con 0x55ec1f248950 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e1800f040 con 0x55ec1f248950 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1770989001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e100119d0 con 0x55ec1f248950 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 10 client.15561 fetch_fsmap learned FSMap version 29 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ec1f014350 con 0x55ec1f248950 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1770989001 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4e1800f040 con 0x55ec1f248950 2024-05-08T20:07:19.182 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1770989001 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4e1001f4c0 con 0x55ec1f248950 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 10 client.15561 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 10 client.15561 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 20 client.15561 populate_metadata read hostname 'smithi033' 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f2b32d0 0x55ec1f2b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 4 client.15561 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ec1f18be60 con 0x55ec1f2b32d0 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.186+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f2b32d0 0x55ec1f2b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.187+0000 7f4e08ff9700 10 client.15561 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:19.183 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.187+0000 7f4e253e3700 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f2b32d0 0x55ec1f2b56f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40d6aa20971fea3 server_cookie=380b002654427b6a in_seq=0 out_seq=0 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e08ff9700 1 -- 172.21.15.33:0/1770989001 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ec1f18be60 con 0x55ec1f2b32d0 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e08ff9700 10 client.15561 handle_command_reply: tid=0 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 client.15561 shutdown 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f248950 msgr2=0x55ec1f2463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f248950 0x55ec1f2463f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4e10005950 tx=0x7f4e100047c0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 shutdown_connections 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x55ec1f2b32d0 0x55ec1f2b56f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ec1f249270 0x55ec1f246930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.569 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e08ff9700 0 client.15561 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ec1f243480 0x55ec1f253e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 --2- 172.21.15.33:0/1770989001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55ec1f248950 0x55ec1f2463f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.577+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 >> 172.21.15.33:0/1770989001 conn(0x55ec1f1a11b0 msgr2=0x55ec1f249650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.578+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 shutdown_connections 2024-05-08T20:07:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.578+0000 7f4e33801b80 1 -- 172.21.15.33:0/1770989001 wait complete. 2024-05-08T20:07:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.578+0000 7f4e33801b80 20 client.15561 trim_cache size 0 max 16384 2024-05-08T20:07:19.570 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:07:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:07:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:07:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:07:19.571 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.578+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4e0c0a1290 msgr2=0x7f4e0c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.578+0000 7f4e27647700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4e0c0a1290 0x7f4e0c0a3750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4e201988c0 tx=0x7f4e1000b410 comp rx=0 tx=0).stop 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.578+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200682e0 msgr2=0x7f4e201973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200682e0 0x7f4e201973c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c000c00 tx=0x7f4e1c004730 comp rx=0 tx=0).stop 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 shutdown_connections 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e20107000 0x7f4e2019bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f4e0c0a1290 0x7f4e0c0a3750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e200682e0 0x7f4e201973c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 --2- 172.21.15.33:0/2951479851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e20068ca0 0x7f4e20197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 >> 172.21.15.33:0/2951479851 conn(0x7f4e20076f10 msgr2=0x7f4e200feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 shutdown_connections 2024-05-08T20:07:19.572 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:19.579+0000 7f4e27647700 1 -- 172.21.15.33:0/2951479851 wait complete. 2024-05-08T20:07:20.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:20 smithi033 ceph-mon[42490]: pgmap v83: 97 pgs: 97 active+clean; 152 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 242 op/s 2024-05-08T20:07:20.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:20 smithi082 ceph-mon[46774]: pgmap v83: 97 pgs: 97 active+clean; 152 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 242 op/s 2024-05-08T20:07:20.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:20 smithi132 ceph-mon[47484]: pgmap v83: 97 pgs: 97 active+clean; 152 MiB data, 952 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 242 op/s 2024-05-08T20:07:22.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:22 smithi033 ceph-mon[42490]: pgmap v84: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 637 op/s 2024-05-08T20:07:22.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:22 smithi082 ceph-mon[46774]: pgmap v84: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 637 op/s 2024-05-08T20:07:22.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:22 smithi132 ceph-mon[47484]: pgmap v84: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 637 op/s 2024-05-08T20:07:24.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:24 smithi033 ceph-mon[42490]: pgmap v85: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 554 op/s 2024-05-08T20:07:24.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:24 smithi082 ceph-mon[46774]: pgmap v85: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 554 op/s 2024-05-08T20:07:24.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:24 smithi132 ceph-mon[47484]: pgmap v85: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 554 op/s 2024-05-08T20:07:26.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:26 smithi033 ceph-mon[42490]: pgmap v86: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 554 op/s 2024-05-08T20:07:26.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:26 smithi082 ceph-mon[46774]: pgmap v86: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 554 op/s 2024-05-08T20:07:26.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:26 smithi132 ceph-mon[47484]: pgmap v86: 97 pgs: 97 active+clean; 129 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 554 op/s 2024-05-08T20:07:27.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:27 smithi033 ceph-mon[42490]: pgmap v87: 97 pgs: 97 active+clean; 148 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 782 op/s 2024-05-08T20:07:27.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:27 smithi082 ceph-mon[46774]: pgmap v87: 97 pgs: 97 active+clean; 148 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 782 op/s 2024-05-08T20:07:27.875 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:27 smithi132 ceph-mon[47484]: pgmap v87: 97 pgs: 97 active+clean; 148 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 782 op/s 2024-05-08T20:07:30.322 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:30 smithi033 ceph-mon[42490]: pgmap v88: 97 pgs: 97 active+clean; 148 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 623 op/s 2024-05-08T20:07:30.373 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:30 smithi082 ceph-mon[46774]: pgmap v88: 97 pgs: 97 active+clean; 148 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 623 op/s 2024-05-08T20:07:30.375 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:30 smithi132 ceph-mon[47484]: pgmap v88: 97 pgs: 97 active+clean; 148 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.7 MiB/s wr, 623 op/s 2024-05-08T20:07:31.140 INFO:tasks.workunit.client.0.smithi033.stdout:Ok 2024-05-08T20:07:31.140 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-08T20:07:31.141 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-08T20:07:32.572 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:32 smithi033 ceph-mon[42490]: pgmap v89: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 765 op/s 2024-05-08T20:07:32.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:32 smithi082 ceph-mon[46774]: pgmap v89: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 765 op/s 2024-05-08T20:07:32.625 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:32 smithi132 ceph-mon[47484]: pgmap v89: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 765 op/s 2024-05-08T20:07:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 -- 172.21.15.33:0/282816855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 msgr2=0x7f24b41014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 --2- 172.21.15.33:0/282816855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b41014e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009990 tx=0x7f24a4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 -- 172.21.15.33:0/282816855 shutdown_connections 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 --2- 172.21.15.33:0/282816855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24b4106220 0x7f24b410dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 --2- 172.21.15.33:0/282816855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b41014e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 --2- 172.21.15.33:0/282816855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b4101ab0 0x7f24b4105af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 -- 172.21.15.33:0/282816855 >> 172.21.15.33:0/282816855 conn(0x7f24b40fc9a0 msgr2=0x7f24b40fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 -- 172.21.15.33:0/282816855 shutdown_connections 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 -- 172.21.15.33:0/282816855 wait complete. 2024-05-08T20:07:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.710+0000 7f24b9dac700 1 Processor -- start 2024-05-08T20:07:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b9dac700 1 -- start start 2024-05-08T20:07:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b9dac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b40732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b9dac700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24b4106220 0x7f24b40737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b9dac700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b4073d20 0x7f24b41a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b9dac700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b41a5c80 con 0x7f24b4101100 2024-05-08T20:07:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b9dac700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b41a5df0 con 0x7f24b4106220 2024-05-08T20:07:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b9dac700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b41a5fb0 con 0x7f24b4073d20 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b40732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b40732a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53472/0 (socket says 172.21.15.33:53472) 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b37fe700 1 -- 172.21.15.33:0/1192333914 learned_addr learned my addr 172.21.15.33:0/1192333914 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b3fff700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b4073d20 0x7f24b41a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24b4106220 0x7f24b40737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b37fe700 1 -- 172.21.15.33:0/1192333914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b4073d20 msgr2=0x7f24b41a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b37fe700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b4073d20 0x7f24b41a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b37fe700 1 -- 172.21.15.33:0/1192333914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24b4106220 msgr2=0x7f24b40737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.711+0000 7f24b37fe700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24b4106220 0x7f24b40737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.712+0000 7f24b37fe700 1 -- 172.21.15.33:0/1192333914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40095f0 con 0x7f24b4101100 2024-05-08T20:07:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.712+0000 7f24b37fe700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b40732a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f24a4005910 tx=0x7f24a4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.712+0000 7f24b0ff9700 1 -- 172.21.15.33:0/1192333914 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a401d070 con 0x7f24b4101100 2024-05-08T20:07:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.712+0000 7f24b0ff9700 1 -- 172.21.15.33:0/1192333914 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f24a4004cf0 con 0x7f24b4101100 2024-05-08T20:07:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.712+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b41a6230 con 0x7f24b4101100 2024-05-08T20:07:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.712+0000 7f24b0ff9700 1 -- 172.21.15.33:0/1192333914 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400f9d0 con 0x7f24b4101100 2024-05-08T20:07:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.712+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b41a6650 con 0x7f24b4101100 2024-05-08T20:07:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.714+0000 7f24b0ff9700 1 -- 172.21.15.33:0/1192333914 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f24a4004e60 con 0x7f24b4101100 2024-05-08T20:07:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.715+0000 7f24b0ff9700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f249c0a1290 0x7f249c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.715+0000 7f24b0ff9700 1 -- 172.21.15.33:0/1192333914 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f24a40cdc50 con 0x7f24b4101100 2024-05-08T20:07:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.715+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f249c0a1290 0x7f249c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.715+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f249c0a1290 0x7f249c0a3750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24b40749d0 tx=0x7f24a8009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 Processor -- start 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 -- start start 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9904f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef9905480 0x559ef99058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef985c0f0 con 0x559ef990b270 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef9859ab0 con 0x559ef9905480 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.716+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef98553a0 con 0x559ef990a950 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9904f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:60456/0 (socket says 172.21.15.33:60456) 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 -- 172.21.15.33:0/2211208053 learned_addr learned my addr 172.21.15.33:0/2211208053 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b3fff700 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef9905480 0x559ef99058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 -- 172.21.15.33:0/2211208053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef9905480 msgr2=0x559ef99058a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef9905480 0x559ef99058a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 -- 172.21.15.33:0/2211208053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 msgr2=0x559ef9904f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9904f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 -- 172.21.15.33:0/2211208053 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ef96d6350 con 0x559ef990a950 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b3fff700 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef9905480 0x559ef99058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9904f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f24b37fe700 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990ad30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24a4097220 tx=0x7f24a409a700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc00e6746e339cec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f2499ffb700 1 -- 172.21.15.33:0/2211208053 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a409eb50 con 0x559ef990a950 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f2499ffb700 1 -- 172.21.15.33:0/2211208053 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f24a40a3110 con 0x559ef990a950 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.717+0000 7f2499ffb700 1 -- 172.21.15.33:0/2211208053 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a409a470 con 0x559ef990a950 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 -- 172.21.15.33:0/2211208053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 msgr2=0x559ef990ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990ad30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f24a4097220 tx=0x7f24a409a700 comp rx=0 tx=0).stop 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 -- 172.21.15.33:0/2211208053 shutdown_connections 2024-05-08T20:07:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef9905480 0x559ef99058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990ad30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/2211208053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9904f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 -- 172.21.15.33:0/2211208053 >> 172.21.15.33:0/2211208053 conn(0x559ef98631b0 msgr2=0x559ef98ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 -- 172.21.15.33:0/2211208053 shutdown_connections 2024-05-08T20:07:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 -- 172.21.15.33:0/2211208053 wait complete. 2024-05-08T20:07:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.718+0000 7f24c5f66b80 1 -- start start 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 1 Processor -- start 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef9905480 0x559ef9911220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990b270 0x559ef990ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef97f1500 con 0x559ef9905480 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef97f11a0 con 0x559ef990b270 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef96d8640 con 0x559ef990a950 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24c5f66b80 10 client.0 _ll_register_callbacks cb 0x559ef97faad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef9905480 0x559ef9911220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.719+0000 7f24b2ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b2ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:60458/0 (socket says 172.21.15.33:60458) 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef9905480 0x559ef9911220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53496/0 (socket says 172.21.15.33:53496) 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b2ffd700 1 -- 172.21.15.33:0/1704425949 learned_addr learned my addr 172.21.15.33:0/1704425949 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b3fff700 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990b270 0x559ef990ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b37fe700 1 -- 172.21.15.33:0/1704425949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 msgr2=0x559ef990e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b37fe700 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b37fe700 1 -- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990b270 msgr2=0x559ef990ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b37fe700 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990b270 0x559ef990ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b37fe700 1 -- 172.21.15.33:0/1704425949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a8017070 con 0x559ef9905480 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24b37fe700 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef9905480 0x559ef9911220 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f24a402d000 tx=0x7f24a4005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=427ba50f7d35efc6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f2492ffd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f2492ffd700 1 -- 172.21.15.33:0/1704425949 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a409eb50 con 0x559ef9905480 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f2492ffd700 1 -- 172.21.15.33:0/1704425949 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f24a409b190 con 0x559ef9905480 2024-05-08T20:07:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ef97ae210 con 0x559ef9905480 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f2492ffd700 1 -- 172.21.15.33:0/1704425949 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24a40a2c80 con 0x559ef9905480 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24c5f66b80 10 client.15573 fetch_fsmap learned FSMap version 29 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.720+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f24b41a6650 con 0x559ef9905480 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f2492ffd700 1 -- 172.21.15.33:0/1704425949 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559ef97ae210 con 0x559ef9905480 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f2492ffd700 1 -- 172.21.15.33:0/1704425949 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f24a400fb30 con 0x559ef9905480 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24c5f66b80 10 client.15573 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24c5f66b80 10 client.15573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24c5f66b80 20 client.15573 populate_metadata read hostname 'smithi033' 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef991e410 0x559ef9920800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24c5f66b80 4 client.15573 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ef98d47b0 con 0x559ef991e410 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef991e410 0x559ef9920800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef991e410 0x559ef9920800 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4449ef31934e6e server_cookie=bc02d6fbccd7e6e3 in_seq=0 out_seq=0 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.721+0000 7f2492ffd700 10 client.15573 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f2492ffd700 1 -- 172.21.15.33:0/1704425949 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ef98d47b0 con 0x559ef991e410 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f2492ffd700 10 client.15573 handle_command_reply: tid=0 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 client.15573 shutdown 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef9905480 msgr2=0x559ef9911220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef9905480 0x559ef9911220 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f24a402d000 tx=0x7f24a4005130 comp rx=0 tx=0).stop 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 shutdown_connections 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef991e410 0x559ef9920800 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990b270 0x559ef990ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef9905480 0x559ef9911220 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/1704425949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef990a950 0x559ef990e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f2492ffd700 0 client.15573 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 >> 172.21.15.33:0/1704425949 conn(0x559ef98631b0 msgr2=0x559ef9903f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 shutdown_connections 2024-05-08T20:07:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.722+0000 7f24c5f66b80 1 -- 172.21.15.33:0/1704425949 wait complete. 2024-05-08T20:07:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.723+0000 7f24c5f66b80 20 client.15573 trim_cache size 0 max 16384 2024-05-08T20:07:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.738+0000 7f24c5f66b80 1 Processor -- start 2024-05-08T20:07:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.738+0000 7f24c5f66b80 1 -- start start 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef990e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef98ff910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9910d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef990fb60 con 0x559ef990b270 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef990b0f0 con 0x559ef990a950 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef990f510 con 0x559ef9905480 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9910d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef98ff910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9910d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53498/0 (socket says 172.21.15.33:53498) 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 -- 172.21.15.33:0/3808016287 learned_addr learned my addr 172.21.15.33:0/3808016287 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b37fe700 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef990e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 -- 172.21.15.33:0/3808016287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 msgr2=0x559ef990e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef990e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 -- 172.21.15.33:0/3808016287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 msgr2=0x559ef98ff910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef98ff910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 -- 172.21.15.33:0/3808016287 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ef9682b00 con 0x559ef990b270 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef98ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f24b3fff700 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9910d50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0119e0 tx=0x7f24ac009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665cb4570719ace server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f249a7fc700 1 -- 172.21.15.33:0/3808016287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00e040 con 0x559ef990b270 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f249a7fc700 1 -- 172.21.15.33:0/3808016287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f24ac00f040 con 0x559ef990b270 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.739+0000 7f249a7fc700 1 -- 172.21.15.33:0/3808016287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac004260 con 0x559ef990b270 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 -- 172.21.15.33:0/3808016287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 msgr2=0x559ef9910d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9910d50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0119e0 tx=0x7f24ac009920 comp rx=0 tx=0).stop 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 -- 172.21.15.33:0/3808016287 shutdown_connections 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9910d50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef990e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/3808016287 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef98ff910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 -- 172.21.15.33:0/3808016287 >> 172.21.15.33:0/3808016287 conn(0x559ef98631b0 msgr2=0x559ef990dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 -- 172.21.15.33:0/3808016287 shutdown_connections 2024-05-08T20:07:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 -- 172.21.15.33:0/3808016287 wait complete. 2024-05-08T20:07:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.740+0000 7f24c5f66b80 1 -- start start 2024-05-08T20:07:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 1 Processor -- start 2024-05-08T20:07:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef9915e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef9913930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9914070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef9914780 con 0x559ef990b270 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef99738e0 con 0x559ef990a950 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ef9973a20 con 0x559ef9905480 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24c5f66b80 10 client.0 _ll_register_callbacks cb 0x559ef97faad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9914070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24b2ffd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef9913930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9914070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53502/0 (socket says 172.21.15.33:53502) 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24b3fff700 1 -- 172.21.15.33:0/4046062376 learned_addr learned my addr 172.21.15.33:0/4046062376 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.741+0000 7f24b37fe700 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef9915e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24b2ffd700 1 -- 172.21.15.33:0/4046062376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 msgr2=0x559ef9915e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.737 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef9915e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24b2ffd700 1 -- 172.21.15.33:0/4046062376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 msgr2=0x559ef9914070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9914070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24b2ffd700 1 -- 172.21.15.33:0/4046062376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a801d610 con 0x559ef990a950 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24b3fff700 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9914070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24b2ffd700 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef9913930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x559ef990fae0 tx=0x7f24a80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18d1cc4e083153a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f2492ffd700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f2492ffd700 1 -- 172.21.15.33:0/4046062376 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8022070 con 0x559ef990a950 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24a40a3110 con 0x559ef990a950 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f2492ffd700 1 -- 172.21.15.33:0/4046062376 <== mon.2 v2:172.21.15.82:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8628+0+0 (secure 0 0 0) 0x7f24a801dd90 con 0x559ef990a950 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f2492ffd700 1 -- 172.21.15.33:0/4046062376 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24a8004030 con 0x559ef990a950 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24c5f66b80 10 client.25451 fetch_fsmap learned FSMap version 29 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f24ac011690 con 0x559ef990a950 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.742+0000 7f2492ffd700 1 -- 172.21.15.33:0/4046062376 <== mon.2 v2:172.21.15.82:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f24a803e080 con 0x559ef990a950 2024-05-08T20:07:32.738 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f2492ffd700 1 -- 172.21.15.33:0/4046062376 <== mon.2 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f24a8032440 con 0x559ef990a950 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24c5f66b80 10 client.25451 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24c5f66b80 10 client.25451 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24c5f66b80 20 client.25451 populate_metadata read hostname 'smithi033' 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef9975290 0x559ef99776b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24c5f66b80 4 client.25451 mds_command: new command op to 24566 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 --> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559ef984de60 con 0x559ef9975290 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24b37fe700 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef9975290 0x559ef99776b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f2492ffd700 10 client.25451 ms_handle_connect on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:32.743+0000 7f24b37fe700 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef9975290 0x559ef99776b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fad3bcb55ac94063 server_cookie=4c4cb6d74fbe75a8 in_seq=0 out_seq=0 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.646+0000 7f2492ffd700 1 -- 172.21.15.33:0/4046062376 <== mds.0 v2:172.21.15.82:6838/3735435957 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559ef984de60 con 0x559ef9975290 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.646+0000 7f2492ffd700 10 client.25451 handle_command_reply: tid=0 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.646+0000 7f24c5f66b80 1 client.25451 shutdown 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 msgr2=0x559ef9913930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef9913930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x559ef990fae0 tx=0x7f24a80047c0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 shutdown_connections 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:6838/3735435957,v1:172.21.15.82:6839/3735435957] conn(0x559ef9975290 0x559ef99776b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x559ef990b270 0x559ef9914070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f2492ffd700 0 client.25451 ms_handle_reset on v2:172.21.15.82:6838/3735435957 2024-05-08T20:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559ef9905480 0x559ef9915e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 --2- 172.21.15.33:0/4046062376 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559ef990a950 0x559ef9913930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 >> 172.21.15.33:0/4046062376 conn(0x559ef98631b0 msgr2=0x559ef9909560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 shutdown_connections 2024-05-08T20:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 1 -- 172.21.15.33:0/4046062376 wait complete. 2024-05-08T20:07:33.640 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.647+0000 7f24c5f66b80 20 client.25451 trim_cache size 0 max 16384 2024-05-08T20:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:{ 2024-05-08T20:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "message": "", 2024-05-08T20:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout: "return_code": 0 2024-05-08T20:07:33.641 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stdout:} 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f249c0a1290 msgr2=0x7f249c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f249c0a1290 0x7f249c0a3750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24b40749d0 tx=0x7f24a8009260 comp rx=0 tx=0).stop 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 msgr2=0x7f24b40732a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b40732a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f24a4005910 tx=0x7f24a4005e80 comp rx=0 tx=0).stop 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 shutdown_connections 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24b4073d20 0x7f24b41a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f249c0a1290 0x7f249c0a3750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f24b4101100 0x7f24b40732a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 --2- 172.21.15.33:0/1192333914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24b4106220 0x7f24b40737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 >> 172.21.15.33:0/1192333914 conn(0x7f24b40fc9a0 msgr2=0x7f24b4105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.648+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 shutdown_connections 2024-05-08T20:07:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi033.front.sepia.ceph.com.smithi033.stderr:2024-05-08T20:07:33.649+0000 7f24b9dac700 1 -- 172.21.15.33:0/1192333914 wait complete. 2024-05-08T20:07:34.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:34 smithi082 ceph-mon[46774]: pgmap v90: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-05-08T20:07:34.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:34 smithi132 ceph-mon[47484]: pgmap v90: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-05-08T20:07:34.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:34 smithi033 ceph-mon[42490]: pgmap v90: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-05-08T20:07:36.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:36 smithi082 ceph-mon[46774]: pgmap v91: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-05-08T20:07:36.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:36 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:36.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:36 smithi132 ceph-mon[47484]: pgmap v91: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-05-08T20:07:36.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:36 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:36.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:36 smithi033 ceph-mon[42490]: pgmap v91: 97 pgs: 97 active+clean; 167 MiB data, 989 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 370 op/s 2024-05-08T20:07:36.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:36 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:07:38.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:38 smithi082 ceph-mon[46774]: pgmap v92: 97 pgs: 97 active+clean; 152 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 971 op/s 2024-05-08T20:07:38.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:38 smithi132 ceph-mon[47484]: pgmap v92: 97 pgs: 97 active+clean; 152 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 971 op/s 2024-05-08T20:07:38.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:38 smithi033 ceph-mon[42490]: pgmap v92: 97 pgs: 97 active+clean; 152 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 971 op/s 2024-05-08T20:07:40.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:40 smithi082 ceph-mon[46774]: pgmap v93: 97 pgs: 97 active+clean; 152 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 744 op/s 2024-05-08T20:07:40.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:40 smithi132 ceph-mon[47484]: pgmap v93: 97 pgs: 97 active+clean; 152 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 744 op/s 2024-05-08T20:07:40.822 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:40 smithi033 ceph-mon[42490]: pgmap v93: 97 pgs: 97 active+clean; 152 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 744 op/s 2024-05-08T20:07:42.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:42 smithi082 ceph-mon[46774]: pgmap v94: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 897 op/s 2024-05-08T20:07:42.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:42 smithi132 ceph-mon[47484]: pgmap v94: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 897 op/s 2024-05-08T20:07:42.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:42 smithi033 ceph-mon[42490]: pgmap v94: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 897 op/s 2024-05-08T20:07:43.524 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-05-08T20:07:43.524 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-08T20:07:43.869 DEBUG:teuthology.parallel:result is None 2024-05-08T20:07:43.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:07:43.923 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-08T20:07:43.923 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-08T20:07:43.934 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:07:43.944 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-08T20:07:43.978 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-05-08T20:07:43.978 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T20:07:43.978 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:07:43.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-05-08T20:07:44.021 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-05-08T20:07:44.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:44 smithi082 ceph-mon[46774]: pgmap v95: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 754 op/s 2024-05-08T20:07:44.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:44 smithi132 ceph-mon[47484]: pgmap v95: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 754 op/s 2024-05-08T20:07:44.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:44 smithi033 ceph-mon[42490]: pgmap v95: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 754 op/s 2024-05-08T20:07:46.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:46 smithi082 ceph-mon[46774]: pgmap v96: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 754 op/s 2024-05-08T20:07:46.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:46 smithi132 ceph-mon[47484]: pgmap v96: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 754 op/s 2024-05-08T20:07:46.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:46 smithi033 ceph-mon[42490]: pgmap v96: 97 pgs: 97 active+clean; 151 MiB data, 970 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 754 op/s 2024-05-08T20:07:48.623 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:48 smithi082 ceph-mon[46774]: pgmap v97: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 870 op/s 2024-05-08T20:07:48.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:48 smithi132 ceph-mon[47484]: pgmap v97: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 870 op/s 2024-05-08T20:07:48.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:48 smithi033 ceph-mon[42490]: pgmap v97: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 870 op/s 2024-05-08T20:07:50.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:50 smithi082 ceph-mon[46774]: pgmap v98: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 907 KiB/s wr, 269 op/s 2024-05-08T20:07:50.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:50 smithi132 ceph-mon[47484]: pgmap v98: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 907 KiB/s wr, 269 op/s 2024-05-08T20:07:50.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:50 smithi033 ceph-mon[42490]: pgmap v98: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 907 KiB/s wr, 269 op/s 2024-05-08T20:07:51.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:51 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:07:51.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:51 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:07:51.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:51 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:07:52.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:52 smithi082 ceph-mon[46774]: pgmap v99: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 914 KiB/s wr, 273 op/s 2024-05-08T20:07:52.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:07:52.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:07:52.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:07:52.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:52 smithi132 ceph-mon[47484]: pgmap v99: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 914 KiB/s wr, 273 op/s 2024-05-08T20:07:52.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:07:52.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:07:52.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:07:52.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:52 smithi033 ceph-mon[42490]: pgmap v99: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 914 KiB/s wr, 273 op/s 2024-05-08T20:07:52.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:07:52.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:07:52.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:07:54.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:54 smithi082 ceph-mon[46774]: pgmap v100: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 298 KiB/s wr, 120 op/s 2024-05-08T20:07:54.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:54 smithi132 ceph-mon[47484]: pgmap v100: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 298 KiB/s wr, 120 op/s 2024-05-08T20:07:54.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:54 smithi033 ceph-mon[42490]: pgmap v100: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 298 KiB/s wr, 120 op/s 2024-05-08T20:07:56.626 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:56 smithi132 ceph-mon[47484]: pgmap v101: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 298 KiB/s wr, 120 op/s 2024-05-08T20:07:56.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:56 smithi033 ceph-mon[42490]: pgmap v101: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 298 KiB/s wr, 120 op/s 2024-05-08T20:07:56.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:56 smithi082 ceph-mon[46774]: pgmap v101: 97 pgs: 97 active+clean; 145 MiB data, 988 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 298 KiB/s wr, 120 op/s 2024-05-08T20:07:58.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:07:58 smithi033 ceph-mon[42490]: pgmap v102: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 300 KiB/s wr, 124 op/s 2024-05-08T20:07:58.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:07:58 smithi082 ceph-mon[46774]: pgmap v102: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 300 KiB/s wr, 124 op/s 2024-05-08T20:07:58.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:07:58 smithi132 ceph-mon[47484]: pgmap v102: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 300 KiB/s wr, 124 op/s 2024-05-08T20:08:00.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:00 smithi033 ceph-mon[42490]: pgmap v103: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.3 KiB/s wr, 8 op/s 2024-05-08T20:08:00.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:00 smithi082 ceph-mon[46774]: pgmap v103: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.3 KiB/s wr, 8 op/s 2024-05-08T20:08:00.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:00 smithi132 ceph-mon[47484]: pgmap v103: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.3 KiB/s wr, 8 op/s 2024-05-08T20:08:02.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:02 smithi033 ceph-mon[42490]: pgmap v104: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 KiB/s wr, 25 op/s 2024-05-08T20:08:02.873 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:02 smithi082 ceph-mon[46774]: pgmap v104: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 KiB/s wr, 25 op/s 2024-05-08T20:08:02.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:02 smithi132 ceph-mon[47484]: pgmap v104: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 31 KiB/s wr, 25 op/s 2024-05-08T20:08:04.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:04 smithi033 ceph-mon[42490]: pgmap v105: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:04.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:04 smithi082 ceph-mon[46774]: pgmap v105: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:04.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:04 smithi132 ceph-mon[47484]: pgmap v105: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:06.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:06 smithi033 ceph-mon[42490]: pgmap v106: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:06.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:06 smithi082 ceph-mon[46774]: pgmap v106: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:06.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:06 smithi132 ceph-mon[47484]: pgmap v106: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:08.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:08 smithi033 ceph-mon[42490]: pgmap v107: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-05-08T20:08:08.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:08 smithi082 ceph-mon[46774]: pgmap v107: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-05-08T20:08:08.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:08 smithi132 ceph-mon[47484]: pgmap v107: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 26 KiB/s wr, 23 op/s 2024-05-08T20:08:10.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:10 smithi033 ceph-mon[42490]: pgmap v108: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:10.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:10 smithi082 ceph-mon[46774]: pgmap v108: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:10.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:10 smithi132 ceph-mon[47484]: pgmap v108: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 20 op/s 2024-05-08T20:08:12.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:12 smithi033 ceph-mon[42490]: pgmap v109: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-05-08T20:08:12.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:12 smithi082 ceph-mon[46774]: pgmap v109: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-05-08T20:08:12.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:12 smithi132 ceph-mon[47484]: pgmap v109: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 22 op/s 2024-05-08T20:08:14.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:14 smithi033 ceph-mon[42490]: pgmap v110: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T20:08:14.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:14 smithi082 ceph-mon[46774]: pgmap v110: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T20:08:14.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:14 smithi132 ceph-mon[47484]: pgmap v110: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T20:08:16.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:16 smithi033 ceph-mon[42490]: pgmap v111: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T20:08:16.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:16 smithi082 ceph-mon[46774]: pgmap v111: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T20:08:16.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:16 smithi132 ceph-mon[47484]: pgmap v111: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-05-08T20:08:18.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:18 smithi033 ceph-mon[42490]: pgmap v112: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-05-08T20:08:18.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:18 smithi082 ceph-mon[46774]: pgmap v112: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-05-08T20:08:18.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:18 smithi132 ceph-mon[47484]: pgmap v112: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.9 KiB/s wr, 8 op/s 2024-05-08T20:08:20.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:20 smithi033 ceph-mon[42490]: pgmap v113: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T20:08:20.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:20 smithi082 ceph-mon[46774]: pgmap v113: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T20:08:20.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:20 smithi132 ceph-mon[47484]: pgmap v113: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-05-08T20:08:22.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:22 smithi033 ceph-mon[42490]: pgmap v114: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-05-08T20:08:22.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:22 smithi082 ceph-mon[46774]: pgmap v114: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-05-08T20:08:22.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:22 smithi132 ceph-mon[47484]: pgmap v114: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-05-08T20:08:24.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:24 smithi033 ceph-mon[42490]: pgmap v115: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T20:08:24.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:24 smithi082 ceph-mon[46774]: pgmap v115: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T20:08:24.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:24 smithi132 ceph-mon[47484]: pgmap v115: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T20:08:26.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:26 smithi033 ceph-mon[42490]: pgmap v116: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T20:08:26.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:26 smithi082 ceph-mon[46774]: pgmap v116: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T20:08:26.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:26 smithi132 ceph-mon[47484]: pgmap v116: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-05-08T20:08:28.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:28 smithi033 ceph-mon[42490]: pgmap v117: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-05-08T20:08:28.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:28 smithi082 ceph-mon[46774]: pgmap v117: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-05-08T20:08:28.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:28 smithi132 ceph-mon[47484]: pgmap v117: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2024-05-08T20:08:29.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:29 smithi033 ceph-mon[42490]: pgmap v118: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:29.874 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:29 smithi082 ceph-mon[46774]: pgmap v118: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:29.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:29 smithi132 ceph-mon[47484]: pgmap v118: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:32.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:32 smithi082 ceph-mon[46774]: pgmap v119: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-08T20:08:32.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:32 smithi132 ceph-mon[47484]: pgmap v119: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-08T20:08:32.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:32 smithi033 ceph-mon[42490]: pgmap v119: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-08T20:08:34.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:34 smithi082 ceph-mon[46774]: pgmap v120: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:34.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:34 smithi132 ceph-mon[47484]: pgmap v120: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:34.823 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:34 smithi033 ceph-mon[42490]: pgmap v120: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:36.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:36 smithi082 ceph-mon[46774]: pgmap v121: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:36.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:36 smithi132 ceph-mon[47484]: pgmap v121: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:36.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:36 smithi033 ceph-mon[42490]: pgmap v121: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 5 op/s 2024-05-08T20:08:38.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:38 smithi082 ceph-mon[46774]: pgmap v122: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-08T20:08:38.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:38 smithi132 ceph-mon[47484]: pgmap v122: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-08T20:08:38.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:38 smithi033 ceph-mon[42490]: pgmap v122: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-08T20:08:40.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:40 smithi082 ceph-mon[46774]: pgmap v123: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:40.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:40 smithi132 ceph-mon[47484]: pgmap v123: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:40.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:40 smithi033 ceph-mon[42490]: pgmap v123: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:42.624 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:42 smithi082 ceph-mon[46774]: pgmap v124: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:42.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:42 smithi132 ceph-mon[47484]: pgmap v124: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:42.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:42 smithi033 ceph-mon[42490]: pgmap v124: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:44.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:44 smithi082 ceph-mon[46774]: pgmap v125: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:44.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:44 smithi132 ceph-mon[47484]: pgmap v125: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:44.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:44 smithi033 ceph-mon[42490]: pgmap v125: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:46.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:46 smithi082 ceph-mon[46774]: pgmap v126: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:46.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:46 smithi132 ceph-mon[47484]: pgmap v126: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:46.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:46 smithi033 ceph-mon[42490]: pgmap v126: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:48.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:48 smithi082 ceph-mon[46774]: pgmap v127: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:48.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:48 smithi132 ceph-mon[47484]: pgmap v127: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:48.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:48 smithi033 ceph-mon[42490]: pgmap v127: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:50.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:50 smithi082 ceph-mon[46774]: pgmap v128: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:50.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:50 smithi132 ceph-mon[47484]: pgmap v128: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:50.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:50 smithi033 ceph-mon[42490]: pgmap v128: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: pgmap v129: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:52 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: pgmap v129: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:52.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:08:52.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:52 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: pgmap v129: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:52.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:08:52.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:52.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:52 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:53.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:53 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:08:53.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:53 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:08:53.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:53 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:53.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:53 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:08:53.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:53 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:08:53.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:53 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:53.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:53 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:08:53.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:53 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:08:53.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:53 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:08:54.627 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:54 smithi132 ceph-mon[47484]: pgmap v130: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:54.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:54 smithi033 ceph-mon[42490]: pgmap v130: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:54.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:54 smithi082 ceph-mon[46774]: pgmap v130: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:56.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:56 smithi033 ceph-mon[42490]: pgmap v131: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:56.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:56 smithi082 ceph-mon[46774]: pgmap v131: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:56.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:56 smithi132 ceph-mon[47484]: pgmap v131: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:08:58.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:08:58 smithi033 ceph-mon[42490]: pgmap v132: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:58.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:08:58 smithi082 ceph-mon[46774]: pgmap v132: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:08:58.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:08:58 smithi132 ceph-mon[47484]: pgmap v132: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:00.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:00 smithi033 ceph-mon[42490]: pgmap v133: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:00.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:00 smithi082 ceph-mon[46774]: pgmap v133: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:00.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:00 smithi132 ceph-mon[47484]: pgmap v133: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:02.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:02 smithi033 ceph-mon[42490]: pgmap v134: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:02.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:02 smithi082 ceph-mon[46774]: pgmap v134: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:02.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:02 smithi132 ceph-mon[47484]: pgmap v134: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:04.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:04 smithi033 ceph-mon[42490]: pgmap v135: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:09:04.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:04 smithi082 ceph-mon[46774]: pgmap v135: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:09:04.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:04 smithi132 ceph-mon[47484]: pgmap v135: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:09:06.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:06 smithi033 ceph-mon[42490]: pgmap v136: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:09:06.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:06 smithi082 ceph-mon[46774]: pgmap v136: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:09:06.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:06 smithi132 ceph-mon[47484]: pgmap v136: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:09:08.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:08 smithi033 ceph-mon[42490]: pgmap v137: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:08.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:08 smithi082 ceph-mon[46774]: pgmap v137: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:08.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:08 smithi132 ceph-mon[47484]: pgmap v137: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:10.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:10 smithi033 ceph-mon[42490]: pgmap v138: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:09:10.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:10 smithi082 ceph-mon[46774]: pgmap v138: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:09:10.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:10 smithi132 ceph-mon[47484]: pgmap v138: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:09:12.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:12 smithi033 ceph-mon[42490]: pgmap v139: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:12.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:12 smithi082 ceph-mon[46774]: pgmap v139: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:12.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:12 smithi132 ceph-mon[47484]: pgmap v139: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:09:14.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:14 smithi033 ceph-mon[42490]: pgmap v140: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:09:14.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:14 smithi082 ceph-mon[46774]: pgmap v140: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:09:14.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:14 smithi132 ceph-mon[47484]: pgmap v140: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:09:16.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:16 smithi033 ceph-mon[42490]: pgmap v141: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:09:16.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:16 smithi082 ceph-mon[46774]: pgmap v141: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:09:16.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:16 smithi132 ceph-mon[47484]: pgmap v141: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:09:18.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:18 smithi033 ceph-mon[42490]: pgmap v142: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T20:09:18.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:18 smithi082 ceph-mon[46774]: pgmap v142: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T20:09:18.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:18 smithi132 ceph-mon[47484]: pgmap v142: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T20:09:20.824 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:20 smithi033 ceph-mon[42490]: pgmap v143: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T20:09:20.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:20 smithi082 ceph-mon[46774]: pgmap v143: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T20:09:20.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:20 smithi132 ceph-mon[47484]: pgmap v143: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T20:09:22.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:22 smithi033 ceph-mon[42490]: pgmap v144: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:09:22.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:22 smithi082 ceph-mon[46774]: pgmap v144: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:09:22.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:22 smithi132 ceph-mon[47484]: pgmap v144: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:09:24.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:24 smithi033 ceph-mon[42490]: pgmap v145: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:24.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:24 smithi082 ceph-mon[46774]: pgmap v145: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:24.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:24 smithi132 ceph-mon[47484]: pgmap v145: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:26.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:26 smithi033 ceph-mon[42490]: pgmap v146: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:26.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:26 smithi082 ceph-mon[46774]: pgmap v146: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:26.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:26 smithi132 ceph-mon[47484]: pgmap v146: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:28.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:28 smithi033 ceph-mon[42490]: pgmap v147: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:28.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:28 smithi082 ceph-mon[46774]: pgmap v147: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:28.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:28 smithi132 ceph-mon[47484]: pgmap v147: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:29.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:29 smithi033 ceph-mon[42490]: pgmap v148: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:29.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:29 smithi082 ceph-mon[46774]: pgmap v148: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:29.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:29 smithi132 ceph-mon[47484]: pgmap v148: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:32.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:32 smithi082 ceph-mon[46774]: pgmap v149: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:32.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:32 smithi132 ceph-mon[47484]: pgmap v149: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:32.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:32 smithi033 ceph-mon[42490]: pgmap v149: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:34.625 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:34 smithi082 ceph-mon[46774]: pgmap v150: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:34.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:34 smithi132 ceph-mon[47484]: pgmap v150: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:34.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:34 smithi033 ceph-mon[42490]: pgmap v150: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:36.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:36 smithi082 ceph-mon[46774]: pgmap v151: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:36.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:36 smithi132 ceph-mon[47484]: pgmap v151: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:36.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:36 smithi033 ceph-mon[42490]: pgmap v151: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:38.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:38 smithi082 ceph-mon[46774]: pgmap v152: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:38.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:38 smithi132 ceph-mon[47484]: pgmap v152: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:38.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:38 smithi033 ceph-mon[42490]: pgmap v152: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:40.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:40 smithi082 ceph-mon[46774]: pgmap v153: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:40.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:40 smithi132 ceph-mon[47484]: pgmap v153: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:40.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:40 smithi033 ceph-mon[42490]: pgmap v153: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:42.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:42 smithi082 ceph-mon[46774]: pgmap v154: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:42.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:42 smithi132 ceph-mon[47484]: pgmap v154: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:42.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:42 smithi033 ceph-mon[42490]: pgmap v154: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:44.628 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:44 smithi132 ceph-mon[47484]: pgmap v155: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:44.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:44 smithi033 ceph-mon[42490]: pgmap v155: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:44.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:44 smithi082 ceph-mon[46774]: pgmap v155: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:46.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:46 smithi033 ceph-mon[42490]: pgmap v156: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:46.875 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:46 smithi082 ceph-mon[46774]: pgmap v156: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:46.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:46 smithi132 ceph-mon[47484]: pgmap v156: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:48.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:48 smithi033 ceph-mon[42490]: pgmap v157: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:48.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:48 smithi082 ceph-mon[46774]: pgmap v157: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:48.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:48 smithi132 ceph-mon[47484]: pgmap v157: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:50.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:50 smithi033 ceph-mon[42490]: pgmap v158: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:50.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:50 smithi082 ceph-mon[46774]: pgmap v158: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:50.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:50 smithi132 ceph-mon[47484]: pgmap v158: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:52.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:52 smithi033 ceph-mon[42490]: pgmap v159: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:52.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:52 smithi082 ceph-mon[46774]: pgmap v159: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:52.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:52 smithi132 ceph-mon[47484]: pgmap v159: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:53.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:53 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:09:53.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:53 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:09:53.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:53 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:09:53.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:53 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:09:53.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:53 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:09:53.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:53 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:09:53.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:53 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:09:53.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:53 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:09:53.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:53 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:09:53.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:53 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:09:53.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:53 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:09:53.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:53 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:09:54.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:54 smithi033 ceph-mon[42490]: pgmap v160: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:54.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:54 smithi082 ceph-mon[46774]: pgmap v160: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:54.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:54 smithi132 ceph-mon[47484]: pgmap v160: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:56.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:56 smithi033 ceph-mon[42490]: pgmap v161: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:56.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:56 smithi082 ceph-mon[46774]: pgmap v161: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:56.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:56 smithi132 ceph-mon[47484]: pgmap v161: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:09:58.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:09:58 smithi033 ceph-mon[42490]: pgmap v162: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:58.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:09:58 smithi082 ceph-mon[46774]: pgmap v162: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:09:58.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:09:58 smithi132 ceph-mon[47484]: pgmap v162: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:00.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:00 smithi082 ceph-mon[46774]: pgmap v163: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:00.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:00 smithi082 ceph-mon[46774]: overall HEALTH_OK 2024-05-08T20:10:00.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:00 smithi033 ceph-mon[42490]: pgmap v163: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:00.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:00 smithi033 ceph-mon[42490]: overall HEALTH_OK 2024-05-08T20:10:00.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:00 smithi132 ceph-mon[47484]: pgmap v163: 97 pgs: 97 active+clean; 145 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:00.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:00 smithi132 ceph-mon[47484]: overall HEALTH_OK 2024-05-08T20:10:02.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:02 smithi033 ceph-mon[42490]: pgmap v164: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:02.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:02 smithi082 ceph-mon[46774]: pgmap v164: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:02.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:02 smithi132 ceph-mon[47484]: pgmap v164: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:04.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:04 smithi033 ceph-mon[42490]: pgmap v165: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:10:04.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:04 smithi082 ceph-mon[46774]: pgmap v165: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:10:04.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:04 smithi132 ceph-mon[47484]: pgmap v165: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:10:05.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:05 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:05.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:05 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:05.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:05 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:06.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:06 smithi033 ceph-mon[42490]: pgmap v166: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:10:06.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:06 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:06.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:06 smithi082 ceph-mon[46774]: pgmap v166: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:10:06.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:06 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:06.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:06 smithi132 ceph-mon[47484]: pgmap v166: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-05-08T20:10:06.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:06 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:08.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:08 smithi033 ceph-mon[42490]: pgmap v167: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:08.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:08 smithi082 ceph-mon[46774]: pgmap v167: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:08.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:08 smithi132 ceph-mon[47484]: pgmap v167: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:09.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:09 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:09.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:09 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:09.878 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:09 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:10.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:10 smithi033 ceph-mon[42490]: pgmap v168: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:10:10.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:10 smithi082 ceph-mon[46774]: pgmap v168: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:10:10.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:10 smithi132 ceph-mon[47484]: pgmap v168: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-05-08T20:10:12.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:12 smithi033 ceph-mon[42490]: pgmap v169: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:12.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:12 smithi082 ceph-mon[46774]: pgmap v169: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:12.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:12 smithi132 ceph-mon[47484]: pgmap v169: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-05-08T20:10:14.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:14 smithi033 ceph-mon[42490]: pgmap v170: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:10:14.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:14 smithi082 ceph-mon[46774]: pgmap v170: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:10:14.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:14 smithi132 ceph-mon[47484]: pgmap v170: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:10:15.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:15 smithi033 ceph-mon[42490]: pgmap v171: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:10:15.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:15 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:15.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:15 smithi082 ceph-mon[46774]: pgmap v171: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:10:15.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:15 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:15.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:15 smithi132 ceph-mon[47484]: pgmap v171: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-05-08T20:10:15.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:15 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:18.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:18 smithi082 ceph-mon[46774]: pgmap v172: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T20:10:18.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:18 smithi132 ceph-mon[47484]: pgmap v172: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T20:10:18.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:18 smithi033 ceph-mon[42490]: pgmap v172: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-05-08T20:10:20.626 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:20 smithi082 ceph-mon[46774]: pgmap v173: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T20:10:20.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:20 smithi132 ceph-mon[47484]: pgmap v173: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T20:10:20.825 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:20 smithi033 ceph-mon[42490]: pgmap v173: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-05-08T20:10:22.629 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:22 smithi132 ceph-mon[47484]: pgmap v174: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:10:22.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:22 smithi033 ceph-mon[42490]: pgmap v174: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:10:22.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:22 smithi082 ceph-mon[46774]: pgmap v174: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:10:24.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:24 smithi033 ceph-mon[42490]: pgmap v175: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:24.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:24 smithi082 ceph-mon[46774]: pgmap v175: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:24.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:24 smithi132 ceph-mon[47484]: pgmap v175: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:26.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:26 smithi033 ceph-mon[42490]: pgmap v176: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:26.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:26 smithi082 ceph-mon[46774]: pgmap v176: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:26.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:26 smithi132 ceph-mon[47484]: pgmap v176: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:28.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:28 smithi033 ceph-mon[42490]: pgmap v177: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:28.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:28 smithi082 ceph-mon[46774]: pgmap v177: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:28.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:28 smithi132 ceph-mon[47484]: pgmap v177: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:30.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:30 smithi033 ceph-mon[42490]: pgmap v178: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:30.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:30 smithi082 ceph-mon[46774]: pgmap v178: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:30.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:30 smithi132 ceph-mon[47484]: pgmap v178: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:32.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:32 smithi033 ceph-mon[42490]: pgmap v179: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:32.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:32 smithi082 ceph-mon[46774]: pgmap v179: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:32.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:32 smithi132 ceph-mon[47484]: pgmap v179: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:34.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:34 smithi033 ceph-mon[42490]: pgmap v180: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:34.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:34 smithi082 ceph-mon[46774]: pgmap v180: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:34.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:34 smithi132 ceph-mon[47484]: pgmap v180: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:36.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:36 smithi033 ceph-mon[42490]: pgmap v181: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:36.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:36 smithi082 ceph-mon[46774]: pgmap v181: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:36.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:36 smithi132 ceph-mon[47484]: pgmap v181: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:38.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:38 smithi033 ceph-mon[42490]: pgmap v182: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:38.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:38 smithi082 ceph-mon[46774]: pgmap v182: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:38.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:38 smithi132 ceph-mon[47484]: pgmap v182: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:39.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:39 smithi033 ceph-mon[42490]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:39.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:39 smithi082 ceph-mon[46774]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:39.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:39 smithi132 ceph-mon[47484]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-05-08T20:10:40.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:40 smithi033 ceph-mon[42490]: pgmap v183: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:40.876 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:40 smithi082 ceph-mon[46774]: pgmap v183: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:40.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:40 smithi132 ceph-mon[47484]: pgmap v183: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:42.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:42 smithi033 ceph-mon[42490]: pgmap v184: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:42.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:42 smithi082 ceph-mon[46774]: pgmap v184: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:42.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:42 smithi132 ceph-mon[47484]: pgmap v184: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:44.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:44 smithi033 ceph-mon[42490]: pgmap v185: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:44.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:44 smithi082 ceph-mon[46774]: pgmap v185: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:44.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:44 smithi132 ceph-mon[47484]: pgmap v185: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:46.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:46 smithi033 ceph-mon[42490]: pgmap v186: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:46.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:46 smithi082 ceph-mon[46774]: pgmap v186: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:46.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:46 smithi132 ceph-mon[47484]: pgmap v186: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:48.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:48 smithi033 ceph-mon[42490]: pgmap v187: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:48.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:48 smithi082 ceph-mon[46774]: pgmap v187: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:48.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:48 smithi132 ceph-mon[47484]: pgmap v187: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:50.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:50 smithi033 ceph-mon[42490]: pgmap v188: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:50.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:50 smithi082 ceph-mon[46774]: pgmap v188: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:50.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:50 smithi132 ceph-mon[47484]: pgmap v188: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:52.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:52 smithi033 ceph-mon[42490]: pgmap v189: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:52.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:52 smithi082 ceph-mon[46774]: pgmap v189: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:52.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:52 smithi132 ceph-mon[47484]: pgmap v189: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:54.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:54 smithi033 ceph-mon[42490]: pgmap v190: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:54.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:54 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:10:54.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:54 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:10:54.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:54 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:10:54.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:54 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:10:54.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:54 smithi082 ceph-mon[46774]: pgmap v190: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:54.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:54 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:10:54.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:54 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:10:54.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:54 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:10:54.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:54 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:10:54.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:54 smithi132 ceph-mon[47484]: pgmap v190: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:54.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:54 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:10:54.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:54 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:10:54.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:54 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:10:54.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:54 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:10:56.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:56 smithi033 ceph-mon[42490]: pgmap v191: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:56.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:56 smithi082 ceph-mon[46774]: pgmap v191: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:56.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:56 smithi132 ceph-mon[47484]: pgmap v191: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:10:58.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:10:58 smithi033 ceph-mon[42490]: pgmap v192: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:58.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:10:58 smithi082 ceph-mon[46774]: pgmap v192: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:10:58.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:10:58 smithi132 ceph-mon[47484]: pgmap v192: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:00.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:00 smithi033 ceph-mon[42490]: pgmap v193: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:00.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:00 smithi082 ceph-mon[46774]: pgmap v193: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:00.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:00 smithi132 ceph-mon[47484]: pgmap v193: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:02.576 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:02 smithi033 ceph-mon[42490]: pgmap v194: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T20:11:02.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:02 smithi082 ceph-mon[46774]: pgmap v194: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T20:11:02.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:02 smithi132 ceph-mon[47484]: pgmap v194: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T20:11:03.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:03 smithi033 ceph-mon[42490]: pgmap v195: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T20:11:03.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:03 smithi082 ceph-mon[46774]: pgmap v195: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T20:11:03.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:03 smithi132 ceph-mon[47484]: pgmap v195: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T20:11:06.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:06 smithi033 ceph-mon[42490]: pgmap v196: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T20:11:06.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:06 smithi082 ceph-mon[46774]: pgmap v196: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T20:11:06.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:06 smithi132 ceph-mon[47484]: pgmap v196: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-05-08T20:11:08.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:08 smithi033 ceph-mon[42490]: pgmap v197: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T20:11:08.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:08 smithi082 ceph-mon[46774]: pgmap v197: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T20:11:08.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:08 smithi132 ceph-mon[47484]: pgmap v197: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-05-08T20:11:09.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:09 smithi033 ceph-mon[42490]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T20:11:09.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:09 smithi082 ceph-mon[46774]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T20:11:09.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:09 smithi132 ceph-mon[47484]: osdmap e87: 12 total, 12 up, 12 in 2024-05-08T20:11:10.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:10 smithi033 ceph-mon[42490]: pgmap v199: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T20:11:10.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:10 smithi082 ceph-mon[46774]: pgmap v199: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T20:11:10.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:10 smithi132 ceph-mon[47484]: pgmap v199: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-05-08T20:11:12.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:12 smithi033 ceph-mon[42490]: pgmap v200: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:12.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:12 smithi082 ceph-mon[46774]: pgmap v200: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:12.879 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:12 smithi132 ceph-mon[47484]: pgmap v200: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:14.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:14 smithi033 ceph-mon[42490]: pgmap v201: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:14.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:14 smithi033 ceph-mon[42490]: osdmap e88: 12 total, 12 up, 12 in 2024-05-08T20:11:14.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:14 smithi082 ceph-mon[46774]: pgmap v201: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:14.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:14 smithi082 ceph-mon[46774]: osdmap e88: 12 total, 12 up, 12 in 2024-05-08T20:11:14.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:14 smithi132 ceph-mon[47484]: pgmap v201: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:14.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:14 smithi132 ceph-mon[47484]: osdmap e88: 12 total, 12 up, 12 in 2024-05-08T20:11:16.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:16 smithi033 ceph-mon[42490]: pgmap v203: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:11:16.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:16 smithi082 ceph-mon[46774]: pgmap v203: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:11:16.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:16 smithi132 ceph-mon[47484]: pgmap v203: 97 pgs: 97 active+clean; 145 MiB data, 1024 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:11:18.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:18 smithi033 ceph-mon[42490]: pgmap v204: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:11:18.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:18 smithi082 ceph-mon[46774]: pgmap v204: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:11:18.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:18 smithi132 ceph-mon[47484]: pgmap v204: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:11:20.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:20 smithi033 ceph-mon[42490]: pgmap v205: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:20.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:20 smithi082 ceph-mon[46774]: pgmap v205: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:20.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:20 smithi132 ceph-mon[47484]: pgmap v205: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:11:22.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:22 smithi033 ceph-mon[42490]: pgmap v206: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:11:22.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:22 smithi082 ceph-mon[46774]: pgmap v206: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:11:22.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:22 smithi132 ceph-mon[47484]: pgmap v206: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:11:24.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:24 smithi033 ceph-mon[42490]: pgmap v207: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:11:24.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:24 smithi082 ceph-mon[46774]: pgmap v207: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:11:24.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:24 smithi132 ceph-mon[47484]: pgmap v207: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:11:26.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:26 smithi033 ceph-mon[42490]: pgmap v208: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:11:26.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:26 smithi082 ceph-mon[46774]: pgmap v208: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:11:26.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:26 smithi132 ceph-mon[47484]: pgmap v208: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:11:28.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:28 smithi033 ceph-mon[42490]: pgmap v209: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:11:28.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:28 smithi082 ceph-mon[46774]: pgmap v209: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:11:28.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:28 smithi132 ceph-mon[47484]: pgmap v209: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:11:30.826 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:30 smithi033 ceph-mon[42490]: pgmap v210: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:30.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:30 smithi082 ceph-mon[46774]: pgmap v210: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:30.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:30 smithi132 ceph-mon[47484]: pgmap v210: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:32.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:32 smithi033 ceph-mon[42490]: pgmap v211: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:32.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:32 smithi082 ceph-mon[46774]: pgmap v211: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:32.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:32 smithi132 ceph-mon[47484]: pgmap v211: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:34.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:34 smithi033 ceph-mon[42490]: pgmap v212: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:34.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:34 smithi082 ceph-mon[46774]: pgmap v212: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:34.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:34 smithi132 ceph-mon[47484]: pgmap v212: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:36.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:36 smithi033 ceph-mon[42490]: pgmap v213: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:36.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:36 smithi082 ceph-mon[46774]: pgmap v213: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:36.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:36 smithi132 ceph-mon[47484]: pgmap v213: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:38.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:38 smithi033 ceph-mon[42490]: pgmap v214: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:38.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:38 smithi082 ceph-mon[46774]: pgmap v214: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:38.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:38 smithi132 ceph-mon[47484]: pgmap v214: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:40.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:40 smithi033 ceph-mon[42490]: pgmap v215: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:40.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:40 smithi082 ceph-mon[46774]: pgmap v215: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:40.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:40 smithi132 ceph-mon[47484]: pgmap v215: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:42.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:42 smithi033 ceph-mon[42490]: pgmap v216: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:42.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:42 smithi082 ceph-mon[46774]: pgmap v216: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:42.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:42 smithi132 ceph-mon[47484]: pgmap v216: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:44.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:44 smithi033 ceph-mon[42490]: pgmap v217: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:44.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:44 smithi082 ceph-mon[46774]: pgmap v217: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:44.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:44 smithi132 ceph-mon[47484]: pgmap v217: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:46.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:46 smithi033 ceph-mon[42490]: pgmap v218: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:46.877 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:46 smithi082 ceph-mon[46774]: pgmap v218: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:46.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:46 smithi132 ceph-mon[47484]: pgmap v218: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:48.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:48 smithi033 ceph-mon[42490]: pgmap v219: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:48.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:48 smithi082 ceph-mon[46774]: pgmap v219: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:48.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:48 smithi132 ceph-mon[47484]: pgmap v219: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:49.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:49 smithi033 ceph-mon[42490]: pgmap v220: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:49.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:49 smithi082 ceph-mon[46774]: pgmap v220: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:49.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:49 smithi132 ceph-mon[47484]: pgmap v220: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:52.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:52 smithi033 ceph-mon[42490]: pgmap v221: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:52.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:52 smithi082 ceph-mon[46774]: pgmap v221: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:52.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:52 smithi132 ceph-mon[47484]: pgmap v221: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:54.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:54 smithi033 ceph-mon[42490]: pgmap v222: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:54.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:54 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:11:54.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:54 smithi082 ceph-mon[46774]: pgmap v222: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:54.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:54 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:11:54.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:54 smithi132 ceph-mon[47484]: pgmap v222: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:54.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:54 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:11:55.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:55 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:11:55.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:55 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:11:55.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:55 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:11:55.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:55 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:11:55.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:55 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:11:55.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:55 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:11:55.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:55 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:11:55.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:55 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:11:55.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:55 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:11:56.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:56 smithi033 ceph-mon[42490]: pgmap v223: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:56.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:56 smithi082 ceph-mon[46774]: pgmap v223: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:56.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:56 smithi132 ceph-mon[47484]: pgmap v223: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:11:58.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:11:58 smithi033 ceph-mon[42490]: pgmap v224: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:58.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:11:58 smithi082 ceph-mon[46774]: pgmap v224: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:11:58.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:11:58 smithi132 ceph-mon[47484]: pgmap v224: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:00.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:00 smithi033 ceph-mon[42490]: pgmap v225: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:00.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:00 smithi082 ceph-mon[46774]: pgmap v225: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:00.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:00 smithi132 ceph-mon[47484]: pgmap v225: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:02.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:02 smithi033 ceph-mon[42490]: pgmap v226: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:12:02.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:02 smithi082 ceph-mon[46774]: pgmap v226: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:12:02.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:02 smithi132 ceph-mon[47484]: pgmap v226: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:12:04.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:04 smithi033 ceph-mon[42490]: pgmap v227: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:12:04.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:04 smithi082 ceph-mon[46774]: pgmap v227: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:12:04.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:04 smithi132 ceph-mon[47484]: pgmap v227: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:12:06.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:06 smithi033 ceph-mon[42490]: pgmap v228: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:12:06.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:06 smithi082 ceph-mon[46774]: pgmap v228: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:12:06.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:06 smithi132 ceph-mon[47484]: pgmap v228: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:12:08.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:08 smithi033 ceph-mon[42490]: pgmap v229: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:12:08.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:08 smithi082 ceph-mon[46774]: pgmap v229: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:12:08.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:08 smithi132 ceph-mon[47484]: pgmap v229: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:12:09.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:09 smithi033 ceph-mon[42490]: osdmap e89: 12 total, 12 up, 12 in 2024-05-08T20:12:09.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:09 smithi082 ceph-mon[46774]: osdmap e89: 12 total, 12 up, 12 in 2024-05-08T20:12:09.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:09 smithi132 ceph-mon[47484]: osdmap e89: 12 total, 12 up, 12 in 2024-05-08T20:12:10.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:10 smithi033 ceph-mon[42490]: pgmap v231: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:12:10.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:10 smithi082 ceph-mon[46774]: pgmap v231: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:12:10.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:10 smithi132 ceph-mon[47484]: pgmap v231: 97 pgs: 97 active+clean; 145 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:12:12.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:12 smithi033 ceph-mon[42490]: pgmap v232: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:12.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:12 smithi082 ceph-mon[46774]: pgmap v232: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:12.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:12 smithi132 ceph-mon[47484]: pgmap v232: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:14.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:14 smithi033 ceph-mon[42490]: pgmap v233: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:14.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:14 smithi033 ceph-mon[42490]: osdmap e90: 12 total, 12 up, 12 in 2024-05-08T20:12:14.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:14 smithi082 ceph-mon[46774]: pgmap v233: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:14.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:14 smithi082 ceph-mon[46774]: osdmap e90: 12 total, 12 up, 12 in 2024-05-08T20:12:14.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:14 smithi132 ceph-mon[47484]: pgmap v233: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:14.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:14 smithi132 ceph-mon[47484]: osdmap e90: 12 total, 12 up, 12 in 2024-05-08T20:12:16.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:16 smithi033 ceph-mon[42490]: pgmap v235: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:12:16.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:16 smithi082 ceph-mon[46774]: pgmap v235: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:12:16.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:16 smithi132 ceph-mon[47484]: pgmap v235: 97 pgs: 97 active+clean; 145 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:12:18.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:18 smithi033 ceph-mon[42490]: pgmap v236: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:12:18.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:18 smithi082 ceph-mon[46774]: pgmap v236: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:12:18.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:18 smithi132 ceph-mon[47484]: pgmap v236: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:12:20.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:20 smithi033 ceph-mon[42490]: pgmap v237: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:20.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:20 smithi082 ceph-mon[46774]: pgmap v237: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:20.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:20 smithi132 ceph-mon[47484]: pgmap v237: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:12:22.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:22 smithi033 ceph-mon[42490]: pgmap v238: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:12:22.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:22 smithi082 ceph-mon[46774]: pgmap v238: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:12:22.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:22 smithi132 ceph-mon[47484]: pgmap v238: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:12:24.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:24 smithi033 ceph-mon[42490]: pgmap v239: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:12:24.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:24 smithi082 ceph-mon[46774]: pgmap v239: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:12:24.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:24 smithi132 ceph-mon[47484]: pgmap v239: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:12:26.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:26 smithi033 ceph-mon[42490]: pgmap v240: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:12:26.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:26 smithi082 ceph-mon[46774]: pgmap v240: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:12:26.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:26 smithi132 ceph-mon[47484]: pgmap v240: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:12:28.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:28 smithi033 ceph-mon[42490]: pgmap v241: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:12:28.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:28 smithi082 ceph-mon[46774]: pgmap v241: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:12:28.880 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:28 smithi132 ceph-mon[47484]: pgmap v241: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:12:29.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:29 smithi033 ceph-mon[42490]: pgmap v242: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:29.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:29 smithi082 ceph-mon[46774]: pgmap v242: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:29.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:29 smithi132 ceph-mon[47484]: pgmap v242: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:32.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:32 smithi033 ceph-mon[42490]: pgmap v243: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:32.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:32 smithi082 ceph-mon[46774]: pgmap v243: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:32.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:32 smithi132 ceph-mon[47484]: pgmap v243: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:34.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:34 smithi033 ceph-mon[42490]: pgmap v244: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:34.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:34 smithi082 ceph-mon[46774]: pgmap v244: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:34.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:34 smithi132 ceph-mon[47484]: pgmap v244: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:36.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:36 smithi033 ceph-mon[42490]: pgmap v245: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:36.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:36 smithi082 ceph-mon[46774]: pgmap v245: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:36.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:36 smithi132 ceph-mon[47484]: pgmap v245: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:38.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:38 smithi033 ceph-mon[42490]: pgmap v246: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:38.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:38 smithi082 ceph-mon[46774]: pgmap v246: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:38.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:38 smithi132 ceph-mon[47484]: pgmap v246: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:40.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:40 smithi033 ceph-mon[42490]: pgmap v247: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:40.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:40 smithi082 ceph-mon[46774]: pgmap v247: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:40.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:40 smithi132 ceph-mon[47484]: pgmap v247: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:42.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:42 smithi033 ceph-mon[42490]: pgmap v248: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:42.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:42 smithi082 ceph-mon[46774]: pgmap v248: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:42.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:42 smithi132 ceph-mon[47484]: pgmap v248: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:44.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:44 smithi033 ceph-mon[42490]: pgmap v249: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:44.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:44 smithi082 ceph-mon[46774]: pgmap v249: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:44.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:44 smithi132 ceph-mon[47484]: pgmap v249: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:46.827 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:46 smithi033 ceph-mon[42490]: pgmap v250: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:46.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:46 smithi082 ceph-mon[46774]: pgmap v250: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:46.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:46 smithi132 ceph-mon[47484]: pgmap v250: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:48.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:48 smithi033 ceph-mon[42490]: pgmap v251: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:48.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:48 smithi082 ceph-mon[46774]: pgmap v251: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:48.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:48 smithi132 ceph-mon[47484]: pgmap v251: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:50.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:50 smithi033 ceph-mon[42490]: pgmap v252: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:50.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:50 smithi082 ceph-mon[46774]: pgmap v252: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:50.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:50 smithi132 ceph-mon[47484]: pgmap v252: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:52.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:52 smithi033 ceph-mon[42490]: pgmap v253: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:52.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:52 smithi082 ceph-mon[46774]: pgmap v253: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:52.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:52 smithi132 ceph-mon[47484]: pgmap v253: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:54.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:54 smithi033 ceph-mon[42490]: pgmap v254: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:54.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:54 smithi082 ceph-mon[46774]: pgmap v254: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:54.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:54 smithi132 ceph-mon[47484]: pgmap v254: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:55.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:55 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:12:55.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:55 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:12:55.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:55 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:12:55.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:55 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:12:55.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:55 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:12:55.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:55 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:12:55.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:55 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:12:55.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:55 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:12:55.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:55 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:12:55.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:55 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:12:55.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:55 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:12:55.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:55 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:12:56.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:56 smithi033 ceph-mon[42490]: pgmap v255: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:56.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:56 smithi082 ceph-mon[46774]: pgmap v255: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:56.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:56 smithi132 ceph-mon[47484]: pgmap v255: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:12:58.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:12:58 smithi033 ceph-mon[42490]: pgmap v256: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:58.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:12:58 smithi082 ceph-mon[46774]: pgmap v256: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:12:58.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:12:58 smithi132 ceph-mon[47484]: pgmap v256: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:00.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:00 smithi033 ceph-mon[42490]: pgmap v257: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:00.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:00 smithi082 ceph-mon[46774]: pgmap v257: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:00.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:00 smithi132 ceph-mon[47484]: pgmap v257: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:02.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:02 smithi033 ceph-mon[42490]: pgmap v258: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:13:02.878 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:02 smithi082 ceph-mon[46774]: pgmap v258: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:13:02.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:02 smithi132 ceph-mon[47484]: pgmap v258: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:13:04.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:04 smithi033 ceph-mon[42490]: pgmap v259: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:13:04.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:04 smithi082 ceph-mon[46774]: pgmap v259: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:13:04.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:04 smithi132 ceph-mon[47484]: pgmap v259: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:13:06.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:06 smithi033 ceph-mon[42490]: pgmap v260: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:13:06.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:06 smithi082 ceph-mon[46774]: pgmap v260: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:13:06.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:06 smithi132 ceph-mon[47484]: pgmap v260: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:13:08.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:08 smithi033 ceph-mon[42490]: pgmap v261: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:13:08.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:08 smithi082 ceph-mon[46774]: pgmap v261: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:13:08.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:08 smithi132 ceph-mon[47484]: pgmap v261: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:13:09.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:09 smithi033 ceph-mon[42490]: osdmap e91: 12 total, 12 up, 12 in 2024-05-08T20:13:09.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:09 smithi082 ceph-mon[46774]: osdmap e91: 12 total, 12 up, 12 in 2024-05-08T20:13:09.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:09 smithi132 ceph-mon[47484]: osdmap e91: 12 total, 12 up, 12 in 2024-05-08T20:13:10.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:10 smithi033 ceph-mon[42490]: pgmap v263: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:13:10.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:10 smithi082 ceph-mon[46774]: pgmap v263: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:13:10.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:10 smithi132 ceph-mon[47484]: pgmap v263: 97 pgs: 97 active+clean; 145 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:13:11.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:11 smithi033 ceph-mon[42490]: pgmap v264: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:11.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:11 smithi082 ceph-mon[46774]: pgmap v264: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:11.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:11 smithi132 ceph-mon[47484]: pgmap v264: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:14.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:14 smithi033 ceph-mon[42490]: pgmap v265: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:14.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:14 smithi033 ceph-mon[42490]: osdmap e92: 12 total, 12 up, 12 in 2024-05-08T20:13:14.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:14 smithi082 ceph-mon[46774]: pgmap v265: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:14.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:14 smithi082 ceph-mon[46774]: osdmap e92: 12 total, 12 up, 12 in 2024-05-08T20:13:14.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:14 smithi132 ceph-mon[47484]: pgmap v265: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:14.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:14 smithi132 ceph-mon[47484]: osdmap e92: 12 total, 12 up, 12 in 2024-05-08T20:13:16.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:16 smithi033 ceph-mon[42490]: pgmap v267: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:13:16.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:16 smithi082 ceph-mon[46774]: pgmap v267: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:13:16.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:16 smithi132 ceph-mon[47484]: pgmap v267: 97 pgs: 97 active+clean; 25 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:13:18.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:18 smithi033 ceph-mon[42490]: pgmap v268: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 230 B/s wr, 7 op/s 2024-05-08T20:13:18.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:18 smithi082 ceph-mon[46774]: pgmap v268: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 230 B/s wr, 7 op/s 2024-05-08T20:13:18.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:18 smithi132 ceph-mon[47484]: pgmap v268: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 230 B/s wr, 7 op/s 2024-05-08T20:13:20.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:20 smithi033 ceph-mon[42490]: pgmap v269: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:20.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:20 smithi082 ceph-mon[46774]: pgmap v269: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:20.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:20 smithi132 ceph-mon[47484]: pgmap v269: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:13:22.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:22 smithi033 ceph-mon[42490]: pgmap v270: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:13:22.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:22 smithi082 ceph-mon[46774]: pgmap v270: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:13:22.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:22 smithi132 ceph-mon[47484]: pgmap v270: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:13:24.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:24 smithi033 ceph-mon[42490]: pgmap v271: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:13:24.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:24 smithi082 ceph-mon[46774]: pgmap v271: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:13:24.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:24 smithi132 ceph-mon[47484]: pgmap v271: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:13:26.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:26 smithi033 ceph-mon[42490]: pgmap v272: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:13:26.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:26 smithi082 ceph-mon[46774]: pgmap v272: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:13:26.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:26 smithi132 ceph-mon[47484]: pgmap v272: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:13:28.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:28 smithi033 ceph-mon[42490]: pgmap v273: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:13:28.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:28 smithi082 ceph-mon[46774]: pgmap v273: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:13:28.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:28 smithi132 ceph-mon[47484]: pgmap v273: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:13:30.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:30 smithi033 ceph-mon[42490]: pgmap v274: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:30.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:30 smithi082 ceph-mon[46774]: pgmap v274: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:30.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:30 smithi132 ceph-mon[47484]: pgmap v274: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:32.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:32 smithi033 ceph-mon[42490]: pgmap v275: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:32.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:32 smithi082 ceph-mon[46774]: pgmap v275: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:32.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:32 smithi132 ceph-mon[47484]: pgmap v275: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:34.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:34 smithi033 ceph-mon[42490]: pgmap v276: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:34.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:34 smithi082 ceph-mon[46774]: pgmap v276: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:34.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:34 smithi132 ceph-mon[47484]: pgmap v276: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:36.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:36 smithi033 ceph-mon[42490]: pgmap v277: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:36.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:36 smithi082 ceph-mon[46774]: pgmap v277: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:36.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:36 smithi132 ceph-mon[47484]: pgmap v277: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:38.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:38 smithi033 ceph-mon[42490]: pgmap v278: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:38.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:38 smithi082 ceph-mon[46774]: pgmap v278: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:38.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:38 smithi132 ceph-mon[47484]: pgmap v278: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:40.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:40 smithi033 ceph-mon[42490]: pgmap v279: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:40.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:40 smithi082 ceph-mon[46774]: pgmap v279: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:40.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:40 smithi132 ceph-mon[47484]: pgmap v279: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:42.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:42 smithi033 ceph-mon[42490]: pgmap v280: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:42.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:42 smithi082 ceph-mon[46774]: pgmap v280: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:42.881 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:42 smithi132 ceph-mon[47484]: pgmap v280: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:44.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:44 smithi033 ceph-mon[42490]: pgmap v281: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:44.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:44 smithi082 ceph-mon[46774]: pgmap v281: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:44.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:44 smithi132 ceph-mon[47484]: pgmap v281: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:46.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:46 smithi033 ceph-mon[42490]: pgmap v282: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:46.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:46 smithi082 ceph-mon[46774]: pgmap v282: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:46.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:46 smithi132 ceph-mon[47484]: pgmap v282: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:48.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:48 smithi033 ceph-mon[42490]: pgmap v283: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:48.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:48 smithi082 ceph-mon[46774]: pgmap v283: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:48.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:48 smithi132 ceph-mon[47484]: pgmap v283: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:50.828 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:50 smithi033 ceph-mon[42490]: pgmap v284: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:50.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:50 smithi082 ceph-mon[46774]: pgmap v284: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:50.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:50 smithi132 ceph-mon[47484]: pgmap v284: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:52.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:52 smithi033 ceph-mon[42490]: pgmap v285: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:52.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:52 smithi082 ceph-mon[46774]: pgmap v285: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:52.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:52 smithi132 ceph-mon[47484]: pgmap v285: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:53.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:53 smithi033 ceph-mon[42490]: pgmap v286: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:53.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:53 smithi082 ceph-mon[46774]: pgmap v286: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:53.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:53 smithi132 ceph-mon[47484]: pgmap v286: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:56.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:56 smithi033 ceph-mon[42490]: pgmap v287: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:56.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:56 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:13:56.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:56 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:13:56.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:56 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:13:56.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:56 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:13:56.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:56 smithi082 ceph-mon[46774]: pgmap v287: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:56.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:56 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:13:56.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:56 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:13:56.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:56 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:13:56.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:56 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:13:56.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:56 smithi132 ceph-mon[47484]: pgmap v287: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:13:56.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:56 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:13:56.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:56 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:13:56.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:56 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:13:56.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:56 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:13:58.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:13:58 smithi033 ceph-mon[42490]: pgmap v288: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:58.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:13:58 smithi082 ceph-mon[46774]: pgmap v288: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:13:58.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:13:58 smithi132 ceph-mon[47484]: pgmap v288: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:00.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:00 smithi033 ceph-mon[42490]: pgmap v289: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:00.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:00 smithi082 ceph-mon[46774]: pgmap v289: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:00.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:00 smithi132 ceph-mon[47484]: pgmap v289: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:02.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:02 smithi033 ceph-mon[42490]: pgmap v290: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:14:02.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:02 smithi082 ceph-mon[46774]: pgmap v290: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:14:02.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:02 smithi132 ceph-mon[47484]: pgmap v290: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:14:04.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:04 smithi033 ceph-mon[42490]: pgmap v291: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:14:04.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:04 smithi082 ceph-mon[46774]: pgmap v291: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:14:04.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:04 smithi132 ceph-mon[47484]: pgmap v291: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:14:06.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:06 smithi033 ceph-mon[42490]: pgmap v292: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:14:06.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:06 smithi082 ceph-mon[46774]: pgmap v292: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:14:06.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:06 smithi132 ceph-mon[47484]: pgmap v292: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:14:08.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:08 smithi033 ceph-mon[42490]: pgmap v293: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:14:08.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:08 smithi082 ceph-mon[46774]: pgmap v293: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:14:08.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:08 smithi132 ceph-mon[47484]: pgmap v293: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:14:09.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:09 smithi033 ceph-mon[42490]: osdmap e93: 12 total, 12 up, 12 in 2024-05-08T20:14:09.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:09 smithi082 ceph-mon[46774]: osdmap e93: 12 total, 12 up, 12 in 2024-05-08T20:14:09.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:09 smithi132 ceph-mon[47484]: osdmap e93: 12 total, 12 up, 12 in 2024-05-08T20:14:10.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:10 smithi033 ceph-mon[42490]: pgmap v295: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:14:10.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:10 smithi082 ceph-mon[46774]: pgmap v295: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:14:10.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:10 smithi132 ceph-mon[47484]: pgmap v295: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:14:12.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:12 smithi033 ceph-mon[42490]: pgmap v296: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:12.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:12 smithi082 ceph-mon[46774]: pgmap v296: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:12.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:12 smithi132 ceph-mon[47484]: pgmap v296: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:14.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:14 smithi033 ceph-mon[42490]: pgmap v297: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:14.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:14 smithi033 ceph-mon[42490]: osdmap e94: 12 total, 12 up, 12 in 2024-05-08T20:14:14.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:14 smithi082 ceph-mon[46774]: pgmap v297: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:14.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:14 smithi082 ceph-mon[46774]: osdmap e94: 12 total, 12 up, 12 in 2024-05-08T20:14:14.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:14 smithi132 ceph-mon[47484]: pgmap v297: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:14.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:14 smithi132 ceph-mon[47484]: osdmap e94: 12 total, 12 up, 12 in 2024-05-08T20:14:16.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:16 smithi033 ceph-mon[42490]: pgmap v299: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:14:16.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:16 smithi082 ceph-mon[46774]: pgmap v299: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:14:16.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:16 smithi132 ceph-mon[47484]: pgmap v299: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:14:18.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:18 smithi033 ceph-mon[42490]: pgmap v300: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:14:18.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:18 smithi082 ceph-mon[46774]: pgmap v300: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:14:18.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:18 smithi132 ceph-mon[47484]: pgmap v300: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 229 B/s wr, 7 op/s 2024-05-08T20:14:20.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:20 smithi033 ceph-mon[42490]: pgmap v301: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:20.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:20 smithi082 ceph-mon[46774]: pgmap v301: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:20.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:20 smithi132 ceph-mon[47484]: pgmap v301: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:14:22.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:22 smithi033 ceph-mon[42490]: pgmap v302: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:14:22.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:22 smithi082 ceph-mon[46774]: pgmap v302: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:14:22.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:22 smithi132 ceph-mon[47484]: pgmap v302: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:14:23.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:23 smithi033 ceph-mon[42490]: pgmap v303: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:14:23.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:23 smithi082 ceph-mon[46774]: pgmap v303: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:14:23.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:23 smithi132 ceph-mon[47484]: pgmap v303: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-05-08T20:14:26.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:26 smithi033 ceph-mon[42490]: pgmap v304: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:14:26.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:26 smithi082 ceph-mon[46774]: pgmap v304: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:14:26.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:26 smithi132 ceph-mon[47484]: pgmap v304: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 91 B/s wr, 5 op/s 2024-05-08T20:14:28.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:28 smithi033 ceph-mon[42490]: pgmap v305: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:14:28.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:28 smithi082 ceph-mon[46774]: pgmap v305: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:14:28.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:28 smithi132 ceph-mon[47484]: pgmap v305: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-05-08T20:14:30.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:30 smithi033 ceph-mon[42490]: pgmap v306: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:30.879 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:30 smithi082 ceph-mon[46774]: pgmap v306: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:30.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:30 smithi132 ceph-mon[47484]: pgmap v306: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:32.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:32 smithi033 ceph-mon[42490]: pgmap v307: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:32.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:32 smithi082 ceph-mon[46774]: pgmap v307: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:32.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:32 smithi132 ceph-mon[47484]: pgmap v307: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:34.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:34 smithi033 ceph-mon[42490]: pgmap v308: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:34.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:34 smithi082 ceph-mon[46774]: pgmap v308: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:34.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:34 smithi132 ceph-mon[47484]: pgmap v308: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:36.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:36 smithi033 ceph-mon[42490]: pgmap v309: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:36.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:36 smithi082 ceph-mon[46774]: pgmap v309: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:36.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:36 smithi132 ceph-mon[47484]: pgmap v309: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:38.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:38 smithi033 ceph-mon[42490]: pgmap v310: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:38.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:38 smithi082 ceph-mon[46774]: pgmap v310: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:38.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:38 smithi132 ceph-mon[47484]: pgmap v310: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:40.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:40 smithi033 ceph-mon[42490]: pgmap v311: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:40.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:40 smithi082 ceph-mon[46774]: pgmap v311: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:40.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:40 smithi132 ceph-mon[47484]: pgmap v311: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:42.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:42 smithi033 ceph-mon[42490]: pgmap v312: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:42.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:42 smithi082 ceph-mon[46774]: pgmap v312: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:42.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:42 smithi132 ceph-mon[47484]: pgmap v312: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:44.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:44 smithi033 ceph-mon[42490]: pgmap v313: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:44.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:44 smithi082 ceph-mon[46774]: pgmap v313: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:44.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:44 smithi132 ceph-mon[47484]: pgmap v313: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:46.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:46 smithi033 ceph-mon[42490]: pgmap v314: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:46.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:46 smithi082 ceph-mon[46774]: pgmap v314: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:46.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:46 smithi132 ceph-mon[47484]: pgmap v314: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:48.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-08T20:14:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 -- 172.21.15.33:0/40782853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 msgr2=0x7fe06c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 --2- 172.21.15.33:0/40782853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c1006d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009990 tx=0x7fe05c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.288 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 -- 172.21.15.33:0/40782853 shutdown_connections 2024-05-08T20:14:48.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 --2- 172.21.15.33:0/40782853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe06c105130 0x7fe06c10ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 --2- 172.21.15.33:0/40782853 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c1006d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 --2- 172.21.15.33:0/40782853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe06c100ca0 0x7fe06c104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 -- 172.21.15.33:0/40782853 >> 172.21.15.33:0/40782853 conn(0x7fe06c076c00 msgr2=0x7fe06c077010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:48.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 -- 172.21.15.33:0/40782853 shutdown_connections 2024-05-08T20:14:48.289 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.284+0000 7fe072477700 1 -- 172.21.15.33:0/40782853 wait complete. 2024-05-08T20:14:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.285+0000 7fe072477700 1 Processor -- start 2024-05-08T20:14:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.285+0000 7fe072477700 1 -- start start 2024-05-08T20:14:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe072477700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c101a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe072477700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe06c105130 0x7fe06c101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe072477700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe06c102500 0x7fe06c1a5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.290 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe072477700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c1a5bd0 con 0x7fe06c1002f0 2024-05-08T20:14:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe072477700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c1a5d40 con 0x7fe06c102500 2024-05-08T20:14:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe072477700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c1a5f00 con 0x7fe06c105130 2024-05-08T20:14:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c101a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c101a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46192/0 (socket says 172.21.15.33:46192) 2024-05-08T20:14:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 -- 172.21.15.33:0/2105929368 learned_addr learned my addr 172.21.15.33:0/2105929368 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:14:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06b7fe700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe06c105130 0x7fe06c101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe070a14700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe06c102500 0x7fe06c1a5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 -- 172.21.15.33:0/2105929368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe06c105130 msgr2=0x7fe06c101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe06c105130 0x7fe06c101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 -- 172.21.15.33:0/2105929368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe06c102500 msgr2=0x7fe06c1a5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe06c102500 0x7fe06c1a5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 -- 172.21.15.33:0/2105929368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c0095f0 con 0x7fe06c1002f0 2024-05-08T20:14:48.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe070a14700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe06c102500 0x7fe06c1a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:14:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe06bfff700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c101a80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe05c005910 tx=0x7fe05c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe0697fa700 1 -- 172.21.15.33:0/2105929368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c01d070 con 0x7fe06c1002f0 2024-05-08T20:14:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe06c1a6180 con 0x7fe06c1002f0 2024-05-08T20:14:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe0697fa700 1 -- 172.21.15.33:0/2105929368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe05c003680 con 0x7fe06c1002f0 2024-05-08T20:14:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.286+0000 7fe0697fa700 1 -- 172.21.15.33:0/2105929368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c017650 con 0x7fe06c1002f0 2024-05-08T20:14:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.287+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe06c1a65a0 con 0x7fe06c1002f0 2024-05-08T20:14:48.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.287+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06c109390 con 0x7fe06c1002f0 2024-05-08T20:14:48.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.289+0000 7fe0697fa700 1 -- 172.21.15.33:0/2105929368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fe05c022470 con 0x7fe06c1002f0 2024-05-08T20:14:48.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.290+0000 7fe0697fa700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fe0580a1290 0x7fe0580a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.290+0000 7fe06b7fe700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fe0580a1290 0x7fe0580a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.290+0000 7fe0697fa700 1 -- 172.21.15.33:0/2105929368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8672+0+0 (secure 0 0 0) 0x7fe05c0ce390 con 0x7fe06c1002f0 2024-05-08T20:14:48.294 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.290+0000 7fe06b7fe700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fe0580a1290 0x7fe0580a3750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe054005fd0 tx=0x7fe05400a560 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:48.295 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.294+0000 7fe0697fa700 1 -- 172.21.15.33:0/2105929368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fe05c0977e0 con 0x7fe06c1002f0 2024-05-08T20:14:48.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.538+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 --> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fe06c102f60 con 0x7fe0580a1290 2024-05-08T20:14:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.547+0000 7fe0697fa700 1 -- 172.21.15.33:0/2105929368 <== mgr.15264 v2:172.21.15.33:6800/1417363085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+350 (secure 0 0 0) 0x7fe06c102f60 con 0x7fe0580a1290 2024-05-08T20:14:48.545 INFO:teuthology.orchestra.run.smithi033.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-08T00:00:00", "created": "2024-05-08T20:04:47", "first": "2024-05-08T20:05:00", "last": "2024-05-08T20:14:00", "last_pruned": "2024-05-08T20:14:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fe0580a1290 msgr2=0x7fe0580a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fe0580a1290 0x7fe0580a3750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe054005fd0 tx=0x7fe05400a560 comp rx=0 tx=0).stop 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 msgr2=0x7fe06c101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c101a80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe05c005910 tx=0x7fe05c00f740 comp rx=0 tx=0).stop 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 shutdown_connections 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe06c102500 0x7fe06c1a5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fe0580a1290 0x7fe0580a3750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe06c1002f0 0x7fe06c101a80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 --2- 172.21.15.33:0/2105929368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe06c105130 0x7fe06c101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 >> 172.21.15.33:0/2105929368 conn(0x7fe06c076c00 msgr2=0x7fe06c069930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:48.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 shutdown_connections 2024-05-08T20:14:48.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.550+0000 7fe072477700 1 -- 172.21.15.33:0/2105929368 wait complete. 2024-05-08T20:14:48.561 DEBUG:teuthology.orchestra.run.smithi033:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-08T20:14:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 -- 172.21.15.33:0/3622190863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff80069df0 msgr2=0x7eff80105b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 --2- 172.21.15.33:0/3622190863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff80069df0 0x7eff80105b20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7eff680099c0 tx=0x7eff68009cd0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 -- 172.21.15.33:0/3622190863 shutdown_connections 2024-05-08T20:14:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 --2- 172.21.15.33:0/3622190863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff80106250 0x7eff8010ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 --2- 172.21.15.33:0/3622190863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff80069440 0x7eff80069820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 --2- 172.21.15.33:0/3622190863 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff80069df0 0x7eff80105b20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 -- 172.21.15.33:0/3622190863 >> 172.21.15.33:0/3622190863 conn(0x7eff80076f40 msgr2=0x7eff80077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 -- 172.21.15.33:0/3622190863 shutdown_connections 2024-05-08T20:14:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.702+0000 7eff8616c700 1 -- 172.21.15.33:0/3622190863 wait complete. 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.703+0000 7eff8616c700 1 Processor -- start 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.703+0000 7eff8616c700 1 -- start start 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.703+0000 7eff8616c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff80069440 0x7eff80197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.703+0000 7eff8616c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff80106250 0x7eff80197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff8616c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff8019bd20 0x7eff8019c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff8616c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8019c7a0 con 0x7eff8019bd20 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff8616c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8019c910 con 0x7eff80106250 2024-05-08T20:14:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff8616c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8019cad0 con 0x7eff80069440 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff8019bd20 0x7eff8019c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff8019bd20 0x7eff8019c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46206/0 (socket says 172.21.15.33:46206) 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 -- 172.21.15.33:0/1765670705 learned_addr learned my addr 172.21.15.33:0/1765670705 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7f7fe700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff80069440 0x7eff80197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7effd700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff80106250 0x7eff80197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 -- 172.21.15.33:0/1765670705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff80069440 msgr2=0x7eff80197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff80069440 0x7eff80197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 -- 172.21.15.33:0/1765670705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff80106250 msgr2=0x7eff80197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff80106250 0x7eff80197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 -- 172.21.15.33:0/1765670705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff680095f0 con 0x7eff8019bd20 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7ffff700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff8019bd20 0x7eff8019c1a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff78007ee0 tx=0x7eff7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7cff9700 1 -- 172.21.15.33:0/1765670705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78017070 con 0x7eff8019bd20 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7cff9700 1 -- 172.21.15.33:0/1765670705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7eff7800f040 con 0x7eff8019bd20 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff801a3fd0 con 0x7eff8019bd20 2024-05-08T20:14:48.704 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.704+0000 7eff7cff9700 1 -- 172.21.15.33:0/1765670705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78005610 con 0x7eff8019bd20 2024-05-08T20:14:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.705+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff801a44b0 con 0x7eff8019bd20 2024-05-08T20:14:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.706+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff801094b0 con 0x7eff8019bd20 2024-05-08T20:14:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.707+0000 7eff7cff9700 1 -- 172.21.15.33:0/1765670705 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7eff78005770 con 0x7eff8019bd20 2024-05-08T20:14:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.707+0000 7eff7cff9700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7eff6c0a1290 0x7eff6c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:48.705 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.707+0000 7eff7f7fe700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7eff6c0a1290 0x7eff6c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.707+0000 7eff7cff9700 1 -- 172.21.15.33:0/1765670705 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8672+0+0 (secure 0 0 0) 0x7eff780cca30 con 0x7eff8019bd20 2024-05-08T20:14:48.706 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.708+0000 7eff7f7fe700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7eff6c0a1290 0x7eff6c0a3750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff70005950 tx=0x7eff7000b410 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:48.709 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.711+0000 7eff7cff9700 1 -- 172.21.15.33:0/1765670705 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7eff78095df0 con 0x7eff8019bd20 2024-05-08T20:14:48.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:48 smithi033 ceph-mon[42490]: pgmap v315: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:48.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:48 smithi082 ceph-mon[46774]: pgmap v315: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:48.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:48 smithi132 ceph-mon[47484]: pgmap v315: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-05-08T20:14:48.958 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.960+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 --> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7eff80198850 con 0x7eff6c0a1290 2024-05-08T20:14:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.968+0000 7eff7cff9700 1 -- 172.21.15.33:0/1765670705 <== mgr.15264 v2:172.21.15.33:6800/1417363085 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7eff80198850 con 0x7eff6c0a1290 2024-05-08T20:14:48.966 INFO:teuthology.orchestra.run.smithi033.stdout:/ 1m 6m3h 2024-05-08T20:14:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7eff6c0a1290 msgr2=0x7eff6c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7eff6c0a1290 0x7eff6c0a3750 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff70005950 tx=0x7eff7000b410 comp rx=0 tx=0).stop 2024-05-08T20:14:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff8019bd20 msgr2=0x7eff8019c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff8019bd20 0x7eff8019c1a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff78007ee0 tx=0x7eff7800d3b0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 shutdown_connections 2024-05-08T20:14:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7eff6c0a1290 0x7eff6c0a3750 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff8019bd20 0x7eff8019c1a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff80069440 0x7eff80197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 --2- 172.21.15.33:0/1765670705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff80106250 0x7eff80197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 >> 172.21.15.33:0/1765670705 conn(0x7eff80076f40 msgr2=0x7eff800fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 shutdown_connections 2024-05-08T20:14:48.969 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:48.970+0000 7eff8616c700 1 -- 172.21.15.33:0/1765670705 wait complete. 2024-05-08T20:14:48.982 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-08T20:14:49.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 -- 172.21.15.33:0/1154152333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a41005a0 msgr2=0x7f72a410d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 --2- 172.21.15.33:0/1154152333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a41005a0 0x7f72a410d1d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7294009990 tx=0x7f7294009ca0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 -- 172.21.15.33:0/1154152333 shutdown_connections 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 --2- 172.21.15.33:0/1154152333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72a410d7a0 0x7f72a410fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 --2- 172.21.15.33:0/1154152333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a40ffbf0 0x7f72a40fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 --2- 172.21.15.33:0/1154152333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a41005a0 0x7f72a410d1d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 -- 172.21.15.33:0/1154152333 >> 172.21.15.33:0/1154152333 conn(0x7f72a40fb840 msgr2=0x7f72a40fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 -- 172.21.15.33:0/1154152333 shutdown_connections 2024-05-08T20:14:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 -- 172.21.15.33:0/1154152333 wait complete. 2024-05-08T20:14:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 Processor -- start 2024-05-08T20:14:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.143+0000 7f72abd47700 1 -- start start 2024-05-08T20:14:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72abd47700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72a40ffbf0 0x7f72a4199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72abd47700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a41005a0 0x7f72a4199b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72abd47700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a410d7a0 0x7f72a419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72abd47700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a419e530 con 0x7f72a410d7a0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72abd47700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a419e6a0 con 0x7f72a40ffbf0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72abd47700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a419e860 con 0x7f72a41005a0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a410d7a0 0x7f72a419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a410d7a0 0x7f72a419def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46228/0 (socket says 172.21.15.33:46228) 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 -- 172.21.15.33:0/3566084875 learned_addr learned my addr 172.21.15.33:0/3566084875 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72a92e2700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a41005a0 0x7f72a4199b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72a9ae3700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72a40ffbf0 0x7f72a4199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 -- 172.21.15.33:0/3566084875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a41005a0 msgr2=0x7f72a4199b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a41005a0 0x7f72a4199b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 -- 172.21.15.33:0/3566084875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72a40ffbf0 msgr2=0x7f72a4199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72a40ffbf0 0x7f72a4199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 -- 172.21.15.33:0/3566084875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940095f0 con 0x7f72a410d7a0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f72aa2e4700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a410d7a0 0x7f72a419def0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f729c007e90 tx=0x7f729c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.144+0000 7f729affd700 1 -- 172.21.15.33:0/3566084875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c009ea0 con 0x7f72a410d7a0 2024-05-08T20:14:49.145 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.145+0000 7f729affd700 1 -- 172.21.15.33:0/3566084875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f729c00f040 con 0x7f72a410d7a0 2024-05-08T20:14:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.145+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a419eb40 con 0x7f72a410d7a0 2024-05-08T20:14:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.145+0000 7f729affd700 1 -- 172.21.15.33:0/3566084875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0126c0 con 0x7f72a410d7a0 2024-05-08T20:14:49.146 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.145+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a41a6380 con 0x7f72a410d7a0 2024-05-08T20:14:49.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.145+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a4108930 con 0x7f72a410d7a0 2024-05-08T20:14:49.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.147+0000 7f729affd700 1 -- 172.21.15.33:0/3566084875 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f729c00dd20 con 0x7f72a410d7a0 2024-05-08T20:14:49.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.148+0000 7f729affd700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f72900a1290 0x7f72900a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.148+0000 7f72a9ae3700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f72900a1290 0x7f72900a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.148+0000 7f729affd700 1 -- 172.21.15.33:0/3566084875 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f729c0ccab0 con 0x7f72a410d7a0 2024-05-08T20:14:49.147 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.148+0000 7f72a9ae3700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f72900a1290 0x7f72900a3750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005950 tx=0x7f72a000b410 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:49.149 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.151+0000 7f729affd700 1 -- 172.21.15.33:0/3566084875 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f729c095e30 con 0x7f72a410d7a0 2024-05-08T20:14:49.373 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.375+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72a419a910 con 0x7f72a410d7a0 2024-05-08T20:14:49.375 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.377+0000 7f729affd700 1 -- 172.21.15.33:0/3566084875 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+23196 (secure 0 0 0) 0x7f729c099450 con 0x7f72a410d7a0 2024-05-08T20:14:49.376 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:14:49.376 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":94,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:14:14.144440+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6801/3089330166":"2024-05-09T20:04:45.212378+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/2345595459":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1758089139":"2024-05-09T20:04:45.212378+0000","172.21.15.33:6800/3089330166":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3850877935":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1526464392":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/3915505292":"2024-05-09T20:04:45.212378+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:14:49.377 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f72900a1290 msgr2=0x7f72900a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f72900a1290 0x7f72900a3750 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f72a0005950 tx=0x7f72a000b410 comp rx=0 tx=0).stop 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a410d7a0 msgr2=0x7f72a419def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a410d7a0 0x7f72a419def0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f729c007e90 tx=0x7f729c00d3b0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 shutdown_connections 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f72900a1290 0x7f72900a3750 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72a410d7a0 0x7f72a419def0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72a40ffbf0 0x7f72a4199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 --2- 172.21.15.33:0/3566084875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a41005a0 0x7f72a4199b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.379+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 >> 172.21.15.33:0/3566084875 conn(0x7f72a40fb840 msgr2=0x7f72a40fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.380+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 shutdown_connections 2024-05-08T20:14:49.378 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.380+0000 7f72abd47700 1 -- 172.21.15.33:0/3566084875 wait complete. 2024-05-08T20:14:49.391 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:03:27.926660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:03:28.993433+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:14:49.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:14:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 -- 172.21.15.33:0/223945844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 msgr2=0x7f4848106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 --2- 172.21.15.33:0/223945844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f4848106370 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f48440099c0 tx=0x7f4844009cd0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 -- 172.21.15.33:0/223945844 shutdown_connections 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 --2- 172.21.15.33:0/223945844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4848100ab0 0x7f484810ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 --2- 172.21.15.33:0/223945844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f4848106370 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 --2- 172.21.15.33:0/223945844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48481000f0 0x7f4848100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 -- 172.21.15.33:0/223945844 >> 172.21.15.33:0/223945844 conn(0x7f4848076ba0 msgr2=0x7f4848076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 -- 172.21.15.33:0/223945844 shutdown_connections 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.534+0000 7f4850767700 1 -- 172.21.15.33:0/223945844 wait complete. 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 Processor -- start 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 -- start start 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48481000f0 0x7f4848101b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4848100ab0 0x7f4848102060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f48481025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a58a0 con 0x7f4848105f90 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a5a10 con 0x7f48481000f0 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f4850767700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481a5bd0 con 0x7f4848100ab0 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f484ed04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f48481025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f484ed04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f48481025a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46256/0 (socket says 172.21.15.33:46256) 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f484ed04700 1 -- 172.21.15.33:0/3933829351 learned_addr learned my addr 172.21.15.33:0/3933829351 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.535+0000 7f484e503700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48481000f0 0x7f4848101b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f484dd02700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4848100ab0 0x7f4848102060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f484ed04700 1 -- 172.21.15.33:0/3933829351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4848100ab0 msgr2=0x7f4848102060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f484ed04700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4848100ab0 0x7f4848102060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f484ed04700 1 -- 172.21.15.33:0/3933829351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48481000f0 msgr2=0x7f4848101b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f484ed04700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48481000f0 0x7f4848101b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f484ed04700 1 -- 172.21.15.33:0/3933829351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440095f0 con 0x7f4848105f90 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f484ed04700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f48481025a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4840007ee0 tx=0x7f484000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:49.536 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f483f7fe700 1 -- 172.21.15.33:0/3933829351 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840017070 con 0x7f4848105f90 2024-05-08T20:14:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f483f7fe700 1 -- 172.21.15.33:0/3933829351 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f484000f040 con 0x7f4848105f90 2024-05-08T20:14:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48481a5eb0 con 0x7f4848105f90 2024-05-08T20:14:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f483f7fe700 1 -- 172.21.15.33:0/3933829351 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840005760 con 0x7f4848105f90 2024-05-08T20:14:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.536+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48481a6340 con 0x7f4848105f90 2024-05-08T20:14:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.537+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4848101560 con 0x7f4848105f90 2024-05-08T20:14:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.539+0000 7f483f7fe700 1 -- 172.21.15.33:0/3933829351 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f48400058c0 con 0x7f4848105f90 2024-05-08T20:14:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.539+0000 7f483f7fe700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f48340a1290 0x7f48340a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.540+0000 7f484e503700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f48340a1290 0x7f48340a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.540+0000 7f483f7fe700 1 -- 172.21.15.33:0/3933829351 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f48400ccb30 con 0x7f4848105f90 2024-05-08T20:14:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.540+0000 7f484e503700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f48340a1290 0x7f48340a3750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4844009990 tx=0x7f4844005fb0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:49.541 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.543+0000 7f483f7fe700 1 -- 172.21.15.33:0/3933829351 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f4840095eb0 con 0x7f4848105f90 2024-05-08T20:14:49.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.762+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4848067460 con 0x7f4848105f90 2024-05-08T20:14:49.760 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.762+0000 7f483f7fe700 1 -- 172.21.15.33:0/3933829351 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4840009390 con 0x7f4848105f90 2024-05-08T20:14:49.760 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.764+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f48340a1290 msgr2=0x7f48340a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.764+0000 7f4850767700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f48340a1290 0x7f48340a3750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4844009990 tx=0x7f4844005fb0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.764+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 msgr2=0x7f48481025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.764+0000 7f4850767700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f48481025a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4840007ee0 tx=0x7f484000d3b0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 shutdown_connections 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f48340a1290 0x7f48340a3750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4848105f90 0x7f48481025a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48481000f0 0x7f4848101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 --2- 172.21.15.33:0/3933829351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4848100ab0 0x7f4848102060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 >> 172.21.15.33:0/3933829351 conn(0x7f4848076ba0 msgr2=0x7f48480693d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 shutdown_connections 2024-05-08T20:14:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.765+0000 7f4850767700 1 -- 172.21.15.33:0/3933829351 wait complete. 2024-05-08T20:14:49.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:49 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3566084875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:14:49.776 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:14:49.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:49 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3566084875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:14:49.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:49 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3566084875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:14:49.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 -- 172.21.15.33:0/2210216499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 msgr2=0x7f0c040ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 --2- 172.21.15.33:0/2210216499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c040ffce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009990 tx=0x7f0bf8009ca0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 -- 172.21.15.33:0/2210216499 shutdown_connections 2024-05-08T20:14:49.916 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 --2- 172.21.15.33:0/2210216499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c04100220 0x7f0c0410ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 --2- 172.21.15.33:0/2210216499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c04105f40 0x7f0c04106320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 --2- 172.21.15.33:0/2210216499 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c040ffce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 -- 172.21.15.33:0/2210216499 >> 172.21.15.33:0/2210216499 conn(0x7f0c040751c0 msgr2=0x7f0c040755d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:49.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 -- 172.21.15.33:0/2210216499 shutdown_connections 2024-05-08T20:14:49.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 -- 172.21.15.33:0/2210216499 wait complete. 2024-05-08T20:14:49.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.918+0000 7f0c09637700 1 Processor -- start 2024-05-08T20:14:49.917 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c09637700 1 -- start start 2024-05-08T20:14:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c09637700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c04197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c09637700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c04100220 0x7f0c04197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c09637700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c04105f40 0x7f0c0419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c09637700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0419c460 con 0x7f0c040ff860 2024-05-08T20:14:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c09637700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0419c5d0 con 0x7f0c04105f40 2024-05-08T20:14:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c09637700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0419c790 con 0x7f0c04100220 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c04197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c04197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46270/0 (socket says 172.21.15.33:46270) 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 -- 172.21.15.33:0/2870031783 learned_addr learned my addr 172.21.15.33:0/2870031783 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c027fc700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c04100220 0x7f0c04197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c037fe700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c04105f40 0x7f0c0419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 -- 172.21.15.33:0/2870031783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c04100220 msgr2=0x7f0c04197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c04100220 0x7f0c04197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 -- 172.21.15.33:0/2870031783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c04105f40 msgr2=0x7f0c0419be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c04105f40 0x7f0c0419be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.919+0000 7f0c02ffd700 1 -- 172.21.15.33:0/2870031783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80095f0 con 0x7f0c040ff860 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.920+0000 7f0c02ffd700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c04197540 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400e9a0 tx=0x7f0bf400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.920+0000 7f0bebfff700 1 -- 172.21.15.33:0/2870031783 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4009790 con 0x7f0c040ff860 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.920+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0419ca70 con 0x7f0c040ff860 2024-05-08T20:14:49.920 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.920+0000 7f0bebfff700 1 -- 172.21.15.33:0/2870031783 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bf400cbd0 con 0x7f0c040ff860 2024-05-08T20:14:49.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.920+0000 7f0bebfff700 1 -- 172.21.15.33:0/2870031783 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4018730 con 0x7f0c040ff860 2024-05-08T20:14:49.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.920+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c041a42b0 con 0x7f0c040ff860 2024-05-08T20:14:49.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.921+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c041094d0 con 0x7f0c040ff860 2024-05-08T20:14:49.921 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.922+0000 7f0bebfff700 1 -- 172.21.15.33:0/2870031783 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f0bf4010430 con 0x7f0c040ff860 2024-05-08T20:14:49.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.923+0000 7f0bebfff700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f0bec0a1290 0x7f0bec0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:49.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.923+0000 7f0c027fc700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f0bec0a1290 0x7f0bec0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:49.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.923+0000 7f0bebfff700 1 -- 172.21.15.33:0/2870031783 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f0bf4014070 con 0x7f0c040ff860 2024-05-08T20:14:49.922 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.923+0000 7f0c027fc700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f0bec0a1290 0x7f0bec0a3750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b7f0 tx=0x7f0bf800b260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:49.925 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:49.927+0000 7f0bebfff700 1 -- 172.21.15.33:0/2870031783 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f0bf4052d60 con 0x7f0c040ff860 2024-05-08T20:14:50.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.143+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c04068170 con 0x7f0c040ff860 2024-05-08T20:14:50.141 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.143+0000 7f0bebfff700 1 -- 172.21.15.33:0/2870031783 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bf4099e90 con 0x7f0c040ff860 2024-05-08T20:14:50.141 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-05-08T20:14:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f0bec0a1290 msgr2=0x7f0bec0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f0bec0a1290 0x7f0bec0a3750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b7f0 tx=0x7f0bf800b260 comp rx=0 tx=0).stop 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 msgr2=0x7f0c04197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c04197540 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0bf400e9a0 tx=0x7f0bf400ed60 comp rx=0 tx=0).stop 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 shutdown_connections 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0c04105f40 0x7f0c0419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f0bec0a1290 0x7f0bec0a3750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c040ff860 0x7f0c04197540 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 --2- 172.21.15.33:0/2870031783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c04100220 0x7f0c04197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 >> 172.21.15.33:0/2870031783 conn(0x7f0c040751c0 msgr2=0x7f0c040fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 shutdown_connections 2024-05-08T20:14:50.144 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.146+0000 7f0c09637700 1 -- 172.21.15.33:0/2870031783 wait complete. 2024-05-08T20:14:50.158 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:14:50.300 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 -- 172.21.15.33:0/2112034659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 msgr2=0x7f5748100a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 --2- 172.21.15.33:0/2112034659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f5748100a00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5738009990 tx=0x7f5738009ca0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 -- 172.21.15.33:0/2112034659 shutdown_connections 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 --2- 172.21.15.33:0/2112034659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5748100f40 0x7f574810cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 --2- 172.21.15.33:0/2112034659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104de0 0x7f57481051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 --2- 172.21.15.33:0/2112034659 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f5748100a00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 -- 172.21.15.33:0/2112034659 >> 172.21.15.33:0/2112034659 conn(0x7f57480763a0 msgr2=0x7f57480fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 -- 172.21.15.33:0/2112034659 shutdown_connections 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 -- 172.21.15.33:0/2112034659 wait complete. 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.300+0000 7f574f37b700 1 Processor -- start 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574f37b700 1 -- start start 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574f37b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f57481982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574f37b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5748100f40 0x7f5748198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.301 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574f37b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104de0 0x7f57481a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574f37b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57481990a0 con 0x7f5748100580 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574f37b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57481a38b0 con 0x7f5748104de0 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574f37b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57481a39f0 con 0x7f5748100f40 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f57481982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f57481982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46284/0 (socket says 172.21.15.33:46284) 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 -- 172.21.15.33:0/3579194476 learned_addr learned my addr 172.21.15.33:0/3579194476 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574c916700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5748100f40 0x7f5748198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d918700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104de0 0x7f57481a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 -- 172.21.15.33:0/3579194476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5748100f40 msgr2=0x7f5748198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5748100f40 0x7f5748198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 -- 172.21.15.33:0/3579194476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104de0 msgr2=0x7f57481a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104de0 0x7f57481a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.302 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 -- 172.21.15.33:0/3579194476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57380095f0 con 0x7f5748100580 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d918700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104de0 0x7f57481a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.301+0000 7f574d117700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f57481982f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f574400d980 tx=0x7f574400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.302+0000 7f573e7fc700 1 -- 172.21.15.33:0/3579194476 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744004220 con 0x7f5748100580 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.302+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57481a3c80 con 0x7f5748100580 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.302+0000 7f573e7fc700 1 -- 172.21.15.33:0/3579194476 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5744007640 con 0x7f5748100580 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.302+0000 7f573e7fc700 1 -- 172.21.15.33:0/3579194476 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744005720 con 0x7f5748100580 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.302+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57481a41b0 con 0x7f5748100580 2024-05-08T20:14:50.303 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.303+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5748108330 con 0x7f5748100580 2024-05-08T20:14:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.304+0000 7f573e7fc700 1 -- 172.21.15.33:0/3579194476 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5744004410 con 0x7f5748100580 2024-05-08T20:14:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.305+0000 7f573e7fc700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f57340a1290 0x7f57340a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.305+0000 7f574c916700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f57340a1290 0x7f57340a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.305+0000 7f573e7fc700 1 -- 172.21.15.33:0/3579194476 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f57440cd0b0 con 0x7f5748100580 2024-05-08T20:14:50.304 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.305+0000 7f574c916700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f57340a1290 0x7f57340a3750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f573800b2e0 tx=0x7f5738005960 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:50.306 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.308+0000 7f573e7fc700 1 -- 172.21.15.33:0/3579194476 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5744096470 con 0x7f5748100580 2024-05-08T20:14:50.525 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.527+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5748101590 con 0x7f5748100580 2024-05-08T20:14:50.526 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.528+0000 7f573e7fc700 1 -- 172.21.15.33:0/3579194476 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f57440160a0 con 0x7f5748100580 2024-05-08T20:14:50.526 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f57340a1290 msgr2=0x7f57340a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f57340a1290 0x7f57340a3750 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f573800b2e0 tx=0x7f5738005960 comp rx=0 tx=0).stop 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 msgr2=0x7f57481982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f57481982f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f574400d980 tx=0x7f574400dc90 comp rx=0 tx=0).stop 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 shutdown_connections 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5748104de0 0x7f57481a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f57340a1290 0x7f57340a3750 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5748100580 0x7f57481982f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 --2- 172.21.15.33:0/3579194476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5748100f40 0x7f5748198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.530+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 >> 172.21.15.33:0/3579194476 conn(0x7f57480763a0 msgr2=0x7f5748102e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.531+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 shutdown_connections 2024-05-08T20:14:50.529 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.531+0000 7f574f37b700 1 -- 172.21.15.33:0/3579194476 wait complete. 2024-05-08T20:14:50.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-08T20:14:50.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 -- 172.21.15.33:0/3499135120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c100910 msgr2=0x7f696c104950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.680 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 --2- 172.21.15.33:0/3499135120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c100910 0x7f696c104950 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6960009990 tx=0x7f6960009ca0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 -- 172.21.15.33:0/3499135120 shutdown_connections 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 --2- 172.21.15.33:0/3499135120 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f696c105080 0x7f696c10cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 --2- 172.21.15.33:0/3499135120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f696c0fff60 0x7f696c100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 --2- 172.21.15.33:0/3499135120 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c100910 0x7f696c104950 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 -- 172.21.15.33:0/3499135120 >> 172.21.15.33:0/3499135120 conn(0x7f696c0fb800 msgr2=0x7f696c0fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 -- 172.21.15.33:0/3499135120 shutdown_connections 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.682+0000 7f69728f1700 1 -- 172.21.15.33:0/3499135120 wait complete. 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 Processor -- start 2024-05-08T20:14:50.681 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 -- start start 2024-05-08T20:14:50.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f696c0fff60 0x7f696c197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f696c105080 0x7f696c197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c19bd00 0x7f696c19c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.683 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c19c780 con 0x7f696c19bd00 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c19c8f0 con 0x7f696c105080 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f69728f1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c19cab0 con 0x7f696c0fff60 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f6970e8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c19bd00 0x7f696c19c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f6970e8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c19bd00 0x7f696c19c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:46296/0 (socket says 172.21.15.33:46296) 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f6970e8e700 1 -- 172.21.15.33:0/2044750912 learned_addr learned my addr 172.21.15.33:0/2044750912 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f696b7fe700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f696c105080 0x7f696c197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.683+0000 7f696bfff700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f696c0fff60 0x7f696c197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f6970e8e700 1 -- 172.21.15.33:0/2044750912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f696c0fff60 msgr2=0x7f696c197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f6970e8e700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f696c0fff60 0x7f696c197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f6970e8e700 1 -- 172.21.15.33:0/2044750912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f696c105080 msgr2=0x7f696c197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f6970e8e700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f696c105080 0x7f696c197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f6970e8e700 1 -- 172.21.15.33:0/2044750912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600095f0 con 0x7f696c19bd00 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f6970e8e700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c19bd00 0x7f696c19c180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f696400ef30 tx=0x7f696400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:50.684 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f69697fa700 1 -- 172.21.15.33:0/2044750912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6964018070 con 0x7f696c19bd00 2024-05-08T20:14:50.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f69697fa700 1 -- 172.21.15.33:0/2044750912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f696400f040 con 0x7f696c19bd00 2024-05-08T20:14:50.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c1a3fb0 con 0x7f696c19bd00 2024-05-08T20:14:50.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f69697fa700 1 -- 172.21.15.33:0/2044750912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f696400cd50 con 0x7f696c19bd00 2024-05-08T20:14:50.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.684+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c1a43e0 con 0x7f696c19bd00 2024-05-08T20:14:50.685 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.685+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c101430 con 0x7f696c19bd00 2024-05-08T20:14:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.686+0000 7f69697fa700 1 -- 172.21.15.33:0/2044750912 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f6964003a00 con 0x7f696c19bd00 2024-05-08T20:14:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.687+0000 7f69697fa700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f69540a1290 0x7f69540a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:14:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.687+0000 7f69697fa700 1 -- 172.21.15.33:0/2044750912 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f69640cd1a0 con 0x7f696c19bd00 2024-05-08T20:14:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.687+0000 7f696bfff700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f69540a1290 0x7f69540a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:14:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.688+0000 7f696bfff700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f69540a1290 0x7f69540a3750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f695c009c60 tx=0x7f695c009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:14:50.689 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.691+0000 7f69697fa700 1 -- 172.21.15.33:0/2044750912 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f69640965b0 con 0x7f696c19bd00 2024-05-08T20:14:50.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:50 smithi033 ceph-mon[42490]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:14:50.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:50 smithi033 ceph-mon[42490]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:14:50.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:50 smithi033 ceph-mon[42490]: pgmap v316: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:50.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:50 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3933829351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:14:50.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:50 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2870031783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:14:50.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:50 smithi082 ceph-mon[46774]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:14:50.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:50 smithi082 ceph-mon[46774]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:14:50.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:50 smithi082 ceph-mon[46774]: pgmap v316: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:50.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:50 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3933829351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:14:50.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:50 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2870031783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:14:50.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:50 smithi132 ceph-mon[47484]: from='client.15585 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:14:50.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:50 smithi132 ceph-mon[47484]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T20:14:50.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:50 smithi132 ceph-mon[47484]: pgmap v316: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-05-08T20:14:50.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:50 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3933829351' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:14:50.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:50 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2870031783' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:14:50.974 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.975+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f696c1009b0 con 0x7f696c19bd00 2024-05-08T20:14:50.981 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.984+0000 7f69697fa700 1 -- 172.21.15.33:0/2044750912 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+733939 (secure 0 0 0) 0x7f69641af310 con 0x7f696c19bd00 2024-05-08T20:14:50.992 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:14:50.992 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "epoch": 25, 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "active_gid": 15264, 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "active_name": "x", 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addrs": { 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6800", 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1417363085 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v1", 2024-05-08T20:14:50.993 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:6801", 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1417363085 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "active_addr": "172.21.15.33:6801/1417363085", 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "active_change": "2024-05-08T20:04:45.212679+0000", 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "active_mgr_features": 4540138322906710015, 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "available": true, 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "standbys": [ 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 25090, 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "z", 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540138322906710015, 2024-05-08T20:14:50.994 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:50.995 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:50.997 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:50.998 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:50.999 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.000 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.001 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.002 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.003 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.004 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.005 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.006 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.007 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.009 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.010 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.011 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.012 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.013 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.014 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.015 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.016 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.017 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.018 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.019 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.020 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.023 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap" 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-05-08T20:14:51.024 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.025 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.026 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-05-08T20:14:51.029 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.030 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.031 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.032 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.034 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.035 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.036 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-05-08T20:14:51.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-05-08T20:14:51.040 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-05-08T20:14:51.043 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-05-08T20:14:51.044 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-05-08T20:14:51.046 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.048 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.049 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.051 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-05-08T20:14:51.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-05-08T20:14:51.053 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T20:14:51.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-05-08T20:14:51.055 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.056 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.057 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.058 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.059 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-05-08T20:14:51.060 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-05-08T20:14:51.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T20:14:51.064 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.066 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.067 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.070 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.071 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.072 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-05-08T20:14:51.073 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.075 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.076 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.078 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.080 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.086 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.088 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.089 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.091 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.092 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-05-08T20:14:51.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-05-08T20:14:51.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.097 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.100 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.101 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T20:14:51.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T20:14:51.103 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.106 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.107 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.109 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.110 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.116 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.118 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.119 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.123 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.124 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T20:14:51.125 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T20:14:51.126 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T20:14:51.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.129 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.130 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.133 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.135 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.137 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.139 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.144 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.149 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.150 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-05-08T20:14:51.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-05-08T20:14:51.152 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-05-08T20:14:51.154 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-05-08T20:14:51.155 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.158 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.160 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.163 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.165 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-05-08T20:14:51.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-05-08T20:14:51.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.170 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.174 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-05-08T20:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-05-08T20:14:51.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-05-08T20:14:51.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-05-08T20:14:51.180 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.182 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.183 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.185 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.186 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.188 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-05-08T20:14:51.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-05-08T20:14:51.190 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-05-08T20:14:51.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.194 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.195 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.196 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.197 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.198 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.199 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.200 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.201 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.204 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.205 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-05-08T20:14:51.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-05-08T20:14:51.207 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.211 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.213 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.214 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.218 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-05-08T20:14:51.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-05-08T20:14:51.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.221 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-05-08T20:14:51.223 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.224 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.225 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.226 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.227 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.228 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.229 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.230 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.232 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.233 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.234 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.235 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.236 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.237 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.238 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.239 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.240 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.241 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.242 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.243 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.244 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.245 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.246 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-05-08T20:14:51.247 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.248 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.249 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.250 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.251 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.252 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.253 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.254 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.255 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.256 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.257 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.258 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.259 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.260 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.261 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.262 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.263 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.264 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-05-08T20:14:51.265 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.266 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T20:14:51.267 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.268 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.269 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.270 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.271 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.272 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-05-08T20:14:51.273 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.274 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.275 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.276 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T20:14:51.277 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.278 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.279 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.280 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.281 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.282 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.283 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.284 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:51.285 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:51.286 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-05-08T20:14:51.287 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.288 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.289 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.291 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.292 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.293 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.294 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.295 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.296 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.297 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.298 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.299 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.300 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.301 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.303 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.304 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.305 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.306 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.307 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.308 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.309 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.310 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.311 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.312 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.313 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.314 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.315 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.316 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.317 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.318 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T20:14:51.319 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.320 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.321 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.322 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.323 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.324 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.325 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-05-08T20:14:51.326 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.327 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.328 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.329 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.330 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.331 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.332 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.333 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.334 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.335 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.336 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.337 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.338 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.339 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.341 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.342 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.343 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.344 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.345 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.346 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.347 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.348 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-05-08T20:14:51.349 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.350 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.351 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.352 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.353 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.354 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.355 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.356 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.357 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.358 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.359 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.360 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.361 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.362 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.363 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.364 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.365 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.366 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.367 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.368 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.369 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.370 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.371 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.372 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.373 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.374 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.375 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.376 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.377 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.378 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.379 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-05-08T20:14:51.380 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-05-08T20:14:51.380 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.381 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.382 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.383 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.384 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.385 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.386 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.387 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.388 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.389 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.390 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.391 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.392 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.393 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-05-08T20:14:51.394 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-05-08T20:14:51.395 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T20:14:51.396 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.397 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.398 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.399 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.400 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.401 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.402 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.403 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.404 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.405 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.406 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.407 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.408 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "gid": 25139, 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "y", 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr_features": 4540138322906710015, 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.409 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.410 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.411 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.412 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.413 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.414 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-05-08T20:14:51.415 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-05-08T20:14:51.416 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-05-08T20:14:51.417 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-05-08T20:14:51.418 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-05-08T20:14:51.419 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.420 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.421 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.422 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.423 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.424 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.425 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.426 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.427 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.428 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.429 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.430 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.431 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.433 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.434 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.435 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.436 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.437 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap" 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.438 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.439 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.440 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-05-08T20:14:51.441 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.442 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.443 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.444 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.445 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T20:14:51.446 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T20:14:51.447 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.448 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.449 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.450 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.451 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.452 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.453 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.455 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-05-08T20:14:51.456 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-05-08T20:14:51.457 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.458 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.459 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.460 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.461 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.462 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.463 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.464 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.465 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.466 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.467 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.468 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.469 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.470 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.471 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.472 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.473 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.474 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T20:14:51.475 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.476 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.477 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.478 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.479 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.480 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T20:14:51.481 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T20:14:51.482 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.483 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.484 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.485 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.486 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-05-08T20:14:51.487 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.488 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.489 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.490 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.491 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.492 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.493 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-05-08T20:14:51.494 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.495 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.496 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.497 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.498 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.499 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T20:14:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.501 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.502 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.503 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.504 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.505 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-05-08T20:14:51.506 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.507 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T20:14:51.508 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T20:14:51.509 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T20:14:51.510 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.511 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.512 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.513 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.514 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.515 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.516 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.517 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.518 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.519 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.520 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.521 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.522 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.523 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.524 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.525 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.526 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.527 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.528 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T20:14:51.529 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T20:14:51.530 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T20:14:51.531 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.532 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.533 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.534 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.535 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.536 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.537 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.538 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T20:14:51.539 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.540 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.541 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.542 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.543 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.544 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.545 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.546 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.547 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.548 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.549 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.550 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.551 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.552 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.553 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.554 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.555 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.556 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.557 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.558 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.559 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-05-08T20:14:51.560 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T20:14:51.561 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:51.562 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.563 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.564 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.565 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.566 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.567 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-05-08T20:14:51.568 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.569 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.570 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.571 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.572 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.573 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.574 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.575 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.576 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.577 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.578 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.579 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.580 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.581 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.582 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.583 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.585 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.586 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.587 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.588 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-05-08T20:14:51.589 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.590 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.591 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-05-08T20:14:51.592 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.593 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.594 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.595 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.596 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.597 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.598 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.599 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.600 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-05-08T20:14:51.601 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-05-08T20:14:51.602 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.603 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.604 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.605 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.606 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.607 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.608 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.609 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.610 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.611 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.612 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.613 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.614 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.615 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.616 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.618 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.619 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.620 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.621 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.622 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.623 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.628 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.629 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.630 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.631 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.632 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.633 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.634 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.635 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.636 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.637 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.638 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.639 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.640 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-05-08T20:14:51.641 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.642 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.643 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.644 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.645 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.646 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.647 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.648 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.649 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.650 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.651 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.652 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.653 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.656 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.657 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.658 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.659 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.660 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.661 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.662 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.663 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.664 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.665 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.666 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.667 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.668 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.669 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.670 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.671 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.672 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.673 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.674 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.675 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T20:14:51.676 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.677 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.678 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.679 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.680 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.681 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.682 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.683 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.684 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.685 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.686 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.687 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.688 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.689 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.691 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.692 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.693 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.694 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.695 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.696 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.697 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.698 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-05-08T20:14:51.699 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-05-08T20:14:51.700 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.701 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.702 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.703 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.704 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.705 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.706 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.707 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.708 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.709 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-05-08T20:14:51.710 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.711 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.712 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.713 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.714 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.715 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.716 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.717 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.718 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.719 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.720 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.721 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.722 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.723 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.724 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.725 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.726 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.727 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.728 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.729 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.730 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.731 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.732 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.733 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.734 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.735 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.736 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.737 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.738 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.739 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.740 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-05-08T20:14:51.741 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-05-08T20:14:51.742 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.743 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.744 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.745 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.746 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.747 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.748 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.749 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.750 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.751 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.752 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.754 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.755 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.756 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.757 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.758 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.759 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.761 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.762 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.763 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.764 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.765 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.766 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.767 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.768 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.770 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.771 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.772 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.773 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.774 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-05-08T20:14:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-05-08T20:14:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.775 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T20:14:51.777 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T20:14:51.778 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.779 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.780 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.781 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.782 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.783 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.784 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-05-08T20:14:51.785 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.786 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.787 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.788 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.789 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.790 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.791 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.792 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T20:14:51.793 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.794 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.795 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.796 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.797 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.798 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.799 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.800 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.801 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.802 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.803 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.806 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.807 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.808 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.809 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.810 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.811 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.812 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.813 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.814 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.816 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.817 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.818 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "modules": [ 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard", 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "iostat", 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "nfs", 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "restful", 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "snap_schedule" 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "available_modules": [ 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.819 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "alerts", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.820 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.821 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.822 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.823 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.824 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_destination": { 2024-05-08T20:14:51.825 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_destination", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email address to send alerts to", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_from_name": { 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_from_name", 2024-05-08T20:14:51.826 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "Ceph", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Email From: name", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_host": { 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_host", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.827 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP server", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_password": { 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_password", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.828 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Password to authenticate with", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_port": { 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_port", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.829 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "465", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP port", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_sender": { 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_sender", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.830 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SMTP envelope sender", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_ssl": { 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_ssl", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.831 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "smtp_user": { 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "smtp_user", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.832 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "User to authenticate as", 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "balancer", 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.833 INFO:teuthology.orchestra.run.smithi033.stdout: "active": { 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "active", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.834 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_time": { 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_time", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0000", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "begin_weekday": { 2024-05-08T20:14:51.835 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "begin_weekday", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_max_iterations": { 2024-05-08T20:14:51.836 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_max_iterations", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "25", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "250", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_metrics": { 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_metrics", 2024-05-08T20:14:51.837 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "crush_compat_step": { 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crush_compat_step", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.838 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.5", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0.001", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "0.999", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "aggressiveness of optimization", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "end_time": { 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_time", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.839 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2359", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "end_weekday": { 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "end_weekday", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.840 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "0", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "6", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.841 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.842 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.843 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.844 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.845 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "min_score": { 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_score", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.846 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "upmap", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.847 INFO:teuthology.orchestra.run.smithi033.stdout: "crush-compat", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "none", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap" 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Balancer mode", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_ids": { 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_ids", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.848 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.849 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_deviation": { 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_deviation", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.850 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "upmap_max_optimizations": { 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "upmap_max_optimizations", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.851 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephadm", 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.852 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_down_multiplier": { 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_down_multiplier", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_refresh_rate": { 2024-05-08T20:14:51.853 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_refresh_rate", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "20", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "agent_starting_port": { 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "agent_starting_port", 2024-05-08T20:14:51.854 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4721", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_ptrace": { 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_ptrace", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.855 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_interval": { 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_interval", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.856 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "autotune_memory_target_ratio": { 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.857 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0.7", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "cgroups_split": { 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cgroups_split", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.858 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "config_checks_enabled": { 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_checks_enabled", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.859 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "config_dashboard": { 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_dashboard", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.860 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_alertmanager": { 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_alertmanager", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.861 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_base": { 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_base", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.862 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Container image name, without the tag", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_elasticsearch": { 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_elasticsearch", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.863 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "elasticsearch container image", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_grafana": { 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_grafana", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.864 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_haproxy": { 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_haproxy", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "HAproxy container image", 2024-05-08T20:14:51.865 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_agent": { 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_agent", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger agent container image", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.866 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_collector": { 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_collector", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger collector container image", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.867 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_jaeger_query": { 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_jaeger_query", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Jaeger query container image", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.868 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_keepalived": { 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_keepalived", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Keepalived container image", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.869 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_loki": { 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_loki", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Loki container image", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.870 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_node_exporter": { 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_node_exporter", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_nvmeof": { 2024-05-08T20:14:51.871 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_nvmeof", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Nvme-of container image", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.872 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_prometheus": { 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_prometheus", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Prometheus container image", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_promtail": { 2024-05-08T20:14:51.873 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_promtail", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Promtail container image", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "container_image_snmp_gateway": { 2024-05-08T20:14:51.874 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_image_snmp_gateway", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "SNMP Gateway container image", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "container_init": { 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "container_init", 2024-05-08T20:14:51.875 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "daemon_cache_timeout": { 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "daemon_cache_timeout", 2024-05-08T20:14:51.876 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "default_cephadm_command_timeout": { 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.877 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "900", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "default_registry": { 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "default_registry", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.878 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "docker.io", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "device_cache_timeout": { 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_cache_timeout", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.879 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1800", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache device inventory", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "device_enhanced_scan": { 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_enhanced_scan", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.880 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "facts_cache_timeout": { 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "facts_cache_timeout", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:51.881 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "seconds to cache host facts data", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "host_check_interval": { 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "host_check_interval", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.882 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to perform a host check", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "hw_monitoring": { 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hw_monitoring", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.883 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "inventory_list_all": { 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "inventory_list_all", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.885 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "log_refresh_metadata": { 2024-05-08T20:14:51.886 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_refresh_metadata", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.887 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.888 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.889 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.890 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T20:14:51.891 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "*", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.892 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "max_count_per_host": { 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_count_per_host", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of daemons per service per host", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.893 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "max_osd_draining_count": { 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_osd_draining_count", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.894 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "migration_current": { 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "migration_current", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "internal - do not modify", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.895 INFO:teuthology.orchestra.run.smithi033.stdout: "mode": { 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mode", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "root", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm-package", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "root" 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.896 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "oob_default_addr": { 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "oob_default_addr", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "169.254.1.1", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.897 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "prometheus_alerts_path": { 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus_alerts_path", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.898 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_insecure": { 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_insecure", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_password": { 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_password", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.900 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_url": { 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_url", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.901 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "registry_username": { 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "registry_username", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.902 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "secure_monitoring_stack": { 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "secure_monitoring_stack", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.903 INFO:teuthology.orchestra.run.smithi033.stdout: "service_discovery_port": { 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "service_discovery_port", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8765", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "cephadm service discovery port", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "ssh_config_file": { 2024-05-08T20:14:51.904 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssh_config_file", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "use_agent": { 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_agent", 2024-05-08T20:14:51.905 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "use_repo_digest": { 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "use_repo_digest", 2024-05-08T20:14:51.906 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_failed_host_check": { 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_failed_host_check", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.907 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_daemons": { 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_daemons", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.908 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_on_stray_hosts": { 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_on_stray_hosts", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.909 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crash", 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.910 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.911 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.912 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.913 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.914 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "retain_interval": { 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retain_interval", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.915 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "31536000", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_recent_interval": { 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_recent_interval", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.916 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1209600", 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dashboard", 2024-05-08T20:14:51.917 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.918 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.919 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.920 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_ENABLED": { 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.921 INFO:teuthology.orchestra.run.smithi033.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.922 INFO:teuthology.orchestra.run.smithi033.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T20:14:51.923 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T20:14:51.924 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.925 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.926 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.927 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.928 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.929 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.930 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.931 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.932 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_URL": { 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_URL", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.933 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.934 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.935 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.936 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.937 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.939 INFO:teuthology.orchestra.run.smithi033.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T20:14:51.940 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T20:14:51.941 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T20:14:51.942 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.943 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.944 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.945 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.946 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.947 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.948 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.949 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.950 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "45", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.951 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.952 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "admin", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.953 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.954 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.955 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.956 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.957 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.958 INFO:teuthology.orchestra.run.smithi033.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "cross_origin_url": { 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cross_origin_url", 2024-05-08T20:14:51.959 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "crt_file": { 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "crt_file", 2024-05-08T20:14:51.960 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "debug": { 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "debug", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.961 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Enable/disable debug options", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "jwt_token_ttl": { 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "jwt_token_ttl", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.962 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "28800", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.963 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.964 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.965 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.966 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.967 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.968 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "motd": { 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "motd", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.969 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "The message of the day", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect_resolve_ip_addr": { 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.970 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.971 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8080", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.972 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.973 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl_server_port": { 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl_server_port", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8443", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.974 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "redirect", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "redirect" 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.975 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.976 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "url_prefix": { 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url_prefix", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.977 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_monitoring": { 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_monitoring", 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.978 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "monitor device health metrics", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.979 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.980 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.981 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.982 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.983 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "mark_out_threshold": { 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mark_out_threshold", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "2419200", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.984 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "pool_name": { 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pool_name", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "device_health_metrics", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T20:14:51.985 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "retention_period": { 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "retention_period", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15552000", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long to retain device health metrics", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.986 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_frequency": { 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_frequency", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.987 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "self_heal": { 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "self_heal", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.988 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.989 INFO:teuthology.orchestra.run.smithi033.stdout: "warn_threshold": { 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "warn_threshold", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7257600", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "diskprediction_local", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.991 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:51.992 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:51.993 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:51.994 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.995 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "predict_interval": { 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predict_interval", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "86400", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.996 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "predictor_model": { 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "predictor_model", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "prophetstor", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.997 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "600", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:51.998 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "influx", 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": false, 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "influxdb python module not found", 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "batch_size": { 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "batch_size", 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5000", 2024-05-08T20:14:51.999 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "database": { 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "database", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "ceph", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.000 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "hostname": { 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "hostname", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.001 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server hostname", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "30", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "5", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.002 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.003 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.004 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.005 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.006 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.007 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "password": { 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "password", 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.008 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "password of InfluxDB server user", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "port": { 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "port", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.009 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "8086", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "InfluxDB server port", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "ssl": { 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ssl", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "false", 2024-05-08T20:14:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "threads": { 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threads", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:52.011 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "32", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "username": { 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "username", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.012 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "username of InfluxDB server user", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "verify_ssl": { 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "verify_ssl", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "true", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.013 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "insights", 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.014 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.015 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.016 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.017 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.018 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "iostat", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.020 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.021 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.022 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.023 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.024 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "k8sevents", 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_event_retention_days": { 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "ceph_event_retention_days", 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "7", 2024-05-08T20:14:52.025 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "config_check_secs": { 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "config_check_secs", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:52.026 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "10", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.027 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.028 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.029 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.030 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.031 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "localpool", 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "failure_domain": { 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "failure_domain", 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.032 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "host", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "failure domain for any created local pool", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.033 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.034 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.035 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.036 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.037 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min_size": { 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "min_size", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.038 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default min_size for any created local pool", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "num_rep": { 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "num_rep", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default replica count for any created local pool", 2024-05-08T20:14:52.039 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_num": { 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_num", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "128", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T20:14:52.040 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "prefix": { 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prefix", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "name prefix for any created local pool", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.041 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "subtree": { 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "subtree", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "rack", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.042 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mds_autoscaler", 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.043 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.044 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.045 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.046 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.047 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirroring", 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.048 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.049 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.050 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.051 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.052 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "nfs", 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.053 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.054 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.055 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.056 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.057 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.058 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "fail_fs": { 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "fail_fs", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.059 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.060 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.061 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.062 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.063 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator": { 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "orchestrator", 2024-05-08T20:14:52.064 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "cephadm", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "rook", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "test_orchestrator" 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Orchestrator backend", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.065 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_perf_query", 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.066 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.067 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.068 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.069 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.070 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "osd_support", 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.071 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.072 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.073 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.074 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.075 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "pg_autoscaler", 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.076 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.077 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.078 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.079 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.080 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:52.081 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "threshold": { 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "threshold", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.082 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "3.0", 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1.0", 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "scaling threshold", 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "progress", 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.083 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_pg_recovery_event": { 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_pg_recovery_event", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.085 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.086 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.087 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.088 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.089 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "max_completed_events": { 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_completed_events", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.090 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "50", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "number of past completed events to remember", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "sleep_interval": { 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "sleep_interval", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.091 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "5", 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "how long the module is going to sleep", 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "prometheus", 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.092 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "cache": { 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cache", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.093 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "exclude_perf_counters": { 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "exclude_perf_counters", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.094 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.095 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.096 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.097 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.098 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools": { 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.099 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.100 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "300", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "scrape_interval": { 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "scrape_interval", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15.0", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.101 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "::", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.102 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "9283", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.103 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "stale_cache_strategy": { 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stale_cache_strategy", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "log", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.104 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_behaviour": { 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_behaviour", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "default", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "default", 2024-05-08T20:14:52.105 INFO:teuthology.orchestra.run.smithi033.stdout: "error" 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "standby_error_status_code": { 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "standby_error_status_code", 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "500", 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "400", 2024-05-08T20:14:52.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "599", 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.107 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.108 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.109 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.110 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.111 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_snap_create": { 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_snap_create", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10", 2024-05-08T20:14:52.112 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "mirror_snapshot_schedule": { 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.113 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "trash_purge_schedule": { 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "trash_purge_schedule", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.114 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "restful", 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "enable_auth": { 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enable_auth", 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.115 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "key_file": { 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "key_file", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.116 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.117 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.118 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.120 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.121 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "server_addr": { 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_addr", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.122 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "server_port": { 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "server_port", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.123 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rgw", 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.124 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.125 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.126 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.127 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.128 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rook", 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.129 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.130 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.131 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.132 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.133 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "storage_class": { 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "storage_class", 2024-05-08T20:14:52.134 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "local", 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.135 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "selftest", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.136 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.137 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.138 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.139 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "roption1": { 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption1", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.141 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "roption2": { 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "roption2", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "xyz", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.142 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption1": { 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption1", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption2": { 2024-05-08T20:14:52.143 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption2", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption3": { 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption3", 2024-05-08T20:14:52.144 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "float", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption4": { 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption4", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.145 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption5": { 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption5", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.146 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption6": { 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption6", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.147 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "rwoption7": { 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rwoption7", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.148 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "1", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "42", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "testkey": { 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testkey", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.149 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "testlkey": { 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testlkey", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.150 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "testnewline": { 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "testnewline", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.151 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "allow_m_granularity": { 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "allow_m_granularity", 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.152 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "dump_on_update": { 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "dump_on_update", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.153 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "dump database to debug log on update", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.154 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.155 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.156 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.157 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.158 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "stats", 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.159 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.160 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.161 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.162 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.163 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "status", 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.164 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.165 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.166 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.167 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.168 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.169 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telegraf", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "address": { 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "address", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.170 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "15", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.171 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.172 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.173 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.174 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.175 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.176 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "telemetry", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_basic": { 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_basic", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.177 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_crash": { 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_crash", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.178 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_device": { 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_device", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T20:14:52.179 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_ident": { 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_ident", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.180 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "channel_perf": { 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "channel_perf", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.181 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "contact": { 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "contact", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.182 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "description": { 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "description", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.183 INFO:teuthology.orchestra.run.smithi033.stdout: "device_url": { 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "device_url", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "enabled": { 2024-05-08T20:14:52.184 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "enabled", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:52.185 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "24", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "8", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "last_opt_revision": { 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "last_opt_revision", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.186 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "1", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard": { 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.187 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "leaderboard_description": { 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "leaderboard_description", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.189 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.190 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.191 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.192 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.193 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "organization": { 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "organization", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.194 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "proxy": { 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "proxy", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.195 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.196 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.196 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.196 INFO:teuthology.orchestra.run.smithi033.stdout: "url": { 2024-05-08T20:14:52.197 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "url", 2024-05-08T20:14:52.197 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.197 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.197 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "test_orchestrator", 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.198 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.199 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.200 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.201 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.202 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.203 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.204 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.205 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.206 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.207 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.208 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max_concurrent_clones": { 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "max_concurrent_clones", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "4", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.209 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_delay": { 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_delay", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "0", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.210 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "snapshot_clone_no_wait": { 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "True", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.211 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix", 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "can_run": true, 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "error_string": "", 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "module_options": { 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "discovery_interval": { 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "discovery_interval", 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "uint", 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "100", 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.212 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "identifier": { 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "identifier", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.213 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "interval": { 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "interval", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "secs", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "60", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.214 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "log_level": { 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_level", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.215 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster": { 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.216 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_cluster_level": { 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_cluster_level", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.217 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "info", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [ 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "critical", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "debug", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "error", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "info", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "warning" 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "log_to_file": { 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "log_to_file", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "bool", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 1, 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "False", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_host": { 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_host", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.220 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_port": { 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_port", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "int", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "10051", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "zabbix_sender": { 2024-05-08T20:14:52.221 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "zabbix_sender", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "str", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "level": "advanced", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "flags": 0, 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "min": "", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "max": "", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "enum_allowed": [], 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "desc": "", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "long_desc": "", 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "tags": [], 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: "see_also": [] 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.222 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "services": { 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "dashboard": "https://172.21.15.33:8443/" 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "always_on_modules": { 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "octopus": [ 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-05-08T20:14:52.223 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "pacific": [ 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "quincy": [ 2024-05-08T20:14:52.224 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "reef": [ 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "balancer", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "crash", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "devicehealth", 2024-05-08T20:14:52.225 INFO:teuthology.orchestra.run.smithi033.stdout: "orchestrator", 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "pg_autoscaler", 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "progress", 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "rbd_support", 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "status", 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "telemetry", 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "volumes" 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "last_failure_osd_epoch": 83, 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "active_clients": [ 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "devicehealth", 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-05-08T20:14:52.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 4126542032 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "libcephsqlite", 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 3241233248 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.227 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "rbd_support", 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 53109580 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-05-08T20:14:52.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 2107526312 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "snap_schedule", 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 1446854346 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.229 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volumes", 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: "addrvec": [ 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: "type": "v2", 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: "addr": "172.21.15.33:0", 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: "nonce": 722326340 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2024-05-08T20:14:52.230 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:14:52.232 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:51 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3579194476' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:14:52.232 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:51 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2044750912' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T20:14:52.232 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:51 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3579194476' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:14:52.232 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:51 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2044750912' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f69540a1290 msgr2=0x7f69540a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f69540a1290 0x7f69540a3750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f695c009c60 tx=0x7f695c009260 comp rx=0 tx=0).stop 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c19bd00 msgr2=0x7f696c19c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c19bd00 0x7f696c19c180 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f696400ef30 tx=0x7f696400c3a0 comp rx=0 tx=0).stop 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 shutdown_connections 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f69540a1290 0x7f69540a3750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f696c19bd00 0x7f696c19c180 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f696c0fff60 0x7f696c197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 --2- 172.21.15.33:0/2044750912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f696c105080 0x7f696c197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 >> 172.21.15.33:0/2044750912 conn(0x7f696c0fb800 msgr2=0x7f696c0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 shutdown_connections 2024-05-08T20:14:52.233 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:14:50.989+0000 7f69728f1700 1 -- 172.21.15.33:0/2044750912 wait complete. 2024-05-08T20:14:52.239 DEBUG:tasks.check_counter:Getting stats from a 2024-05-08T20:14:52.239 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-08T20:14:52.240 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:51 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3579194476' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:14:52.240 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:51 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2044750912' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T20:14:52.496 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:14:52.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:52 smithi033 ceph-mon[42490]: pgmap v317: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T20:14:52.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:52 smithi082 ceph-mon[46774]: pgmap v317: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T20:14:52.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:52 smithi132 ceph-mon[47484]: pgmap v317: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T20:14:53.650 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 197, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 187, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 1416240, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 106384, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.043357024, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.013353937, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.033310933, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.004276825, 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:53.651 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 186, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.012430059, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000066828 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 1416240, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 106384 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 2, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 142, 2024-05-08T20:14:53.652 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 320, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 177424, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 5, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 3, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.013483589, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.008495034, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002540481, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 139, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.019603111, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000141029 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:53.653 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 177424 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 4, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 4, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 2992, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 448, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-05-08T20:14:53.654 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.000869246, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000071136, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000780826, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 3, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.001069732, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000356577 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T20:14:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:14:53.656 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:14:53.657 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:14:53.658 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 150008, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 31, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:14:53.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 199, 2024-05-08T20:14:53.660 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 1388449, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 199, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 199, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 1388449, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:53.661 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:14:53.672 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:53 smithi033 ceph-mon[42490]: pgmap v318: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:14:53.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:53 smithi082 ceph-mon[46774]: pgmap v318: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:14:53.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:53 smithi132 ceph-mon[47484]: pgmap v318: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:14:54.027 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-05-08T20:14:54.027 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-05-08T20:14:54.027 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-05-08T20:14:54.027 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-05-08T20:14:54.027 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-05-08T20:14:54.027 DEBUG:tasks.check_counter:Getting stats from d 2024-05-08T20:14:54.028 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-08T20:14:54.287 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:14:55.323 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 0, 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2, 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 0, 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 0, 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-05-08T20:14:55.324 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.002716442, 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000577339, 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:55.325 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 200, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 190, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 1417056, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 108160, 2024-05-08T20:14:55.326 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.039413683, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.010829328, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.031808927, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.004655960, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 189, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.013096397, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000069293 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.327 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:55.328 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:55.328 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:55.328 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:55.328 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.328 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 1417056, 2024-05-08T20:14:55.328 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 108160 2024-05-08T20:14:55.329 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.329 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:14:55.329 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 6, 2024-05-08T20:14:55.329 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 147, 2024-05-08T20:14:55.329 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 3312, 2024-05-08T20:14:55.329 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 178400, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 5, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 3, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.014143511, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.008811049, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.002874884, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 145, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.019209313, 2024-05-08T20:14:55.330 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000132478 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 178400 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.331 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:14:55.332 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-05-08T20:14:55.333 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:14:55.334 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:14:55.335 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-05-08T20:14:55.335 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-05-08T20:14:55.335 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-05-08T20:14:55.335 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:14:55.335 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:14:55.335 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:14:55.335 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 150008, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 31, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:14:55.336 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-05-08T20:14:55.337 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:55.338 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 202, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 1388839, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 202, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 202, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 1388839, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:55.339 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:55.340 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:55.340 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:14:55.676 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-08T20:14:55.677 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-08T20:14:55.677 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-05-08T20:14:55.677 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-05-08T20:14:55.677 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-05-08T20:14:55.677 DEBUG:tasks.check_counter:Getting stats from g 2024-05-08T20:14:55.677 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-08T20:14:55.933 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:14:56.752 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:56 smithi033 ceph-mon[42490]: pgmap v319: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:14:56.752 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:56 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:14:56.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:56 smithi082 ceph-mon[46774]: pgmap v319: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:14:56.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:56 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:14:56.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:56 smithi132 ceph-mon[47484]: pgmap v319: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:14:56.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:56 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T20:14:57.062 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:14:57.062 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 3283, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2535, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 1313823, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 3436625, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 10, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 5, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.271487771, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.109795225, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.189900001, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.013765333, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2533, 2024-05-08T20:14:57.063 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.114051652, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000045026 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 5048, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000983528, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000194 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 300112 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 1716, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2095, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 616018, 2024-05-08T20:14:57.064 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 1231326, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 17, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 5, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.266715298, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.112984282, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.124191894, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.044900759, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2093, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.095718627, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000045732 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 2980, 2024-05-08T20:14:57.065 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000752765, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000252 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 579392, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 1145104 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 440, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 446, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 1573569, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 250166, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 7, 2024-05-08T20:14:57.066 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 6, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.062647368, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.018978312, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.046055785, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.009463695, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 445, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.033768930, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000075885 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 56, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000024436, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000436 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.067 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 1502416, 2024-05-08T20:14:57.068 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 125856 2024-05-08T20:14:57.068 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.068 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-05-08T20:14:57.069 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 1, 2024-05-08T20:14:57.069 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-05-08T20:14:57.069 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.069 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-MDSRank": { 2024-05-08T20:14:57.069 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-05-08T20:14:57.069 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-05-08T20:14:57.069 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 448, 2024-05-08T20:14:57.070 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.360117140, 2024-05-08T20:14:57.070 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000803832 2024-05-08T20:14:57.070 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.070 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.070 INFO:teuthology.orchestra.run.smithi033.stdout: "finisher-PurgeQueue": { 2024-05-08T20:14:57.070 INFO:teuthology.orchestra.run.smithi033.stdout: "queue_len": 0, 2024-05-08T20:14:57.070 INFO:teuthology.orchestra.run.smithi033.stdout: "complete_latency": { 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 470, 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.029690241, 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000063170 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": { 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "request": 552, 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "reply": 547, 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "reply_latency": { 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 547, 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 4.206027506, 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.007689264 2024-05-08T20:14:57.071 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_reply": 0, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "forward": 5, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_complete": 0, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_fetch_keys": 0, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_commit": 11, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_split": 0, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_merge": 0, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes": 35, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_top": 7, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_bottom": 9, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pin_tail": 19, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_pinned": 23, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_expired": 247, 2024-05-08T20:14:57.072 INFO:teuthology.orchestra.run.smithi033.stdout: "inodes_with_caps": 3, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": 3, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "subtrees": 4, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse": 877, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_hit": 723, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_forward": 1, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_discover": 30, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_dir_fetch": 0, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_remote_ino": 0, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "traverse_lock": 0, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "load_cent": 0, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "q": 0, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "exported": 26, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "exported_inodes": 154, 2024-05-08T20:14:57.073 INFO:teuthology.orchestra.run.smithi033.stdout: "imported": 26, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "imported_inodes": 187, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_dir_fetch": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_backtrace_fetch": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "openino_peer_discover": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rfiles": 4, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rbytes": 234, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "root_rsnaps": 4, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_set_tag": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_inotable_repaired": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_inodes": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T20:14:57.074 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "scrub_file_inodes": 0, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_inode_file_caps": 0, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_revoke": 64, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_grant": 468, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps": 236, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_caps_dirty": 190, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_cap_release": 77, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "process_request_cap_release": 536 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.075 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_cache": { 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_update_receipt": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_try_discover": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_send_discover": 28, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "dir_handle_discover": 7, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays": 1, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_delayed": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "num_strays_enqueuing": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_created": 267, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_enqueued": 266, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_reintegrated": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "strays_migrated": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_processing": 0, 2024-05-08T20:14:57.076 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_enqueued": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "num_recovering_prioritized": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_started": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "recovery_completed": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_exportdir": 26, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_flush": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragmentdir": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_fragstats": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "ireq_inodestats": 0 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_log": { 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "evadd": 1102, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "evex": 0, 2024-05-08T20:14:57.077 INFO:teuthology.orchestra.run.smithi033.stdout: "evtrm": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "ev": 1102, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "evexg": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "evexd": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "segadd": 2, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "segex": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "segtrm": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "seg": 2, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "segexg": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "segexd": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "expos": 4194304, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "wrpos": 6510292, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "rdpos": 0, 2024-05-08T20:14:57.078 INFO:teuthology.orchestra.run.smithi033.stdout: "jlat": { 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 179, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.379220641, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.002118551 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "replayed": 0 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_mem": { 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "ino": 36, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "ino+": 428, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "ino-": 392, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "dir": 34, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "dir+": 107, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "dir-": 73, 2024-05-08T20:14:57.079 INFO:teuthology.orchestra.run.smithi033.stdout: "dn": 35, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "dn+": 654, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "dn-": 619, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "cap": 3, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "cap+": 298, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "cap-": 295, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "rss": 53116, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "heap": 198964 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_server": { 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_client_request": 732, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "dispatch_server_request": 28, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_request": 552, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_client_session": 24, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "handle_peer_request": 123, 2024-05-08T20:14:57.080 INFO:teuthology.orchestra.run.smithi033.stdout: "req_create_latency": { 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 80, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.065293273, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000816165 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getattr_latency": { 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 6, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 3.574381796, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.595730299 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getfilelock_latency": { 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.081 INFO:teuthology.orchestra.run.smithi033.stdout: "req_link_latency": { 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookup_latency": { 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 144, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.046980939, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000326256 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookuphash_latency": { 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.082 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupino_latency": { 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 1, 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000255556, 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000255556 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupname_latency": { 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupparent_latency": { 2024-05-08T20:14:57.083 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lookupsnap_latency": { 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "req_lssnap_latency": { 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.084 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mkdir_latency": { 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mknod_latency": { 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "req_mksnap_latency": { 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.085 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "req_open_latency": { 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "req_readdir_latency": { 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 49, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.026292792, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000536587 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rename_latency": { 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.086 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "req_renamesnap_latency": { 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "req_snapdiff_latency": { 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmdir_latency": { 2024-05-08T20:14:57.087 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 8, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.076684133, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.009585516 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmsnap_latency": { 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "req_rmxattr_latency": { 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setattr_latency": { 2024-05-08T20:14:57.088 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setdirlayout_latency": { 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setfilelock_latency": { 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.089 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setlayout_latency": { 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "req_setxattr_latency": { 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "req_symlink_latency": { 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.090 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "req_unlink_latency": { 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 259, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.416139017, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.001606714 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_revoke_eviction": 0, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "cap_acquisition_throttle": 0, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "req_getvxattr_latency": { 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.091 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_sessions": { 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "session_count": 2, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "session_add": 4, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "session_remove": 2, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_open": 2, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "sessions_stale": 0, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "total_load": 392, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "average_load": 196, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "avg_session_uptime": 603, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "mdthresh_evicted": 0 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-05-08T20:14:57.092 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:14:57.093 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-05-08T20:14:57.094 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 306609, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 121, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:14:57.095 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 8640, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 196, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 162538, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 885, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.096 INFO:teuthology.orchestra.run.smithi033.stdout: "objecter": { 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_active": 0, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_laggy": 0, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send": 593, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_send_bytes": 2391820, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_resend": 27, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_reply": 593, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_latency": { 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 593, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 1.697972369, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.002863359 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "op_inflight": 0, 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "oplen_avg": { 2024-05-08T20:14:57.097 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 593, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 642 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "op": 593, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "op_r": 32, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "op_w": 561, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "op_rmw": 0, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "op_pg": 0, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_stat": 0, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_create": 10, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_read": 32, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_write": 211, 2024-05-08T20:14:57.098 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writefull": 31, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_writesame": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_append": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_zero": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_truncate": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_delete": 278, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_mapext": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_sparse_read": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_clonerange": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_getxattr": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_setxattr": 20, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_cmpxattr": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_rmxattr": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_resetxattrs": 0, 2024-05-08T20:14:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_call": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_watch": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_notify": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_pgls_filter": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "osdop_other": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_active": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_send": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_resend": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "linger_ping": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_active": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_send": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "poolop_resend": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_active": 0, 2024-05-08T20:14:57.103 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_send": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "poolstat_resend": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_active": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_send": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "statfs_resend": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "command_active": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "command_send": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "command_resend": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "map_epoch": 94, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "map_full": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "map_inc": 14, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_sessions": 12, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_open": 12, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_session_close": 0, 2024-05-08T20:14:57.104 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_laggy": 0, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_wr": 48, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_rd": 0, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_del": 12 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "oft": { 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_objs": 1, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_kv_pairs": 0, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_updates": 0, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "omap_total_removes": 0 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "osd-slow-ops": { 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "slow_ops_count": 0 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "purge_queue": { 2024-05-08T20:14:57.105 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops": 0, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_ops_high_water": 10, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing": 0, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executing_high_water": 10, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_executed": 266, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "pq_item_in_journal": 0 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 5435, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 2932195, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:57.106 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 5435, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 5435, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 2932195, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_bytes": { 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-05-08T20:14:57.107 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 593, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 2419326, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 593, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 2419326, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.108 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-objecter_ops": { 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 1024, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 0, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 0, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 0, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 593, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 593, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 593, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 593, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.109 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle": { 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 266, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 27506, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 266, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-05-08T20:14:57.110 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 32, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 27506, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-write_buf_throttle-0x5574c18140a0": { 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 3758096384, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 1102, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 2315988, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:57.111 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 1102, 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 179, 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 2315988, 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:57.112 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:14:57.551 INFO:tasks.check_counter:Daemon mds.g mds.exported=26 2024-05-08T20:14:57.551 INFO:tasks.check_counter:Daemon mds.g mds.imported=26 2024-05-08T20:14:57.552 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=4 2024-05-08T20:14:57.552 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-05-08T20:14:57.552 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T20:14:57.552 DEBUG:tasks.check_counter:Getting stats from j 2024-05-08T20:14:57.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-08T20:14:57.879 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T20:14:58.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: pgmap v320: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:58 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.632 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: pgmap v320: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:58 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: pgmap v320: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 0 B/s wr, 9 op/s 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:58.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:58 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:58.937 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 201, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 191, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 1417328, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 108752, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 4, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 0, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.042695871, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.012948779, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.032461485, 2024-05-08T20:14:58.938 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.004488020, 2024-05-08T20:14:58.939 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:58.939 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 190, 2024-05-08T20:14:58.939 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.013078924, 2024-05-08T20:14:58.941 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000068836 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 1417328, 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 108752 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:14:58.942 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 6, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 149, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 3312, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 178752, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 5, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 3, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.014418311, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.008961910, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.003101584, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 147, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.013141156, 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000089395 2024-05-08T20:14:58.943 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 178752 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_messages": 0, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages": 2, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_bytes": 0, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_bytes": 0, 2024-05-08T20:14:58.944 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_created_connections": 2, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_active_connections": 1, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_total_time": 0.000518909, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_recv_time": 0.000419545, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:58.945 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "cct": { 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "total_workers": 0, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "unhealthy_workers": 0 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "mempool": { 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "bloom_filter_items": 0, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:14:58.946 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:14:58.947 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_extent_items": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_blob_items": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_txc_items": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:14:58.948 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "bluestore_writing_items": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_bytes": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_items": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_bytes": 148977, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_anon_items": 30, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "buffer_meta_items": 0, 2024-05-08T20:14:58.949 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_bytes": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_items": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_mapbl_items": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osd_pglog_items": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_bytes": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_items": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_bytes": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "pgmap_items": 0, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_bytes": 928, 2024-05-08T20:14:58.950 INFO:teuthology.orchestra.run.smithi033.stdout: "mds_co_items": 2, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_bytes": 0, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_1_items": 0, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_bytes": 0, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "unittest_2_items": 0 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "val": 0, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "max": 104857600, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "get_started": 0, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "get": 203, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "get_sum": 1388969, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_fail": 0, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "get_or_fail_success": 203, 2024-05-08T20:14:58.951 INFO:teuthology.orchestra.run.smithi033.stdout: "take": 0, 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: "take_sum": 0, 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: "put": 203, 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: "put_sum": 1388969, 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: "wait": { 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: "avgcount": 0, 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: "sum": 0.000000000, 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: "avgtime": 0.000000000 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout: } 2024-05-08T20:14:58.952 INFO:teuthology.orchestra.run.smithi033.stdout:} 2024-05-08T20:14:59.309 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-08T20:14:59.309 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-08T20:14:59.310 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-05-08T20:14:59.310 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-05-08T20:14:59.310 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-05-08T20:14:59.310 DEBUG:tasks.check_counter:Getting stats from b 2024-05-08T20:14:59.310 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-08T20:14:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:14:59.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi132 to 182.5M 2024-05-08T20:14:59.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi082 to 182.4M 2024-05-08T20:14:59.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: Unable to set osd_memory_target on smithi132 to 191379148: error parsing value: Value '191379148' is below minimum 939524096 2024-05-08T20:14:59.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: Unable to set osd_memory_target on smithi082 to 191350476: error parsing value: Value '191350476' is below minimum 939524096 2024-05-08T20:14:59.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:14:59.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:14:59.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:14:59 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:59.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi132 to 182.5M 2024-05-08T20:14:59.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi082 to 182.4M 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: Unable to set osd_memory_target on smithi132 to 191379148: error parsing value: Value '191379148' is below minimum 939524096 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: Unable to set osd_memory_target on smithi082 to 191350476: error parsing value: Value '191350476' is below minimum 939524096 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:14:59.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:14:59 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi132 to 182.5M 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi082 to 182.4M 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: Unable to set osd_memory_target on smithi132 to 191379148: error parsing value: Value '191379148' is below minimum 939524096 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: Unable to set osd_memory_target on smithi082 to 191350476: error parsing value: Value '191350476' is below minimum 939524096 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T20:14:59.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:14:59 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' 2024-05-08T20:15:00.516 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 10508, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 10557, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3388957, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 49223844, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 11, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.729983463, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.252616657, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.187090353, 2024-05-08T20:15:00.517 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.270587711, 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10559, 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 22.377851702, 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002119315 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 5131, 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000835571, 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000162 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.518 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 359456, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 89104 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 14134, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 13989, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 6937484, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 49167671, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 20, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 6, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.822581630, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.307470483, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.265557911, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.259999413, 2024-05-08T20:15:00.519 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 13990, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 10.577110183, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000756047 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 7041, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001096179, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000155 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1507136, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 421840 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:00.520 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 48068, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 94010, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 16841416, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 78670100, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 30, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 9, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 3.092944098, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 1.463776248, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 3.736868933, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.242717219, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 94001, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 20.923949993, 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000222592 2024-05-08T20:15:00.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 110188, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.014693704, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000133 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 14344800, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 43885664 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.522 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2720, 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 26.001955607, 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.009559542 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 14494, 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3.245578857, 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000223925 2024-05-08T20:15:00.523 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 23012, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 22981, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 22981, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 57.427730831, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002498922 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 31, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-05-08T20:15:00.524 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 1675, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 17, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 5, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 9157, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 6153, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 2688, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 316, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 366, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 1900, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 2, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 2, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 10, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 23540, 2024-05-08T20:15:00.525 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 23435, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 137, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 1693, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 31, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 253, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-05-08T20:15:00.526 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 7, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 63, 2024-05-08T20:15:00.527 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 2105, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 24797, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 14950, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 13256, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 2336, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 11836 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-05-08T20:15:00.528 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 147, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 311, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 9939, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 9628, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T20:15:00.529 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 137, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 22, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 48560, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 43524, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 43524, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 5036, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 9037, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 67, 2024-05-08T20:15:00.530 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 61, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 61, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 6, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 11, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 105847838, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 116096942, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 0, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1819, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 178.165910739, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.097947174 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 0 2024-05-08T20:15:00.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 4051, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 15373, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 11322, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 390, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 783, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 393, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 9157, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 22265, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 13108, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 2, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 11655, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 11653, 2024-05-08T20:15:00.532 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 125488, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 207156 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 25622, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 100, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 23012, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 159, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 283, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 11019, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 24.848869036, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002255092 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.533 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 131, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.071344604, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000544615 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 352, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.149325281, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000424219 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 10, 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.003154970, 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000315497 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 623, 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.634520832, 2024-05-08T20:15:00.537 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001018492 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 11, 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.917887774, 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.083444343 2024-05-08T20:15:00.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 853, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.340936255, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001572023 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.003354574, 2024-05-08T20:15:00.539 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001677287 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 475, 2024-05-08T20:15:00.540 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 8.403898348, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.017692417 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 4, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.019737857, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.004934464 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-05-08T20:15:00.541 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 29, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3.367224925, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.116111204 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.542 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 8, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.021241610, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.002655201 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 9464, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 17.646234765, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001864564 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.544 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 6, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 4, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 112, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 56, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 605, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 120, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 120, 2024-05-08T20:15:00.545 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:00.546 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:00.547 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 2913107, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 4776, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 1584, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 18, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T20:15:00.548 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8640, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 196, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 16630070, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 264433, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:00.549 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 26314, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 134178306, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 37, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 26314, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 26314, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2796.355615555, 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.106268739 2024-05-08T20:15:00.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 26314, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 53706 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 26314, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 96, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 26218, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1046, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 12172, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 96, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 1915, 2024-05-08T20:15:00.551 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 104, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 17, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 10287, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 24344, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-05-08T20:15:00.552 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-05-08T20:15:00.553 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 94, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 15, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 12, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 12, 2024-05-08T20:15:00.554 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 3287, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 0, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 438 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 1, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.555 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 20, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 10, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 9628, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 72706, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 18802647, 2024-05-08T20:15:00.556 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 72706, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 72706, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 18802647, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T20:15:00.557 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 26314, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 135179478, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 26314, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 135179478, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.558 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 26314, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 26314, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 26314, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 26314, 2024-05-08T20:15:00.559 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 9628, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1001172, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 9628, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:00.560 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 96, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1001172, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55b3086e20a0": { 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 84, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 48560, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 111902638, 2024-05-08T20:15:00.561 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 48560, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 1819, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 111902554, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:00.562 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T20:15:00.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:00 smithi082 ceph-mon[46774]: Adjusting osd_memory_target on smithi033 to 183.5M 2024-05-08T20:15:00.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:00 smithi082 ceph-mon[46774]: Unable to set osd_memory_target on smithi033 to 192483020: error parsing value: Value '192483020' is below minimum 939524096 2024-05-08T20:15:00.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:00 smithi082 ceph-mon[46774]: pgmap v321: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:15:00.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:00 smithi033 ceph-mon[42490]: Adjusting osd_memory_target on smithi033 to 183.5M 2024-05-08T20:15:00.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:00 smithi033 ceph-mon[42490]: Unable to set osd_memory_target on smithi033 to 192483020: error parsing value: Value '192483020' is below minimum 939524096 2024-05-08T20:15:00.830 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:00 smithi033 ceph-mon[42490]: pgmap v321: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:15:00.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:00 smithi132 ceph-mon[47484]: Adjusting osd_memory_target on smithi033 to 183.5M 2024-05-08T20:15:00.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:00 smithi132 ceph-mon[47484]: Unable to set osd_memory_target on smithi033 to 192483020: error parsing value: Value '192483020' is below minimum 939524096 2024-05-08T20:15:00.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:00 smithi132 ceph-mon[47484]: pgmap v321: 97 pgs: 97 active+clean; 25 MiB data, 721 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 0 B/s wr, 7 op/s 2024-05-08T20:15:00.887 INFO:tasks.check_counter:Daemon mds.b mds.exported=137 2024-05-08T20:15:00.887 INFO:tasks.check_counter:Daemon mds.b mds.imported=31 2024-05-08T20:15:00.887 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2024-05-08T20:15:00.887 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-05-08T20:15:00.887 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-05-08T20:15:00.887 DEBUG:tasks.check_counter:Getting stats from e 2024-05-08T20:15:00.888 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-08T20:15:01.108 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:15:02.066 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T20:15:02.066 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:02.066 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 282, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 284, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 4268315, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 87766, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.026351578, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.008864340, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.008025037, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.006192876, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 282, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.015441100, 2024-05-08T20:15:02.067 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000054755 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 678, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 778, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1596252, 2024-05-08T20:15:02.068 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 551508, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.089128313, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.028964947, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.041897295, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.020713459, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 778, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.043322735, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000055684 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.069 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1487744, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 414352 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1321, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1342, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 6557108, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 519672, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-05-08T20:15:02.070 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.137288201, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.044166647, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.036152169, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.043014657, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1339, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.062274747, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000046508 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T20:15:02.071 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 109152 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3436, 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.096998244, 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000028229 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.072 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 1659, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 1659, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 1659, 2024-05-08T20:15:02.074 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-05-08T20:15:02.075 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-05-08T20:15:02.076 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.077 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-05-08T20:15:02.078 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-05-08T20:15:02.079 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 3728, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 5, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 14551800, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 14549712, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.080 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 3728 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 12, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 1668, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 1656, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 9, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 217, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 208, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 1659, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 3175, 2024-05-08T20:15:02.081 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 1516, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 50472, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 207156 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.082 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.083 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-05-08T20:15:02.084 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-05-08T20:15:02.085 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.086 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.088 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.090 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.091 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-05-08T20:15:02.092 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 3, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 2, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 3442, 2024-05-08T20:15:02.093 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:02.094 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:02.095 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 198427, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 62, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-05-08T20:15:02.096 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8640, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 196, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 1214606, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 7335, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:02.097 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2043, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2043, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2043, 2024-05-08T20:15:02.098 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.458971221, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000714131 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2043, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2044 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2043, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2043, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1308, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-05-08T20:15:02.099 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 733, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-05-08T20:15:02.100 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-05-08T20:15:02.101 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 94, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 14, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 6, 2024-05-08T20:15:02.102 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 6, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-05-08T20:15:02.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2277, 2024-05-08T20:15:02.104 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 12201946, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2277, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2277, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 12201946, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:02.105 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2043, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 10357501, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2043, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 10357501, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.106 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2043, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2043, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2043, 2024-05-08T20:15:02.107 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2043, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:02.108 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x55b105e845a0": { 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:02.109 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:02.110 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T20:15:02.438 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-08T20:15:02.438 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-08T20:15:02.438 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-05-08T20:15:02.438 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-05-08T20:15:02.438 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T20:15:02.438 DEBUG:tasks.check_counter:Getting stats from h 2024-05-08T20:15:02.439 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-08T20:15:02.467 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:02 smithi082 ceph-mon[46774]: pgmap v322: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-05-08T20:15:02.659 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:15:02.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:02 smithi033 ceph-mon[42490]: pgmap v322: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-05-08T20:15:02.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:02 smithi132 ceph-mon[47484]: pgmap v322: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 26 op/s 2024-05-08T20:15:03.575 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T20:15:03.575 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 647, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 648, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 36578735, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 200739, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 8, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.068554307, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.014605592, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.031402870, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.016471648, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 647, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.029064658, 2024-05-08T20:15:03.576 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000044922 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2656, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1497, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1486, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 59406782, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 500904, 2024-05-08T20:15:03.577 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.163825755, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.051292290, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.062288930, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.038808939, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1485, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.101473901, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000068332 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:03.578 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 375552, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 93744 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 49, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 169, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 16791341, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 306329, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 5, 2024-05-08T20:15:03.579 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.019742093, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.005314397, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.011675409, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.001078964, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 167, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.011057670, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000066213 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 291392 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3267, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.210187135, 2024-05-08T20:15:03.581 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000064336 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-05-08T20:15:03.582 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-05-08T20:15:03.583 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-05-08T20:15:03.583 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-05-08T20:15:03.583 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.583 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 18037, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 10675, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 7362, 2024-05-08T20:15:03.584 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 2787, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 2, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-05-08T20:15:03.585 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 4, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 234, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 6, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T20:15:03.586 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-05-08T20:15:03.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-05-08T20:15:03.588 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-05-08T20:15:03.589 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 48522, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 6, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-05-08T20:15:03.590 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 105847838, 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 116098487, 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 116098403, 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.592 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 48522 2024-05-08T20:15:03.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.592 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-05-08T20:15:03.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 4039, 2024-05-08T20:15:03.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 15366, 2024-05-08T20:15:03.592 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 11327, 2024-05-08T20:15:03.592 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 382, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 780, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 398, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 18037, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 22155, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 4118, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 81360, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 207156 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-05-08T20:15:03.593 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.595 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.596 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-05-08T20:15:03.596 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.596 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.596 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.596 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.598 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.599 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-05-08T20:15:03.600 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.600 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.600 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.600 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-05-08T20:15:03.600 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.600 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.601 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.601 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-05-08T20:15:03.601 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.601 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.601 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.602 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-05-08T20:15:03.602 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.602 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.602 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.603 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-05-08T20:15:03.603 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.603 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.603 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.603 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-05-08T20:15:03.604 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.604 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.604 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.604 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-05-08T20:15:03.604 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.605 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.605 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.605 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-05-08T20:15:03.605 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.605 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.606 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.606 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-05-08T20:15:03.606 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.606 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.606 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.607 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-05-08T20:15:03.607 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.607 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.607 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.608 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-05-08T20:15:03.608 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.608 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.608 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.608 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-05-08T20:15:03.609 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.609 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.609 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.609 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-05-08T20:15:03.609 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.610 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.610 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.610 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-05-08T20:15:03.610 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.610 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.611 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.611 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-05-08T20:15:03.611 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.611 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.611 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.612 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-05-08T20:15:03.612 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.612 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.612 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.613 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-05-08T20:15:03.613 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.613 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.613 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.613 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 2, 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 5, 2024-05-08T20:15:03.614 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 3, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 4193, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:03.615 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:03.616 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T20:15:03.617 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 377071, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 4402, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:03.618 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 8640, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 196, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 22566313, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 266744, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-05-08T20:15:03.619 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 2001, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 26, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 4, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 2001, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2001, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 1.864963144, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000932015 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2001, 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 2002 2024-05-08T20:15:03.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 2001, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 2001, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 1274, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 724, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-05-08T20:15:03.621 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 2, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T20:15:03.622 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-05-08T20:15:03.623 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 94, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 10, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 10, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 10, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-05-08T20:15:03.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-05-08T20:15:03.625 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 2190, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 112567538, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 2190, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2190, 2024-05-08T20:15:03.626 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 112567538, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:03.627 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2001, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 111838185, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2001, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 111838185, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-05-08T20:15:03.628 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 2001, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 2001, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 2001, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 2001, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.629 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:03.630 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x5621d86545a0": { 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:03.631 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:03.632 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T20:15:03.954 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-08T20:15:03.954 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-08T20:15:03.954 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-05-08T20:15:03.955 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-05-08T20:15:03.955 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T20:15:03.955 DEBUG:tasks.check_counter:Getting stats from k 2024-05-08T20:15:03.955 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-08T20:15:04.215 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T20:15:04.630 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:04 smithi082 ceph-mon[46774]: pgmap v323: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:15:04.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:04 smithi033 ceph-mon[42490]: pgmap v323: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:15:04.886 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:04 smithi132 ceph-mon[47484]: pgmap v323: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.001111537, 2024-05-08T20:15:05.166 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000240031, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T20:15:05.167 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 6, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 150, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3312, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 178928, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.010303812, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.006144634, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.001974602, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:15:05.168 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 148, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.015651340, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000105752 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 178928 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:05.169 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 203, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 193, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 1417872, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 109936, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.039975180, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.011938039, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.030709302, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.004984090, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 192, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.011492941, 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000059859 2024-05-08T20:15:05.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 1417872, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 109936 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T20:15:05.171 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:05.172 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:05.173 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148977, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 30, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:05.174 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T20:15:05.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 205, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1389229, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 205, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 205, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1389229, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T20:15:05.176 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T20:15:05.177 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T20:15:05.177 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:05.177 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T20:15:05.177 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T20:15:05.528 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-05-08T20:15:05.528 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-05-08T20:15:05.529 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-05-08T20:15:05.529 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-05-08T20:15:05.529 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-05-08T20:15:05.529 DEBUG:tasks.check_counter:Getting stats from c 2024-05-08T20:15:05.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-08T20:15:05.777 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:15:06.578 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:06 smithi132 ceph-mon[47484]: pgmap v324: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:15:06.785 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-05-08T20:15:06.785 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:06.785 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 967, 2024-05-08T20:15:06.785 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 947, 2024-05-08T20:15:06.785 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 1674246, 2024-05-08T20:15:06.785 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 4624658, 2024-05-08T20:15:06.785 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 11, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 3, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.094650663, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.031205113, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.046297700, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.021077180, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 946, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.077537340, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000081963 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 19, 2024-05-08T20:15:06.786 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000002872, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000151 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1498736, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 120272 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 3098, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 8353, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 1042398, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 8781852, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 14, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 6, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.276276040, 2024-05-08T20:15:06.787 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.134336478, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.135122589, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.014977087, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 8351, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.326393545, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000039084 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 7404, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.001295433, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000174 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 865856, 2024-05-08T20:15:06.788 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 4459520 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 4545, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 4953, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 3153954, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 3966211, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 8, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 6, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.264167817, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.101760024, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.177471726, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.019385238, 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:06.789 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 4951, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.175493186, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000035446 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 7818, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.001348373, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000172 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-05-08T20:15:06.790 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 1, 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-MDSRank": { 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 688, 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 1.497363736, 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.002176400 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-PurgeQueue": { 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-05-08T20:15:06.791 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2561, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.269432458, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000105205 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": { 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "request": 1873, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "reply": 1853, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "reply_latency": { 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 1853, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 4.618548458, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.002492470 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.792 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_reply": 0, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "forward": 20, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_complete": 0, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_keys": 0, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_commit": 11, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_split": 0, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_merge": 0, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes": 45, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_top": 17, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_bottom": 13, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pin_tail": 15, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pinned": 18, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_expired": 151, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_with_caps": 1, 2024-05-08T20:15:06.793 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": 1, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "subtrees": 3, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse": 2263, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_hit": 1988, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_forward": 0, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_discover": 106, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_dir_fetch": 0, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_remote_ino": 0, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_lock": 0, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "load_cent": 0, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "q": 0, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "exported": 12, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "exported_inodes": 99, 2024-05-08T20:15:06.794 INFO:teuthology.orchestra.run.smithi132.stdout: "imported": 118, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "imported_inodes": 1506, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_dir_fetch": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_backtrace_fetch": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_peer_discover": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rfiles": 4, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rbytes": 234, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rsnaps": 4, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_set_tag": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_inotable_repaired": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_inodes": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T20:15:06.795 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_file_inodes": 0, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_inode_file_caps": 24, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_revoke": 279, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_grant": 2018, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps": 416, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps_dirty": 150, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_cap_release": 48, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "process_request_cap_release": 1865 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_cache": { 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update_receipt": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_try_discover": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_send_discover": 126, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_handle_discover": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays": 3, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_delayed": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_enqueuing": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_created": 1555, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_enqueued": 1552, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_reintegrated": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_migrated": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_processing": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_enqueued": 0, 2024-05-08T20:15:06.797 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_prioritized": 0, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_started": 0, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_completed": 0, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_exportdir": 12, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_flush": 0, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragmentdir": 0, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragstats": 0, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_inodestats": 0 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_log": { 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "evadd": 3728, 2024-05-08T20:15:06.798 INFO:teuthology.orchestra.run.smithi132.stdout: "evex": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "evtrm": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "ev": 3728, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "evexg": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "evexd": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "segadd": 5, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "segex": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "segtrm": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "seg": 5, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "segexg": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "segexd": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "expos": 4194304, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "wrpos": 14551800, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "rdpos": 0, 2024-05-08T20:15:06.799 INFO:teuthology.orchestra.run.smithi132.stdout: "jlat": { 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 360, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 1.819303900, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.005053621 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "replayed": 0 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_mem": { 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "ino": 29, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "ino+": 1656, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "ino-": 1627, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "dir": 28, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "dir+": 205, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "dir-": 177, 2024-05-08T20:15:06.800 INFO:teuthology.orchestra.run.smithi132.stdout: "dn": 45, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "dn+": 3183, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "dn-": 3138, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "cap": 1, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "cap+": 1569, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "cap-": 1568, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "rss": 62508, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "heap": 198964 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_server": { 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_client_request": 2718, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_server_request": 43, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_request": 1873, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_session": 16, 2024-05-08T20:15:06.801 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_peer_request": 161, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "req_create_latency": { 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 49, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.032751574, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000668399 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getattr_latency": { 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 9, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.010543688, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.001171520 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getfilelock_latency": { 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.802 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "req_link_latency": { 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookup_latency": { 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 96, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.034882489, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000363359 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookuphash_latency": { 2024-05-08T20:15:06.803 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupino_latency": { 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 1, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000133916, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000133916 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupname_latency": { 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupparent_latency": { 2024-05-08T20:15:06.804 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupsnap_latency": { 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lssnap_latency": { 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mkdir_latency": { 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mknod_latency": { 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mksnap_latency": { 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.806 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "req_open_latency": { 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "req_readdir_latency": { 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 143, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.084402316, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000590225 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rename_latency": { 2024-05-08T20:15:06.807 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "req_renamesnap_latency": { 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "req_snapdiff_latency": { 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.808 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmdir_latency": { 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 134, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 2.691957203, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.020089232 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmsnap_latency": { 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmxattr_latency": { 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.809 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setattr_latency": { 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setdirlayout_latency": { 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setfilelock_latency": { 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setlayout_latency": { 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setxattr_latency": { 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "req_symlink_latency": { 2024-05-08T20:15:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "req_unlink_latency": { 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 1421, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 1.763877272, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.001241292 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_revoke_eviction": 0, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_acquisition_throttle": 0, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getvxattr_latency": { 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_sessions": { 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "session_count": 1, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "session_add": 3, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "session_remove": 2, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_open": 1, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_stale": 0, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "total_load": 1612, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "average_load": 1612, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "avg_session_uptime": 615, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mdthresh_evicted": 0 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:06.814 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:06.815 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 313295, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 117, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-05-08T20:15:06.816 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 8640, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 196, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 149588, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 1268, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-05-08T20:15:06.817 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "objecter": { 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "op_active": 0, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "op_laggy": 0, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send": 2119, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send_bytes": 10679331, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "op_resend": 33, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "op_reply": 2119, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "op_latency": { 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2119, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 6.954807397, 2024-05-08T20:15:06.818 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.003282117 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "op_inflight": 0, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "oplen_avg": { 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2119, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 2163 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "op": 2119, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "op_r": 55, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "op_w": 2064, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "op_rmw": 0, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "op_pg": 0, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_stat": 0, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_create": 10, 2024-05-08T20:15:06.819 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_read": 55, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_write": 415, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writefull": 37, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writesame": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_append": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_zero": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_truncate": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_delete": 1574, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_mapext": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_sparse_read": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_clonerange": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_getxattr": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_setxattr": 20, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_cmpxattr": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_rmxattr": 0, 2024-05-08T20:15:06.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_resetxattrs": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_call": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_watch": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_notify": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls_filter": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_other": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_active": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_send": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_resend": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_ping": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_active": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_send": 0, 2024-05-08T20:15:06.821 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_resend": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_active": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_send": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_resend": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_active": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_send": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_resend": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "command_active": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "command_send": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "command_resend": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "map_epoch": 94, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "map_full": 0, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "map_inc": 14, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_sessions": 12, 2024-05-08T20:15:06.822 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_open": 12, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_close": 0, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_laggy": 0, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_wr": 40, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_rd": 0, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_del": 12 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "oft": { 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_objs": 1, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_kv_pairs": 0, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_updates": 0, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_removes": 0 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "osd-slow-ops": { 2024-05-08T20:15:06.823 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_ops_count": 0 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "purge_queue": { 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops": 0, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops_high_water": 10, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing": 0, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_high_water": 10, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executed": 1552, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_item_in_journal": 0 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:06.824 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 8606, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 4971888, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 8606, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 8606, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 4971888, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_bytes": { 2024-05-08T20:15:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 2119, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 10836483, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 2119, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 10836483, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_ops": { 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 1024, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 2119, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 2119, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 2119, 2024-05-08T20:15:06.827 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 2119, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle": { 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 1552, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 157152, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 1552, 2024-05-08T20:15:06.828 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 55, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 157152, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle-0x556af281c0a0": { 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 3728, 2024-05-08T20:15:06.829 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 10357496, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 3728, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 360, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 10357496, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:06.830 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-05-08T20:15:06.831 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:06 smithi033 ceph-mon[42490]: pgmap v324: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:15:06.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:06 smithi082 ceph-mon[46774]: pgmap v324: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-05-08T20:15:07.143 INFO:tasks.check_counter:Daemon mds.c mds.exported=12 2024-05-08T20:15:07.143 INFO:tasks.check_counter:Daemon mds.c mds.imported=118 2024-05-08T20:15:07.143 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=4 2024-05-08T20:15:07.143 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-05-08T20:15:07.143 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T20:15:07.144 DEBUG:tasks.check_counter:Getting stats from f 2024-05-08T20:15:07.144 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-08T20:15:07.367 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 206, 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 194, 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 1420592, 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 109808, 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 4, 2024-05-08T20:15:08.344 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 0, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.042203781, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.012215797, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.031610988, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.005116188, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 194, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.011497080, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000059263 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:08.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1420592, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 109808 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 2, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 147, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 320, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 178304, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 5, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 3, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.010258101, 2024-05-08T20:15:08.346 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.006364670, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.001627555, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 144, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.020264565, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000140726 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:08.347 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:08.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.348 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-08T20:15:08.348 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 178304 2024-05-08T20:15:08.348 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 0, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 2, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 0, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 0, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 2, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 1, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.000335872, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.000279132, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:15:08.349 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T20:15:08.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 0, 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-05-08T20:15:08.351 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:08.352 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:08.353 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-05-08T20:15:08.354 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 148994, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 31, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:08.355 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 928, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 2, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-05-08T20:15:08.356 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 204, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 1389099, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 204, 2024-05-08T20:15:08.357 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 204, 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 1389099, 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:08.358 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-05-08T20:15:08.698 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-05-08T20:15:08.699 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-05-08T20:15:08.699 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2024-05-08T20:15:08.699 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2024-05-08T20:15:08.699 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2024-05-08T20:15:08.699 DEBUG:tasks.check_counter:Getting stats from i 2024-05-08T20:15:08.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-08T20:15:08.729 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:08 smithi132 ceph-mon[47484]: pgmap v325: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:15:08.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:08 smithi033 ceph-mon[42490]: pgmap v325: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:15:08.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:08 smithi082 ceph-mon[46774]: pgmap v325: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-05-08T20:15:08.924 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:15:09.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:09 smithi033 ceph-mon[42490]: osdmap e95: 12 total, 12 up, 12 in 2024-05-08T20:15:09.838 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:09 smithi132 ceph-mon[47484]: osdmap e95: 12 total, 12 up, 12 in 2024-05-08T20:15:09.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:09 smithi082 ceph-mon[46774]: osdmap e95: 12 total, 12 up, 12 in 2024-05-08T20:15:10.053 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 2065, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 2067, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 2898271, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 642222, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 6, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 2, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.183338530, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.058421468, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.046148370, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.062614375, 2024-05-08T20:15:10.054 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2065, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.085225277, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000041271 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.055 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 239, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 214, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 1495820, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 113516, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 3, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 2, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.042979484, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.012983854, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.031656890, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.005371354, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 213, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.013562113, 2024-05-08T20:15:10.056 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000063671 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1495264, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 112832 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 7, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 149, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 3580, 2024-05-08T20:15:10.057 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 411591, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 6, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 4, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.010100438, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.005823137, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.002495382, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000026056, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 147, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.014995022, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000102006 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 411280 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 1, 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.059 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-MDSRank": { 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 3497, 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.100045774, 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000028609 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "finisher-PurgeQueue": { 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "queue_len": 0, 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "complete_latency": { 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.060 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": { 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "request": 0, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "reply": 0, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "reply_latency": { 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_reply": 0, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "forward": 0, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_complete": 0, 2024-05-08T20:15:10.061 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_fetch_keys": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_commit": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_split": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_merge": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes": 277, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_top": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_bottom": 277, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pin_tail": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_pinned": 277, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_expired": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "inodes_with_caps": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": 0, 2024-05-08T20:15:10.062 INFO:teuthology.orchestra.run.smithi132.stdout: "subtrees": 1, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse": 0, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_hit": 0, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_forward": 0, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_discover": 0, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_dir_fetch": 0, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_remote_ino": 0, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "traverse_lock": 0, 2024-05-08T20:15:10.063 INFO:teuthology.orchestra.run.smithi132.stdout: "load_cent": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "q": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "exported": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "exported_inodes": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "imported": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "imported_inodes": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_dir_fetch": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_backtrace_fetch": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "openino_peer_discover": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rfiles": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rbytes": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "root_rsnaps": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_set_tag": 0, 2024-05-08T20:15:10.064 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_inotable_repaired": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_inodes": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "scrub_file_inodes": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_inode_file_caps": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_grant": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T20:15:10.065 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_caps_dirty": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_cap_release": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "process_request_cap_release": 0 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_cache": { 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_update_receipt": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_try_discover": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_send_discover": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "dir_handle_discover": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_delayed": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "num_strays_enqueuing": 0, 2024-05-08T20:15:10.066 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_created": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_enqueued": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_reintegrated": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "strays_migrated": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_processing": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_enqueued": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "num_recovering_prioritized": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_started": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_completed": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_exportdir": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_flush": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragmentdir": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_fragstats": 0, 2024-05-08T20:15:10.067 INFO:teuthology.orchestra.run.smithi132.stdout: "ireq_inodestats": 0 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_log": { 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "evadd": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "evex": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "evtrm": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "ev": 1102, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "evexg": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "evexd": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "segadd": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "segex": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "segtrm": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "seg": 2, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "segexg": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "segexd": 0, 2024-05-08T20:15:10.068 INFO:teuthology.orchestra.run.smithi132.stdout: "expos": 4194304, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "wrpos": 6510292, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "rdpos": 6508204, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "jlat": { 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "replayed": 1102 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_mem": { 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "ino": 10, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "ino+": 440, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "ino-": 430, 2024-05-08T20:15:10.069 INFO:teuthology.orchestra.run.smithi132.stdout: "dir": 4, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "dir+": 118, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "dir-": 114, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "dn": 277, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "dn+": 638, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "dn-": 361, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "cap": 0, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "cap+": 0, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "cap-": 0, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "rss": 52836, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "heap": 207156 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_server": { 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_client_request": 0, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "dispatch_server_request": 0, 2024-05-08T20:15:10.070 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_request": 0, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_client_session": 0, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "handle_peer_request": 0, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "req_create_latency": { 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getattr_latency": { 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getfilelock_latency": { 2024-05-08T20:15:10.071 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "req_link_latency": { 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookup_latency": { 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookuphash_latency": { 2024-05-08T20:15:10.072 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupino_latency": { 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.073 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupname_latency": { 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupparent_latency": { 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lookupsnap_latency": { 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.074 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "req_lssnap_latency": { 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mkdir_latency": { 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mknod_latency": { 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.075 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "req_mksnap_latency": { 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "req_open_latency": { 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "req_readdir_latency": { 2024-05-08T20:15:10.076 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rename_latency": { 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "req_renamesnap_latency": { 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.077 INFO:teuthology.orchestra.run.smithi132.stdout: "req_snapdiff_latency": { 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmdir_latency": { 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmsnap_latency": { 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "req_rmxattr_latency": { 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setattr_latency": { 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setdirlayout_latency": { 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setfilelock_latency": { 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setlayout_latency": { 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.080 INFO:teuthology.orchestra.run.smithi132.stdout: "req_setxattr_latency": { 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "req_symlink_latency": { 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "req_unlink_latency": { 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.081 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_revoke_eviction": 0, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "cap_acquisition_throttle": 0, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "req_getvxattr_latency": { 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_sessions": { 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "session_count": 2, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "session_add": 4, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "session_remove": 2, 2024-05-08T20:15:10.082 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_open": 4, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "sessions_stale": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "total_load": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "average_load": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "avg_session_uptime": 3459, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "mdthresh_evicted": 0 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:10.083 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:10.084 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:10.085 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 181517, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 53, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:10.086 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 8640, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 196, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 227821, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 1435, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-05-08T20:15:10.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "objecter": { 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_active": 0, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_laggy": 0, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send": 2068, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_send_bytes": 21, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_resend": 3, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_reply": 2068, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_latency": { 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2068, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 1.118969164, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000541087 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "op_inflight": 0, 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "oplen_avg": { 2024-05-08T20:15:10.088 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 2068, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 2069 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "op": 2068, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "op_r": 2068, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "op_w": 0, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "op_rmw": 0, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "op_pg": 0, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_stat": 1322, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_create": 0, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_read": 744, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_write": 0, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writefull": 0, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_writesame": 0, 2024-05-08T20:15:10.089 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_append": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_zero": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_truncate": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_delete": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_mapext": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_sparse_read": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_clonerange": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_getxattr": 1, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_setxattr": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_cmpxattr": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_rmxattr": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_resetxattrs": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_call": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_watch": 0, 2024-05-08T20:15:10.090 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_notify": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_pgls_filter": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "osdop_other": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_active": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_send": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_resend": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "linger_ping": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_active": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_send": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "poolop_resend": 0, 2024-05-08T20:15:10.091 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_active": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_send": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "poolstat_resend": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_active": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_send": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "statfs_resend": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "command_active": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "command_send": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "command_resend": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "map_epoch": 95, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "map_full": 0, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "map_inc": 15, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_sessions": 4, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_open": 4, 2024-05-08T20:15:10.092 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_session_close": 0, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_laggy": 0, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_wr": 0, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_rd": 2, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_del": 0 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "oft": { 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_objs": 0, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_kv_pairs": 0, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_updates": 0, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "omap_total_removes": 0 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "osd-slow-ops": { 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "slow_ops_count": 0 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.093 INFO:teuthology.orchestra.run.smithi132.stdout: "purge_queue": { 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops": 0, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing": 0, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executing_high_water": 0, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_executed": 0, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "pq_item_in_journal": 0 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 2307, 2024-05-08T20:15:10.094 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 4175024, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 2307, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 2307, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 4175024, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.095 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_bytes": { 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 2068, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 2315993, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 2068, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 2315993, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.096 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-objecter_ops": { 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 1024, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 2068, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 2068, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 2068, 2024-05-08T20:15:10.097 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 2068, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle": { 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-05-08T20:15:10.098 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-write_buf_throttle-0x5654d8d625a0": { 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:10.099 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 3758096384, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.100 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:10.101 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-05-08T20:15:10.416 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-05-08T20:15:10.416 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-05-08T20:15:10.416 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=0 2024-05-08T20:15:10.416 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-05-08T20:15:10.416 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-05-08T20:15:10.416 DEBUG:tasks.check_counter:Getting stats from l 2024-05-08T20:15:10.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:d21e4f961318b56f0d915caa2490c3711bf13c34 shell --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-08T20:15:10.681 INFO:teuthology.orchestra.run.smithi132.stderr:Inferring config /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T20:15:10.809 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:10 smithi132 ceph-mon[47484]: pgmap v327: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:15:10.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:10 smithi033 ceph-mon[42490]: pgmap v327: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:15:10.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:10 smithi082 ceph-mon[46774]: pgmap v327: 97 pgs: 97 active+clean; 25 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-05-08T20:15:11.717 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-05-08T20:15:11.717 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 4, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 4, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 2992, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 448, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 4, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 0, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.001641167, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.000037841, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.000765978, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:15:11.718 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 3, 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000800913, 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000266971 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T20:15:11.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 206, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 196, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 1419312, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 111472, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 2, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 1, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.041634037, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.012188521, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.032105529, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.005348839, 2024-05-08T20:15:11.720 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 195, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.011980855, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000061440 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 1419312, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 111472 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.721 INFO:teuthology.orchestra.run.smithi132.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_messages": 2, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages": 150, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_bytes": 320, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_bytes": 178832, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_created_connections": 5, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_active_connections": 3, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_total_time": 0.009954561, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_send_time": 0.006304593, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_recv_time": 0.001438484, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T20:15:11.722 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 147, 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.019788858, 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000134618 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_handle_ack_lat": { 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: "msgr_send_encrypted_bytes": 178832 2024-05-08T20:15:11.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "cct": { 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "total_workers": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "unhealthy_workers": 0 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "mempool": { 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_bytes": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bloom_filter_items": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_alloc_items": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_data_items": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T20:15:11.724 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_other_items": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_bytes": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_extent_items": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_bytes": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_blob_items": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T20:15:11.725 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_fsck_items": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_bytes": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_txc_items": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_bytes": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluestore_writing_items": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_bytes": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_items": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_reader_items": 0, 2024-05-08T20:15:11.726 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "bluefs_file_writer_items": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_bytes": 149017, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_anon_items": 31, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_bytes": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "buffer_meta_items": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_bytes": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_items": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_bytes": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_mapbl_items": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_bytes": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_pglog_items": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_bytes": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_items": 0, 2024-05-08T20:15:11.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_mapping_items": 0, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_bytes": 0, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "pgmap_items": 0, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_bytes": 928, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_co_items": 2, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_bytes": 0, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_1_items": 0, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_bytes": 0, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "unittest_2_items": 0 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T20:15:11.728 INFO:teuthology.orchestra.run.smithi132.stdout: "val": 0, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "max": 104857600, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "get_started": 0, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "get": 208, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "get_sum": 1390256, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_fail": 0, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "get_or_fail_success": 208, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "take": 0, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "take_sum": 0, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "put": 208, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "put_sum": 1390256, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "wait": { 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "avgcount": 0, 2024-05-08T20:15:11.729 INFO:teuthology.orchestra.run.smithi132.stdout: "sum": 0.000000000, 2024-05-08T20:15:11.730 INFO:teuthology.orchestra.run.smithi132.stdout: "avgtime": 0.000000000 2024-05-08T20:15:11.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:11.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-05-08T20:15:11.730 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-05-08T20:15:12.090 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-05-08T20:15:12.090 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-05-08T20:15:12.090 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-05-08T20:15:12.090 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-05-08T20:15:12.090 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-05-08T20:15:12.090 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T20:15:12.108 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T20:15:12.109 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T20:15:12.109 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:15:12.133 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2024-05-08T20:15:12.133 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T20:15:12.196 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:15:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 -- 172.21.15.33:0/4184354890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101a10 msgr2=0x7fc46c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 --2- 172.21.15.33:0/4184354890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101a10 0x7fc46c105a50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009990 tx=0x7fc45c009ca0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.387 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 -- 172.21.15.33:0/4184354890 shutdown_connections 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 --2- 172.21.15.33:0/4184354890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc46c106180 0x7fc46c10dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 --2- 172.21.15.33:0/4184354890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c101060 0x7fc46c101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 --2- 172.21.15.33:0/4184354890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101a10 0x7fc46c105a50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 -- 172.21.15.33:0/4184354890 >> 172.21.15.33:0/4184354890 conn(0x7fc46c078360 msgr2=0x7fc46c078770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 -- 172.21.15.33:0/4184354890 shutdown_connections 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 -- 172.21.15.33:0/4184354890 wait complete. 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.387+0000 7fc47133c700 1 Processor -- start 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc47133c700 1 -- start start 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc47133c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101060 0x7fc46c199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc47133c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc46c106180 0x7fc46c199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc47133c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c19df10 0x7fc46c19e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc47133c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c19e990 con 0x7fc46c101060 2024-05-08T20:15:12.388 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc47133c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c19eb00 con 0x7fc46c19df10 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc47133c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c19ecc0 con 0x7fc46c106180 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101060 0x7fc46c199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101060 0x7fc46c199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43104/0 (socket says 172.21.15.33:43104) 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 -- 172.21.15.33:0/1127760230 learned_addr learned my addr 172.21.15.33:0/1127760230 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46a7fc700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc46c106180 0x7fc46c199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46b7fe700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c19df10 0x7fc46c19e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 -- 172.21.15.33:0/1127760230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc46c106180 msgr2=0x7fc46c199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc46c106180 0x7fc46c199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 -- 172.21.15.33:0/1127760230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c19df10 msgr2=0x7fc46c19e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c19df10 0x7fc46c19e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46affd700 1 -- 172.21.15.33:0/1127760230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0095f0 con 0x7fc46c101060 2024-05-08T20:15:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.388+0000 7fc46a7fc700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc46c106180 0x7fc46c199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T20:15:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.389+0000 7fc46affd700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101060 0x7fc46c199680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc46000d950 tx=0x7fc46000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.389+0000 7fc453fff700 1 -- 172.21.15.33:0/1127760230 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000f890 con 0x7fc46c101060 2024-05-08T20:15:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.389+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c1a6220 con 0x7fc46c101060 2024-05-08T20:15:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.389+0000 7fc453fff700 1 -- 172.21.15.33:0/1127760230 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc460010460 con 0x7fc46c101060 2024-05-08T20:15:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.389+0000 7fc453fff700 1 -- 172.21.15.33:0/1127760230 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46000e610 con 0x7fc46c101060 2024-05-08T20:15:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.389+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c1a6700 con 0x7fc46c101060 2024-05-08T20:15:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.390+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c102530 con 0x7fc46c101060 2024-05-08T20:15:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.391+0000 7fc453fff700 1 -- 172.21.15.33:0/1127760230 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc460010960 con 0x7fc46c101060 2024-05-08T20:15:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.392+0000 7fc453fff700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4540a1290 0x7fc4540a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.392+0000 7fc46a7fc700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4540a1290 0x7fc4540a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.392+0000 7fc453fff700 1 -- 172.21.15.33:0/1127760230 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8716+0+0 (secure 0 0 0) 0x7fc4600ccb20 con 0x7fc46c101060 2024-05-08T20:15:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.393+0000 7fc46a7fc700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4540a1290 0x7fc4540a3750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc46c19ab80 tx=0x7fc45c005fd0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:12.394 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.397+0000 7fc453fff700 1 -- 172.21.15.33:0/1127760230 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc460095eb0 con 0x7fc46c101060 2024-05-08T20:15:12.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:12 smithi033 ceph-mon[42490]: pgmap v328: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:15:12.617 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.619+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc46c101a10 con 0x7fc46c101060 2024-05-08T20:15:12.619 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.621+0000 7fc453fff700 1 -- 172.21.15.33:0/1127760230 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+23263 (secure 0 0 0) 0x7fc460016090 con 0x7fc46c101060 2024-05-08T20:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:15:12.619 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:15:08.467285+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6801/3089330166":"2024-05-09T20:04:45.212378+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/2345595459":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1758089139":"2024-05-09T20:04:45.212378+0000","172.21.15.33:6800/3089330166":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3850877935":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1526464392":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/3915505292":"2024-05-09T20:04:45.212378+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_removed_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4540a1290 msgr2=0x7fc4540a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4540a1290 0x7fc4540a3750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc46c19ab80 tx=0x7fc45c005fd0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101060 msgr2=0x7fc46c199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101060 0x7fc46c199680 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc46000d950 tx=0x7fc46000dc60 comp rx=0 tx=0).stop 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 shutdown_connections 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc46c19df10 0x7fc46c19e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc4540a1290 0x7fc4540a3750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc46c101060 0x7fc46c199680 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 --2- 172.21.15.33:0/1127760230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc46c106180 0x7fc46c199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.623+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 >> 172.21.15.33:0/1127760230 conn(0x7fc46c078360 msgr2=0x7fc46c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.624+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 shutdown_connections 2024-05-08T20:15:12.623 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.624+0000 7fc47133c700 1 -- 172.21.15.33:0/1127760230 wait complete. 2024-05-08T20:15:12.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T20:00:17.595088+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T20:03:27.926660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T20:03:28.993433+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '95', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 95, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T20:15:12.636 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T20:15:12.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1625795331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc0100ab0 msgr2=0x7f9cc010ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.779 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1625795331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc0100ab0 0x7f9cc010ccc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800b0d0 tx=0x7f9cb800b3e0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1625795331 shutdown_connections 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1625795331 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc0100ab0 0x7f9cc010ccc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1625795331 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cc0105f90 0x7f9cc0106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1625795331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc01000f0 0x7f9cc0100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1625795331 >> 172.21.15.33:0/1625795331 conn(0x7f9cc0076ba0 msgr2=0x7f9cc0076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1625795331 shutdown_connections 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.778+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1625795331 wait complete. 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 Processor -- start 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 -- start start 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc01000f0 0x7f9cc01997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc0100ab0 0x7f9cc0199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cc0105f90 0x7f9cc019d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.780 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019d600 con 0x7f9cc01000f0 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019d770 con 0x7f9cc0105f90 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc7f41700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc019d930 con 0x7f9cc0100ab0 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc5cdd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc01000f0 0x7f9cc01997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc5cdd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc01000f0 0x7f9cc01997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43114/0 (socket says 172.21.15.33:43114) 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.779+0000 7f9cc5cdd700 1 -- 172.21.15.33:0/1203224392 learned_addr learned my addr 172.21.15.33:0/1203224392 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc64de700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cc0105f90 0x7f9cc019d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc54dc700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc0100ab0 0x7f9cc0199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc5cdd700 1 -- 172.21.15.33:0/1203224392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc0100ab0 msgr2=0x7f9cc0199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc5cdd700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc0100ab0 0x7f9cc0199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc5cdd700 1 -- 172.21.15.33:0/1203224392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cc0105f90 msgr2=0x7f9cc019d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc5cdd700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cc0105f90 0x7f9cc019d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc5cdd700 1 -- 172.21.15.33:0/1203224392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009d00 con 0x7f9cc01000f0 2024-05-08T20:15:12.781 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc5cdd700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc01000f0 0x7f9cc01997d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00d980 tx=0x7f9cbc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:12.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cb6ffd700 1 -- 172.21.15.33:0/1203224392 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00f890 con 0x7f9cc01000f0 2024-05-08T20:15:12.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cb6ffd700 1 -- 172.21.15.33:0/1203224392 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9cbc010460 con 0x7f9cc01000f0 2024-05-08T20:15:12.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc019dc10 con 0x7f9cc01000f0 2024-05-08T20:15:12.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cb6ffd700 1 -- 172.21.15.33:0/1203224392 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc0195c0 con 0x7f9cc01000f0 2024-05-08T20:15:12.782 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.780+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a6570 con 0x7f9cc01000f0 2024-05-08T20:15:12.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.782+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc0101560 con 0x7f9cc01000f0 2024-05-08T20:15:12.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.783+0000 7f9cb6ffd700 1 -- 172.21.15.33:0/1203224392 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f9cbc010940 con 0x7f9cc01000f0 2024-05-08T20:15:12.783 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.784+0000 7f9cb6ffd700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9cac0a1290 0x7f9cac0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:12.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.784+0000 7f9cc54dc700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9cac0a1290 0x7f9cac0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:12.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.784+0000 7f9cb6ffd700 1 -- 172.21.15.33:0/1203224392 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8716+0+0 (secure 0 0 0) 0x7f9cbc0ccfd0 con 0x7f9cc01000f0 2024-05-08T20:15:12.784 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.785+0000 7f9cc54dc700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9cac0a1290 0x7f9cac0a3750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cc019ad20 tx=0x7f9cb0009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:12.787 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:12.789+0000 7f9cb6ffd700 1 -- 172.21.15.33:0/1203224392 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9cbc096300 con 0x7f9cc01000f0 2024-05-08T20:15:12.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:12 smithi082 ceph-mon[46774]: pgmap v328: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:15:12.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:12 smithi132 ceph-mon[47484]: pgmap v328: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:15:13.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.005+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cc0111010 con 0x7f9cc01000f0 2024-05-08T20:15:13.004 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.006+0000 7f9cb6ffd700 1 -- 172.21.15.33:0/1203224392 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cbc0160a0 con 0x7f9cc01000f0 2024-05-08T20:15:13.004 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2024-05-08T20:15:13.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9cac0a1290 msgr2=0x7f9cac0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9cac0a1290 0x7f9cac0a3750 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cc019ad20 tx=0x7f9cb0009260 comp rx=0 tx=0).stop 2024-05-08T20:15:13.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc01000f0 msgr2=0x7f9cc01997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc01000f0 0x7f9cc01997d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc00d980 tx=0x7f9cbc00dc90 comp rx=0 tx=0).stop 2024-05-08T20:15:13.006 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 shutdown_connections 2024-05-08T20:15:13.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9cc0105f90 0x7f9cc019d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9cac0a1290 0x7f9cac0a3750 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9cc01000f0 0x7f9cc01997d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 --2- 172.21.15.33:0/1203224392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc0100ab0 0x7f9cc0199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 >> 172.21.15.33:0/1203224392 conn(0x7f9cc0076ba0 msgr2=0x7f9cc010b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:13.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 shutdown_connections 2024-05-08T20:15:13.007 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.008+0000 7f9cc7f41700 1 -- 172.21.15.33:0/1203224392 wait complete. 2024-05-08T20:15:13.020 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T20:15:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 -- 172.21.15.33:0/715105545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ff410 msgr2=0x7f33240ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 --2- 172.21.15.33:0/715105545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ff410 0x7f33240ff890 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f3318009990 tx=0x7f3318009ca0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 -- 172.21.15.33:0/715105545 shutdown_connections 2024-05-08T20:15:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 --2- 172.21.15.33:0/715105545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33240ffdd0 0x7f332410dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 --2- 172.21.15.33:0/715105545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3324105ef0 0x7f33241062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.162 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 --2- 172.21.15.33:0/715105545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ff410 0x7f33240ff890 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 -- 172.21.15.33:0/715105545 >> 172.21.15.33:0/715105545 conn(0x7f33240763a0 msgr2=0x7f33240fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 -- 172.21.15.33:0/715105545 shutdown_connections 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 -- 172.21.15.33:0/715105545 wait complete. 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 Processor -- start 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.162+0000 7f332c28c700 1 -- start start 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332c28c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33240ff410 0x7f33241005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332c28c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ffdd0 0x7f3324100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332c28c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3324105ef0 0x7f3324101070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332c28c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33241a5950 con 0x7f33240ffdd0 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332c28c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33241a5ac0 con 0x7f3324105ef0 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332c28c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33241a5c80 con 0x7f33240ff410 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ffdd0 0x7f3324100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.163 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ffdd0 0x7f3324100b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43136/0 (socket says 172.21.15.33:43136) 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 -- 172.21.15.33:0/2003026583 learned_addr learned my addr 172.21.15.33:0/2003026583 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332a028700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33240ff410 0x7f33241005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f332a829700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3324105ef0 0x7f3324101070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 -- 172.21.15.33:0/2003026583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33240ff410 msgr2=0x7f33241005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33240ff410 0x7f33241005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 -- 172.21.15.33:0/2003026583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3324105ef0 msgr2=0x7f3324101070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3324105ef0 0x7f3324101070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 -- 172.21.15.33:0/2003026583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180095f0 con 0x7f33240ffdd0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.163+0000 7f3329827700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ffdd0 0x7f3324100b30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3318000c00 tx=0x7f3318004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.164+0000 7f33177fe700 1 -- 172.21.15.33:0/2003026583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331801d070 con 0x7f33240ffdd0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.164+0000 7f33177fe700 1 -- 172.21.15.33:0/2003026583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3318022470 con 0x7f33240ffdd0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.164+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33241a5f00 con 0x7f33240ffdd0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.164+0000 7f33177fe700 1 -- 172.21.15.33:0/2003026583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3318017650 con 0x7f33240ffdd0 2024-05-08T20:15:13.164 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.164+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33241a62c0 con 0x7f33240ffdd0 2024-05-08T20:15:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.165+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3324109480 con 0x7f33240ffdd0 2024-05-08T20:15:13.165 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.166+0000 7f33177fe700 1 -- 172.21.15.33:0/2003026583 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f33180225e0 con 0x7f33240ffdd0 2024-05-08T20:15:13.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.166+0000 7f33177fe700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f33100a1290 0x7f33100a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.167+0000 7f332a028700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f33100a1290 0x7f33100a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.167+0000 7f33177fe700 1 -- 172.21.15.33:0/2003026583 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8716+0+0 (secure 0 0 0) 0x7f33180ce2b0 con 0x7f33240ffdd0 2024-05-08T20:15:13.166 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.167+0000 7f332a028700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f33100a1290 0x7f33100a3750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3320009be0 tx=0x7f3320009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:13.168 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.170+0000 7f33177fe700 1 -- 172.21.15.33:0/2003026583 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f33180976d0 con 0x7f33240ffdd0 2024-05-08T20:15:13.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.388+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3324101ad0 con 0x7f33240ffdd0 2024-05-08T20:15:13.386 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.388+0000 7f33177fe700 1 -- 172.21.15.33:0/2003026583 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7f331809acf0 con 0x7f33240ffdd0 2024-05-08T20:15:13.387 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.390+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f33100a1290 msgr2=0x7f33100a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.390+0000 7f332c28c700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f33100a1290 0x7f33100a3750 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3320009be0 tx=0x7f3320009260 comp rx=0 tx=0).stop 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.390+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ffdd0 msgr2=0x7f3324100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.390+0000 7f332c28c700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ffdd0 0x7f3324100b30 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3318000c00 tx=0x7f3318004730 comp rx=0 tx=0).stop 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 shutdown_connections 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3324105ef0 0x7f3324101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33240ff410 0x7f33241005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f33100a1290 0x7f33100a3750 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.389 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 --2- 172.21.15.33:0/2003026583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33240ffdd0 0x7f3324100b30 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 >> 172.21.15.33:0/2003026583 conn(0x7f33240763a0 msgr2=0x7f33241040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:13.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 shutdown_connections 2024-05-08T20:15:13.390 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.391+0000 7f332c28c700 1 -- 172.21.15.33:0/2003026583 wait complete. 2024-05-08T20:15:13.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 -- 172.21.15.33:0/2954894163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f841000f0 msgr2=0x7f8f84100570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 --2- 172.21.15.33:0/2954894163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f841000f0 0x7f8f84100570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8f740099c0 tx=0x7f8f74009cd0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 -- 172.21.15.33:0/2954894163 shutdown_connections 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 --2- 172.21.15.33:0/2954894163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f84100ab0 0x7f8f8410ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 --2- 172.21.15.33:0/2954894163 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f84105f90 0x7f8f84106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 --2- 172.21.15.33:0/2954894163 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f841000f0 0x7f8f84100570 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 -- 172.21.15.33:0/2954894163 >> 172.21.15.33:0/2954894163 conn(0x7f8f84076ba0 msgr2=0x7f8f84076fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 -- 172.21.15.33:0/2954894163 shutdown_connections 2024-05-08T20:15:13.544 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.545+0000 7f8f88a18700 1 -- 172.21.15.33:0/2954894163 wait complete. 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.546+0000 7f8f88a18700 1 Processor -- start 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.546+0000 7f8f88a18700 1 -- start start 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f88a18700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f841000f0 0x7f8f84197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f88a18700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f84100ab0 0x7f8f84197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f88a18700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f84105f90 0x7f8f8419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f88a18700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8419c300 con 0x7f8f84105f90 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f88a18700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8419c470 con 0x7f8f84100ab0 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f88a18700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8419c630 con 0x7f8f841000f0 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f84105f90 0x7f8f8419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f84105f90 0x7f8f8419bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43140/0 (socket says 172.21.15.33:43140) 2024-05-08T20:15:13.547 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 -- 172.21.15.33:0/3285187868 learned_addr learned my addr 172.21.15.33:0/3285187868 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f8259c700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f841000f0 0x7f8f84197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f81d9b700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f84100ab0 0x7f8f84197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 -- 172.21.15.33:0/3285187868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f841000f0 msgr2=0x7f8f84197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f841000f0 0x7f8f84197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 -- 172.21.15.33:0/3285187868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f84100ab0 msgr2=0x7f8f84197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f84100ab0 0x7f8f84197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 -- 172.21.15.33:0/3285187868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f740095f0 con 0x7f8f84105f90 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f82d9d700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f84105f90 0x7f8f8419bcc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c007ee0 tx=0x7f8f7c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.547+0000 7f8f737fe700 1 -- 172.21.15.33:0/3285187868 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c00dd20 con 0x7f8f84105f90 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.548+0000 7f8f737fe700 1 -- 172.21.15.33:0/3285187868 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8f7c00f040 con 0x7f8f84105f90 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.548+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8419c910 con 0x7f8f84105f90 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.548+0000 7f8f737fe700 1 -- 172.21.15.33:0/3285187868 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c015400 con 0x7f8f84105f90 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.548+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f841a4150 con 0x7f8f84105f90 2024-05-08T20:15:13.548 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.549+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f84108340 con 0x7f8f84105f90 2024-05-08T20:15:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.550+0000 7f8f737fe700 1 -- 172.21.15.33:0/3285187868 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8f7c003a00 con 0x7f8f84105f90 2024-05-08T20:15:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.550+0000 7f8f737fe700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f8f6c0a1310 0x7f8f6c0a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.551+0000 7f8f737fe700 1 -- 172.21.15.33:0/3285187868 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8716+0+0 (secure 0 0 0) 0x7f8f7c0cce40 con 0x7f8f84105f90 2024-05-08T20:15:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.551+0000 7f8f8259c700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f8f6c0a1310 0x7f8f6c0a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.549 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.551+0000 7f8f8259c700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f8f6c0a1310 0x7f8f6c0a37d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f84067bb0 tx=0x7f8f78009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:13.552 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.554+0000 7f8f737fe700 1 -- 172.21.15.33:0/3285187868 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8f7c0961d0 con 0x7f8f84105f90 2024-05-08T20:15:13.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.773+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f841986e0 con 0x7f8f84105f90 2024-05-08T20:15:13.771 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.773+0000 7f8f737fe700 1 -- 172.21.15.33:0/3285187868 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f7c0997f0 con 0x7f8f84105f90 2024-05-08T20:15:13.771 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f8f6c0a1310 msgr2=0x7f8f6c0a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f8f6c0a1310 0x7f8f6c0a37d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8f84067bb0 tx=0x7f8f78009260 comp rx=0 tx=0).stop 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f84105f90 msgr2=0x7f8f8419bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f84105f90 0x7f8f8419bcc0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c007ee0 tx=0x7f8f7c00d3b0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 shutdown_connections 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f8f6c0a1310 0x7f8f6c0a37d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f84105f90 0x7f8f8419bcc0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.774 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f841000f0 0x7f8f84197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 --2- 172.21.15.33:0/3285187868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f84100ab0 0x7f8f84197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 >> 172.21.15.33:0/3285187868 conn(0x7f8f84076ba0 msgr2=0x7f8f840fee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 shutdown_connections 2024-05-08T20:15:13.775 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.776+0000 7f8f88a18700 1 -- 172.21.15.33:0/3285187868 wait complete. 2024-05-08T20:15:13.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:13 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1127760230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:15:13.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:13 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1203224392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:15:13.787 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:13 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2003026583' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:15:13.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-08T20:15:13.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:13 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1127760230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:15:13.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:13 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1203224392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:15:13.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:13 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2003026583' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:15:13.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:13 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1127760230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:15:13.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:13 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1203224392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T20:15:13.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:13 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2003026583' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T20:15:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 -- 172.21.15.33:0/1271058823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c101b90 msgr2=0x7f848c105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1271058823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c101b90 0x7f848c105bd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8480009990 tx=0x7f8480009ca0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 -- 172.21.15.33:0/1271058823 shutdown_connections 2024-05-08T20:15:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1271058823 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c106300 0x7f848c10de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1271058823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1011e0 0x7f848c1015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.930 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1271058823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c101b90 0x7f848c105bd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 -- 172.21.15.33:0/1271058823 >> 172.21.15.33:0/1271058823 conn(0x7f848c0fca80 msgr2=0x7f848c0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 -- 172.21.15.33:0/1271058823 shutdown_connections 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.928+0000 7f8491eb4700 1 -- 172.21.15.33:0/1271058823 wait complete. 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 Processor -- start 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 -- start start 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1011e0 0x7f848c0732a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c106300 0x7f848c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c073d20 0x7f848c1a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.931 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1a5d50 con 0x7f848c106300 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1a5ec0 con 0x7f848c073d20 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f8491eb4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1a6080 con 0x7f848c1011e0 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f848affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c106300 0x7f848c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f848affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c106300 0x7f848c0737e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43162/0 (socket says 172.21.15.33:43162) 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.929+0000 7f848affd700 1 -- 172.21.15.33:0/1837058079 learned_addr learned my addr 172.21.15.33:0/1837058079 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848bfff700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c073d20 0x7f848c1a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848b7fe700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1011e0 0x7f848c0732a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848affd700 1 -- 172.21.15.33:0/1837058079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1011e0 msgr2=0x7f848c0732a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848affd700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1011e0 0x7f848c0732a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848affd700 1 -- 172.21.15.33:0/1837058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c073d20 msgr2=0x7f848c1a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848affd700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c073d20 0x7f848c1a5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848affd700 1 -- 172.21.15.33:0/1837058079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800095f0 con 0x7f848c106300 2024-05-08T20:15:13.932 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848b7fe700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1011e0 0x7f848c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:15:13.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f848affd700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c106300 0x7f848c0737e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f84800059d0 tx=0x7f8480004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:13.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f8488ff9700 1 -- 172.21.15.33:0/1837058079 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848001d070 con 0x7f848c106300 2024-05-08T20:15:13.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c1a6300 con 0x7f848c106300 2024-05-08T20:15:13.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f8488ff9700 1 -- 172.21.15.33:0/1837058079 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f848000bed0 con 0x7f848c106300 2024-05-08T20:15:13.933 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f8488ff9700 1 -- 172.21.15.33:0/1837058079 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84800173f0 con 0x7f848c106300 2024-05-08T20:15:13.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.930+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c1a6730 con 0x7f848c106300 2024-05-08T20:15:13.934 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.931+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c1095d0 con 0x7f848c106300 2024-05-08T20:15:13.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.933+0000 7f8488ff9700 1 -- 172.21.15.33:0/1837058079 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f8480022470 con 0x7f848c106300 2024-05-08T20:15:13.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.933+0000 7f8488ff9700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f84740a1290 0x7f84740a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:13.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.933+0000 7f8488ff9700 1 -- 172.21.15.33:0/1837058079 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8716+0+0 (secure 0 0 0) 0x7f84800ce460 con 0x7f848c106300 2024-05-08T20:15:13.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.933+0000 7f848b7fe700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f84740a1290 0x7f84740a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:13.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.934+0000 7f848b7fe700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f84740a1290 0x7f84740a3750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f847c005950 tx=0x7f847c0058e0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:13.935 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:13.937+0000 7f8488ff9700 1 -- 172.21.15.33:0/1837058079 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f8480097880 con 0x7f848c106300 2024-05-08T20:15:14.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.177+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f848c1026b0 con 0x7f848c106300 2024-05-08T20:15:14.175 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.177+0000 7f8488ff9700 1 -- 172.21.15.33:0/1837058079 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v96) v1 ==== 81+0+1001 (secure 0 0 0) 0x7f848009aea0 con 0x7f848c106300 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/3089330166 2024-05-09T20:04:45.212378+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/2102553152 2024-05-09T19:58:27.048499+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3865397420 2024-05-09T19:58:04.583134+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/948350534 2024-05-09T19:58:04.583134+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/113789498 2024-05-09T19:58:04.583134+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2605806424 2024-05-09T19:58:27.048499+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3748938822 2024-05-09T19:58:04.583134+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/2102553152 2024-05-09T19:58:27.048499+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2502819545 2024-05-09T19:58:27.048499+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6801/113789498 2024-05-09T19:58:04.583134+0000 2024-05-08T20:15:14.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/2345595459 2024-05-09T20:04:45.212378+0000 2024-05-08T20:15:14.177 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1758089139 2024-05-09T20:04:45.212378+0000 2024-05-08T20:15:14.177 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:6800/3089330166 2024-05-09T20:04:45.212378+0000 2024-05-08T20:15:14.177 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1749884602 2024-05-09T19:58:27.048499+0000 2024-05-08T20:15:14.177 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3850877935 2024-05-09T20:04:45.212378+0000 2024-05-08T20:15:14.177 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/1526464392 2024-05-09T20:04:45.212378+0000 2024-05-08T20:15:14.177 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33:0/3915505292 2024-05-09T20:04:45.212378+0000 2024-05-08T20:15:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f84740a1290 msgr2=0x7f84740a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f84740a1290 0x7f84740a3750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f847c005950 tx=0x7f847c0058e0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c106300 msgr2=0x7f848c0737e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c106300 0x7f848c0737e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f84800059d0 tx=0x7f8480004730 comp rx=0 tx=0).stop 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 shutdown_connections 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f848c073d20 0x7f848c1a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1011e0 0x7f848c0732a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f84740a1290 0x7f84740a3750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 --2- 172.21.15.33:0/1837058079 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f848c106300 0x7f848c0737e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 >> 172.21.15.33:0/1837058079 conn(0x7f848c0fca80 msgr2=0x7f848c0fedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 shutdown_connections 2024-05-08T20:15:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.180+0000 7f8491eb4700 1 -- 172.21.15.33:0/1837058079 wait complete. 2024-05-08T20:15:14.180 INFO:teuthology.orchestra.run.smithi033.stderr:listed 17 entries 2024-05-08T20:15:14.192 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T20:15:14.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:15:14.192 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-05-08T20:15:14.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:15:14.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:15:14.286 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-08T20:15:14.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:15:14.386 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2024-05-08T20:15:14.419 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-08T20:15:14.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:15:14.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-08T20:15:14.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T20:15:14.496 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2024-05-08T20:15:14.600 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-08T20:15:14.617 INFO:tasks.cephadm:Teardown begin 2024-05-08T20:15:14.618 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T20:15:14.618 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:15:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/1128726687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440ffe20 msgr2=0x7f5c4410c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/1128726687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440ffe20 0x7f5c4410c330 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00b0a0 tx=0x7f5c3c00b3b0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/1128726687 shutdown_connections 2024-05-08T20:15:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/1128726687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c440ffe20 0x7f5c4410c330 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/1128726687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c44105500 0x7f5c441058e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/1128726687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c440ff460 0x7f5c440ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.761 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/1128726687 >> 172.21.15.33:0/1128726687 conn(0x7f5c44076270 msgr2=0x7f5c440fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:14.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/1128726687 shutdown_connections 2024-05-08T20:15:14.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.762+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/1128726687 wait complete. 2024-05-08T20:15:14.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 Processor -- start 2024-05-08T20:15:14.762 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 -- start start 2024-05-08T20:15:14.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c440ff460 0x7f5c440fb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:14.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c440ffe20 0x7f5c440fbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:14.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c44105500 0x7f5c440fc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:14.763 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c441a5650 con 0x7f5c44105500 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c441a57c0 con 0x7f5c440ffe20 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.763+0000 7f5c4bd7c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c441a5980 con 0x7f5c440ff460 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49b18700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c440ff460 0x7f5c440fb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49317700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c440ffe20 0x7f5c440fbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49b18700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c440ff460 0x7f5c440fb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.33:52118/0 (socket says 172.21.15.33:52118) 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c4a319700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c44105500 0x7f5c440fc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49b18700 1 -- 172.21.15.33:0/2625815904 learned_addr learned my addr 172.21.15.33:0/2625815904 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49317700 1 -- 172.21.15.33:0/2625815904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c440ff460 msgr2=0x7f5c440fb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49317700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c440ff460 0x7f5c440fb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49317700 1 -- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c44105500 msgr2=0x7f5c440fc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49317700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c44105500 0x7f5c440fc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49317700 1 -- 172.21.15.33:0/2625815904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c009d00 con 0x7f5c440ffe20 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c49317700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c440ffe20 0x7f5c440fbc40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400e9f0 tx=0x7f5c3400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c3affd700 1 -- 172.21.15.33:0/2625815904 <== mon.2 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3400c9c0 con 0x7f5c440ffe20 2024-05-08T20:15:14.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c3affd700 1 -- 172.21.15.33:0/2625815904 <== mon.2 v2:172.21.15.82:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5c34010430 con 0x7f5c440ffe20 2024-05-08T20:15:14.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c441a5c60 con 0x7f5c440ffe20 2024-05-08T20:15:14.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c3affd700 1 -- 172.21.15.33:0/2625815904 <== mon.2 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34018680 con 0x7f5c440ffe20 2024-05-08T20:15:14.765 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.764+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c441a61c0 con 0x7f5c440ffe20 2024-05-08T20:15:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.766+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c44100ba0 con 0x7f5c440ffe20 2024-05-08T20:15:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.766+0000 7f5c3affd700 1 -- 172.21.15.33:0/2625815904 <== mon.2 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f5c34010910 con 0x7f5c440ffe20 2024-05-08T20:15:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.767+0000 7f5c3affd700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5c300a1310 0x7f5c300a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.767+0000 7f5c49b18700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5c300a1310 0x7f5c300a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.767+0000 7f5c3affd700 1 -- 172.21.15.33:0/2625815904 <== mon.2 v2:172.21.15.82:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f5c34014070 con 0x7f5c440ffe20 2024-05-08T20:15:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.768+0000 7f5c49b18700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5c300a1310 0x7f5c300a37d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009ca0 tx=0x7f5c40009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:14.770 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:14.772+0000 7f5c3affd700 1 -- 172.21.15.33:0/2625815904 <== mon.2 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f5c34052d60 con 0x7f5c440ffe20 2024-05-08T20:15:14.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:14 smithi033 ceph-mon[42490]: pgmap v329: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:15:14.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:14 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3285187868' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:15:14.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:14 smithi033 ceph-mon[42490]: osdmap e96: 12 total, 12 up, 12 in 2024-05-08T20:15:14.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:14 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1837058079' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T20:15:14.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:14 smithi082 ceph-mon[46774]: pgmap v329: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:15:14.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:14 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3285187868' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:15:14.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:14 smithi082 ceph-mon[46774]: osdmap e96: 12 total, 12 up, 12 in 2024-05-08T20:15:14.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:14 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1837058079' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T20:15:14.882 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:14 smithi132 ceph-mon[47484]: pgmap v329: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-05-08T20:15:14.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:14 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3285187868' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T20:15:14.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:14 smithi132 ceph-mon[47484]: osdmap e96: 12 total, 12 up, 12 in 2024-05-08T20:15:14.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:14 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1837058079' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T20:15:15.041 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.043+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c4410f4d0 con 0x7f5c440ffe20 2024-05-08T20:15:15.042 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.044+0000 7f5c3affd700 1 -- 172.21.15.33:0/2625815904 <== mon.2 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+10854 (secure 0 0 0) 0x7f5c34096210 con 0x7f5c440ffe20 2024-05-08T20:15:15.043 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:15:15.043 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:10:38.411165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25262":{"gid":25262,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/2592033355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2592033355},{"type":"v1","addr":"172.21.15.82:6837","nonce":2592033355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.046+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5c300a1310 msgr2=0x7f5c300a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.046+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5c300a1310 0x7f5c300a37d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009ca0 tx=0x7f5c40009260 comp rx=0 tx=0).stop 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.046+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c440ffe20 msgr2=0x7f5c440fbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.046+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c440ffe20 0x7f5c440fbc40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5c3400e9f0 tx=0x7f5c3400ed00 comp rx=0 tx=0).stop 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 shutdown_connections 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f5c300a1310 0x7f5c300a37d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c44105500 0x7f5c440fc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.045 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c440ff460 0x7f5c440fb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 --2- 172.21.15.33:0/2625815904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c440ffe20 0x7f5c440fbc40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 >> 172.21.15.33:0/2625815904 conn(0x7f5c44076270 msgr2=0x7f5c440fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 shutdown_connections 2024-05-08T20:15:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.047+0000 7f5c4bd7c700 1 -- 172.21.15.33:0/2625815904 wait complete. 2024-05-08T20:15:15.046 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 35 2024-05-08T20:15:15.059 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 -- 172.21.15.33:0/674002875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 msgr2=0x7f16a810d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 --2- 172.21.15.33:0/674002875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a810d890 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f16a000b0a0 tx=0x7f16a000b3b0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 -- 172.21.15.33:0/674002875 shutdown_connections 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 --2- 172.21.15.33:0/674002875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a810d890 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 --2- 172.21.15.33:0/674002875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a8102010 0x7f16a81023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 --2- 172.21.15.33:0/674002875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16a8102930 0x7f16a810ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 -- 172.21.15.33:0/674002875 >> 172.21.15.33:0/674002875 conn(0x7f16a80fb7f0 msgr2=0x7f16a80fdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:15.199 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 -- 172.21.15.33:0/674002875 shutdown_connections 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.198+0000 7f16accd6700 1 -- 172.21.15.33:0/674002875 wait complete. 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 Processor -- start 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 -- start start 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a8102010 0x7f16a8197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16a8102930 0x7f16a8197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a819c3f0 con 0x7f16a810b480 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a819c560 con 0x7f16a8102010 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16accd6700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a819c720 con 0x7f16a8102930 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16a6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16a6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43212/0 (socket says 172.21.15.33:43212) 2024-05-08T20:15:15.200 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16a6d9d700 1 -- 172.21.15.33:0/2128417802 learned_addr learned my addr 172.21.15.33:0/2128417802 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16a5d9b700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16a8102930 0x7f16a8197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.199+0000 7f16a659c700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a8102010 0x7f16a8197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16a6d9d700 1 -- 172.21.15.33:0/2128417802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16a8102930 msgr2=0x7f16a8197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16a6d9d700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16a8102930 0x7f16a8197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16a6d9d700 1 -- 172.21.15.33:0/2128417802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a8102010 msgr2=0x7f16a8197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16a6d9d700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a8102010 0x7f16a8197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16a6d9d700 1 -- 172.21.15.33:0/2128417802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a0009d00 con 0x7f16a810b480 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16a6d9d700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a819bdb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f16a000b070 tx=0x7f16a0004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16977fe700 1 -- 172.21.15.33:0/2128417802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a000e040 con 0x7f16a810b480 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16977fe700 1 -- 172.21.15.33:0/2128417802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f16a00079d0 con 0x7f16a810b480 2024-05-08T20:15:15.201 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a819c9a0 con 0x7f16a810b480 2024-05-08T20:15:15.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16977fe700 1 -- 172.21.15.33:0/2128417802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a00052a0 con 0x7f16a810b480 2024-05-08T20:15:15.202 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.200+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a81a4240 con 0x7f16a810b480 2024-05-08T20:15:15.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.201+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8106560 con 0x7f16a810b480 2024-05-08T20:15:15.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.202+0000 7f16977fe700 1 -- 172.21.15.33:0/2128417802 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f16a001d470 con 0x7f16a810b480 2024-05-08T20:15:15.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.203+0000 7f16977fe700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f16900a1310 0x7f16900a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.203+0000 7f16977fe700 1 -- 172.21.15.33:0/2128417802 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f16a00ce940 con 0x7f16a810b480 2024-05-08T20:15:15.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.203+0000 7f16a659c700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f16900a1310 0x7f16900a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.203 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.203+0000 7f16a659c700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f16900a1310 0x7f16900a37d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1698005950 tx=0x7f16980058e0 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:15.205 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.207+0000 7f16977fe700 1 -- 172.21.15.33:0/2128417802 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f16a0097d90 con 0x7f16a810b480 2024-05-08T20:15:15.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.477+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f16a8069c50 con 0x7f16a810b480 2024-05-08T20:15:15.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.477+0000 7f16977fe700 1 -- 172.21.15.33:0/2128417802 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+10854 (secure 0 0 0) 0x7f16a009b3b0 con 0x7f16a810b480 2024-05-08T20:15:15.476 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:15:15.476 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/737673799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":737673799},{"type":"v1","addr":"172.21.15.33:6835","nonce":737673799}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6841/1914520158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6840","nonce":1914520158},{"type":"v1","addr":"172.21.15.33:6841","nonce":1914520158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24463,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/2425560119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":2425560119},{"type":"v1","addr":"172.21.15.132:6833","nonce":2425560119}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6833/3776468536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":3776468536},{"type":"v1","addr":"172.21.15.82:6833","nonce":3776468536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2880897493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2880897493},{"type":"v1","addr":"172.21.15.33:6837","nonce":2880897493}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24499,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/3702888214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3702888214},{"type":"v1","addr":"172.21.15.132:6835","nonce":3702888214}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T20:03:29.655534+0000","modified":"2024-05-08T20:10:38.411165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24566,"mds_1":24535,"mds_2":24508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6835/120986217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":120986217},{"type":"v1","addr":"172.21.15.82:6835","nonce":120986217}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24508":{"gid":24508,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.132:6837/852069157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":852069157},{"type":"v1","addr":"172.21.15.132:6837","nonce":852069157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24523":{"gid":24523,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.132:6839/3830178924","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6838","nonce":3830178924},{"type":"v1","addr":"172.21.15.132:6839","nonce":3830178924}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24535":{"gid":24535,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.33:6839/151321489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6838","nonce":151321489},{"type":"v1","addr":"172.21.15.33:6839","nonce":151321489}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24566":{"gid":24566,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.82:6839/3735435957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":3735435957},{"type":"v1","addr":"172.21.15.82:6839","nonce":3735435957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25262":{"gid":25262,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6837/2592033355","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":2592033355},{"type":"v1","addr":"172.21.15.82:6837","nonce":2592033355}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-08T20:15:15.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f16900a1310 msgr2=0x7f16900a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f16900a1310 0x7f16900a37d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1698005950 tx=0x7f16980058e0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 msgr2=0x7f16a819bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a819bdb0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f16a000b070 tx=0x7f16a0004c80 comp rx=0 tx=0).stop 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 shutdown_connections 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f16900a1310 0x7f16900a37d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16a810b480 0x7f16a819bdb0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f16a8102010 0x7f16a8197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 --2- 172.21.15.33:0/2128417802 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16a8102930 0x7f16a8197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 >> 172.21.15.33:0/2128417802 conn(0x7f16a80fb7f0 msgr2=0x7f16a80fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 shutdown_connections 2024-05-08T20:15:15.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.480+0000 7f16accd6700 1 -- 172.21.15.33:0/2128417802 wait complete. 2024-05-08T20:15:15.480 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 35 2024-05-08T20:15:15.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T20:15:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 -- 172.21.15.33:0/2490746349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0101060 msgr2=0x7fc8a0101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 --2- 172.21.15.33:0/2490746349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0101060 0x7fc8a0101440 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc890009990 tx=0x7fc890009ca0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 -- 172.21.15.33:0/2490746349 shutdown_connections 2024-05-08T20:15:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 --2- 172.21.15.33:0/2490746349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a0106180 0x7fc8a010dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 --2- 172.21.15.33:0/2490746349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0101060 0x7fc8a0101440 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 --2- 172.21.15.33:0/2490746349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a0101a10 0x7fc8a0105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 -- 172.21.15.33:0/2490746349 >> 172.21.15.33:0/2490746349 conn(0x7fc8a00fc920 msgr2=0x7fc8a00fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 -- 172.21.15.33:0/2490746349 shutdown_connections 2024-05-08T20:15:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.632+0000 7fc8a5576700 1 -- 172.21.15.33:0/2490746349 wait complete. 2024-05-08T20:15:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.633+0000 7fc8a5576700 1 Processor -- start 2024-05-08T20:15:15.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.633+0000 7fc8a5576700 1 -- start start 2024-05-08T20:15:15.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc8a5576700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a0101060 0x7fc8a0197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc8a5576700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0106180 0x7fc8a0197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc8a5576700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a019bd10 0x7fc8a019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc8a5576700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a019c790 con 0x7fc8a0106180 2024-05-08T20:15:15.634 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc8a5576700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a019c900 con 0x7fc8a019bd10 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc8a5576700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a019cac0 con 0x7fc8a0101060 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0106180 0x7fc8a0197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0106180 0x7fc8a0197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43230/0 (socket says 172.21.15.33:43230) 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 -- 172.21.15.33:0/3134613453 learned_addr learned my addr 172.21.15.33:0/3134613453 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89effd700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a0101060 0x7fc8a0197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89f7fe700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a019bd10 0x7fc8a019c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 -- 172.21.15.33:0/3134613453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a0101060 msgr2=0x7fc8a0197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a0101060 0x7fc8a0197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 -- 172.21.15.33:0/3134613453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a019bd10 msgr2=0x7fc8a019c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a019bd10 0x7fc8a019c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 -- 172.21.15.33:0/3134613453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900095f0 con 0x7fc8a0106180 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc89e7fc700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0106180 0x7fc8a0197970 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc88800e970 tx=0x7fc88800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc897fff700 1 -- 172.21.15.33:0/3134613453 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888009790 con 0x7fc8a0106180 2024-05-08T20:15:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.634+0000 7fc897fff700 1 -- 172.21.15.33:0/3134613453 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc88800c7e0 con 0x7fc8a0106180 2024-05-08T20:15:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.635+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a01a3fc0 con 0x7fc8a0106180 2024-05-08T20:15:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.635+0000 7fc897fff700 1 -- 172.21.15.33:0/3134613453 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888005580 con 0x7fc8a0106180 2024-05-08T20:15:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.635+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a01a44a0 con 0x7fc8a0106180 2024-05-08T20:15:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.635+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a0109360 con 0x7fc8a0106180 2024-05-08T20:15:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.637+0000 7fc897fff700 1 -- 172.21.15.33:0/3134613453 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc88800cce0 con 0x7fc8a0106180 2024-05-08T20:15:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.637+0000 7fc897fff700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc88c0a1290 0x7fc88c0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.637+0000 7fc897fff700 1 -- 172.21.15.33:0/3134613453 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8672+0+0 (secure 0 0 0) 0x7fc888014070 con 0x7fc8a0106180 2024-05-08T20:15:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.638+0000 7fc89effd700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc88c0a1290 0x7fc88c0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.638+0000 7fc89effd700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc88c0a1290 0x7fc88c0a3750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc890006010 tx=0x7fc89000b260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.641+0000 7fc897fff700 1 -- 172.21.15.33:0/3134613453 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc8880964f0 con 0x7fc8a0106180 2024-05-08T20:15:15.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:15 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2625815904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:15:15.829 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:15 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2128417802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:15:15.860 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.862+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8a0102530 con 0x7fc8a0106180 2024-05-08T20:15:15.861 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.863+0000 7fc897fff700 1 -- 172.21.15.33:0/3134613453 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+23196 (secure 0 0 0) 0x7fc888099b10 con 0x7fc8a0106180 2024-05-08T20:15:15.862 INFO:teuthology.orchestra.run.smithi033.stdout: 2024-05-08T20:15:15.862 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":96,"fsid":"0ee61dd4-0d75-11ef-bc97-c7b262605968","created":"2024-05-08T19:57:39.572383+0000","modified":"2024-05-08T20:15:14.159205+0000","last_up_change":"2024-05-08T20:02:56.176349+0000","last_in_change":"2024-05-08T20:02:39.666033+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T20:00:17.595088+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T20:03:27.926660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T20:03:28.993433+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":95,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"475543e7-9098-4d93-82e8-529f6ae4e779","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6803","nonce":2726923319}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6805","nonce":2726923319}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6809","nonce":2726923319}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2726923319},{"type":"v1","addr":"172.21.15.33:6807","nonce":2726923319}]},"public_addr":"172.21.15.33:6803/2726923319","cluster_addr":"172.21.15.33:6805/2726923319","heartbeat_back_addr":"172.21.15.33:6809/2726923319","heartbeat_front_addr":"172.21.15.33:6807/2726923319","state":["exists","up"]},{"osd":1,"uuid":"47267f72-b070-4a71-a9fd-8737a8e4ed6e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6801","nonce":2641494895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6803","nonce":2641494895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6807","nonce":2641494895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":2641494895},{"type":"v1","addr":"172.21.15.82:6805","nonce":2641494895}]},"public_addr":"172.21.15.82:6801/2641494895","cluster_addr":"172.21.15.82:6803/2641494895","heartbeat_back_addr":"172.21.15.82:6807/2641494895","heartbeat_front_addr":"172.21.15.82:6805/2641494895","state":["exists","up"]},{"osd":2,"uuid":"d4a04dc0-c34f-488e-b0e9-8826eb6a555c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6801","nonce":1122791849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6803","nonce":1122791849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6807","nonce":1122791849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":1122791849},{"type":"v1","addr":"172.21.15.132:6805","nonce":1122791849}]},"public_addr":"172.21.15.132:6801/1122791849","cluster_addr":"172.21.15.132:6803/1122791849","heartbeat_back_addr":"172.21.15.132:6807/1122791849","heartbeat_front_addr":"172.21.15.132:6805/1122791849","state":["exists","up"]},{"osd":3,"uuid":"f6988c00-180e-459e-aabb-96b918684e46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6811","nonce":3020184499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6813","nonce":3020184499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6817","nonce":3020184499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":3020184499},{"type":"v1","addr":"172.21.15.33:6815","nonce":3020184499}]},"public_addr":"172.21.15.33:6811/3020184499","cluster_addr":"172.21.15.33:6813/3020184499","heartbeat_back_addr":"172.21.15.33:6817/3020184499","heartbeat_front_addr":"172.21.15.33:6815/3020184499","state":["exists","up"]},{"osd":4,"uuid":"9922f2c4-b26d-42b1-94af-f8875d7b499b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6809","nonce":2673475836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6811","nonce":2673475836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6815","nonce":2673475836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2673475836},{"type":"v1","addr":"172.21.15.82:6813","nonce":2673475836}]},"public_addr":"172.21.15.82:6809/2673475836","cluster_addr":"172.21.15.82:6811/2673475836","heartbeat_back_addr":"172.21.15.82:6815/2673475836","heartbeat_front_addr":"172.21.15.82:6813/2673475836","state":["exists","up"]},{"osd":5,"uuid":"f86a281b-beaa-426a-b519-f1585214fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6809","nonce":2308536934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6811","nonce":2308536934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6815","nonce":2308536934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":2308536934},{"type":"v1","addr":"172.21.15.132:6813","nonce":2308536934}]},"public_addr":"172.21.15.132:6809/2308536934","cluster_addr":"172.21.15.132:6811/2308536934","heartbeat_back_addr":"172.21.15.132:6815/2308536934","heartbeat_front_addr":"172.21.15.132:6813/2308536934","state":["exists","up"]},{"osd":6,"uuid":"87f5ea9e-6467-4b4e-8aa4-8769b53650ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6819","nonce":469932513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6821","nonce":469932513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6825","nonce":469932513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":469932513},{"type":"v1","addr":"172.21.15.33:6823","nonce":469932513}]},"public_addr":"172.21.15.33:6819/469932513","cluster_addr":"172.21.15.33:6821/469932513","heartbeat_back_addr":"172.21.15.33:6825/469932513","heartbeat_front_addr":"172.21.15.33:6823/469932513","state":["exists","up"]},{"osd":7,"uuid":"6700de25-138d-4cb4-bd2c-6935b873816a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6817","nonce":3754120069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6819","nonce":3754120069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6823","nonce":3754120069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":3754120069},{"type":"v1","addr":"172.21.15.82:6821","nonce":3754120069}]},"public_addr":"172.21.15.82:6817/3754120069","cluster_addr":"172.21.15.82:6819/3754120069","heartbeat_back_addr":"172.21.15.82:6823/3754120069","heartbeat_front_addr":"172.21.15.82:6821/3754120069","state":["exists","up"]},{"osd":8,"uuid":"af5ad8e0-189d-4f89-a802-a3cd2efd0428","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6817","nonce":909790708}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6819","nonce":909790708}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6823","nonce":909790708}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":909790708},{"type":"v1","addr":"172.21.15.132:6821","nonce":909790708}]},"public_addr":"172.21.15.132:6817/909790708","cluster_addr":"172.21.15.132:6819/909790708","heartbeat_back_addr":"172.21.15.132:6823/909790708","heartbeat_front_addr":"172.21.15.132:6821/909790708","state":["exists","up"]},{"osd":9,"uuid":"b3c11e7d-ffde-4056-81df-8f6816c9c085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6827","nonce":185298138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6829","nonce":185298138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6833","nonce":185298138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":185298138},{"type":"v1","addr":"172.21.15.33:6831","nonce":185298138}]},"public_addr":"172.21.15.33:6827/185298138","cluster_addr":"172.21.15.33:6829/185298138","heartbeat_back_addr":"172.21.15.33:6833/185298138","heartbeat_front_addr":"172.21.15.33:6831/185298138","state":["exists","up"]},{"osd":10,"uuid":"39c38ffb-6a12-406e-a8ec-c0e2b3b51204","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6825","nonce":3525934345}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6827","nonce":3525934345}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6831","nonce":3525934345}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":3525934345},{"type":"v1","addr":"172.21.15.82:6829","nonce":3525934345}]},"public_addr":"172.21.15.82:6825/3525934345","cluster_addr":"172.21.15.82:6827/3525934345","heartbeat_back_addr":"172.21.15.82:6831/3525934345","heartbeat_front_addr":"172.21.15.82:6829/3525934345","state":["exists","up"]},{"osd":11,"uuid":"fb54a8e4-a4f7-42b5-9c6a-65d25bf32f5c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6825","nonce":77968886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6827","nonce":77968886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6831","nonce":77968886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":77968886},{"type":"v1","addr":"172.21.15.132:6829","nonce":77968886}]},"public_addr":"172.21.15.132:6825/77968886","cluster_addr":"172.21.15.132:6827/77968886","heartbeat_back_addr":"172.21.15.132:6831/77968886","heartbeat_front_addr":"172.21.15.132:6829/77968886","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:40.634887+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T19:59:58.006189+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:15.237778+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:33.414765+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:00:50.502891+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:07.990177+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:26.602082+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:01:43.966464+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:01.334725+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:19.395748+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:36.830948+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T20:02:54.247102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1}]},{"pgid":"2.f","mappings":[{"from":8,"to":11}]},{"pgid":"2.10","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":4,"to":6}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.23","mappings":[{"from":4,"to":7}]},{"pgid":"3.28","mappings":[{"from":5,"to":8}]},{"pgid":"3.38","mappings":[{"from":3,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6801/3089330166":"2024-05-09T20:04:45.212378+0000","172.21.15.33:6800/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3865397420":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/948350534":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6800/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/2605806424":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3748938822":"2024-05-09T19:58:04.583134+0000","172.21.15.33:6801/2102553152":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/2502819545":"2024-05-09T19:58:27.048499+0000","172.21.15.33:6801/113789498":"2024-05-09T19:58:04.583134+0000","172.21.15.33:0/2345595459":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1758089139":"2024-05-09T20:04:45.212378+0000","172.21.15.33:6800/3089330166":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1749884602":"2024-05-09T19:58:27.048499+0000","172.21.15.33:0/3850877935":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/1526464392":"2024-05-09T20:04:45.212378+0000","172.21.15.33:0/3915505292":"2024-05-09T20:04:45.212378+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T20:15:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc88c0a1290 msgr2=0x7fc88c0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc88c0a1290 0x7fc88c0a3750 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc890006010 tx=0x7fc89000b260 comp rx=0 tx=0).stop 2024-05-08T20:15:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0106180 msgr2=0x7fc8a0197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0106180 0x7fc8a0197970 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc88800e970 tx=0x7fc88800ec80 comp rx=0 tx=0).stop 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 shutdown_connections 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8a019bd10 0x7fc8a019c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8a0101060 0x7fc8a0197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc88c0a1290 0x7fc88c0a3750 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 --2- 172.21.15.33:0/3134613453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8a0106180 0x7fc8a0197970 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 >> 172.21.15.33:0/3134613453 conn(0x7fc8a00fc920 msgr2=0x7fc8a0104dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 shutdown_connections 2024-05-08T20:15:15.865 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:15.866+0000 7fc8a5576700 1 -- 172.21.15.33:0/3134613453 wait complete. 2024-05-08T20:15:15.878 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-08T20:15:15.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:15 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2625815904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:15:15.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:15 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2128417802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:15:15.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:15 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2625815904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:15:15.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:15 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2128417802' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 -- 172.21.15.33:0/177091293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d380733d0 msgr2=0x7f9d380737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/177091293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d380733d0 0x7f9d380737b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009990 tx=0x7f9d28009ca0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 -- 172.21.15.33:0/177091293 shutdown_connections 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/177091293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d3810d730 0x7f9d3810fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/177091293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d380733d0 0x7f9d380737b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/177091293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d38073cf0 0x7f9d3810d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 -- 172.21.15.33:0/177091293 >> 172.21.15.33:0/177091293 conn(0x7f9d380fc9e0 msgr2=0x7f9d380fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 -- 172.21.15.33:0/177091293 shutdown_connections 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.018+0000 7f9d3fa82700 1 -- 172.21.15.33:0/177091293 wait complete. 2024-05-08T20:15:16.019 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 Processor -- start 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 -- start start 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380733d0 0x7f9d381996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d38073cf0 0x7f9d38199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3810d730 0x7f9d3819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3819e5f0 con 0x7f9d38073cf0 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3819e760 con 0x7f9d3810d730 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3fa82700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3819e920 con 0x7f9d380733d0 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3d01d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d38073cf0 0x7f9d38199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3d01d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d38073cf0 0x7f9d38199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43246/0 (socket says 172.21.15.33:43246) 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3d01d700 1 -- 172.21.15.33:0/1609742393 learned_addr learned my addr 172.21.15.33:0/1609742393 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:16.020 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3d81e700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380733d0 0x7f9d381996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.019+0000 7f9d3e01f700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3810d730 0x7f9d3819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3d01d700 1 -- 172.21.15.33:0/1609742393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380733d0 msgr2=0x7f9d381996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3d01d700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380733d0 0x7f9d381996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3d01d700 1 -- 172.21.15.33:0/1609742393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3810d730 msgr2=0x7f9d3819dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3d01d700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3810d730 0x7f9d3819dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3d01d700 1 -- 172.21.15.33:0/1609742393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d280095f0 con 0x7f9d38073cf0 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3d81e700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380733d0 0x7f9d381996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3e01f700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3810d730 0x7f9d3819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3d01d700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d38073cf0 0x7f9d38199c10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400d950 tx=0x7f9d3400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d2effd700 1 -- 172.21.15.33:0/1609742393 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34009b40 con 0x7f9d38073cf0 2024-05-08T20:15:16.021 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d2effd700 1 -- 172.21.15.33:0/1609742393 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9d34009ca0 con 0x7f9d38073cf0 2024-05-08T20:15:16.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3819ec00 con 0x7f9d38073cf0 2024-05-08T20:15:16.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d2effd700 1 -- 172.21.15.33:0/1609742393 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400f6b0 con 0x7f9d38073cf0 2024-05-08T20:15:16.022 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.020+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d381a6440 con 0x7f9d38073cf0 2024-05-08T20:15:16.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.021+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d38108940 con 0x7f9d38073cf0 2024-05-08T20:15:16.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.022+0000 7f9d2effd700 1 -- 172.21.15.33:0/1609742393 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f9d34010460 con 0x7f9d38073cf0 2024-05-08T20:15:16.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.023+0000 7f9d2effd700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9d240a1310 0x7f9d240a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.023+0000 7f9d3d81e700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9d240a1310 0x7f9d240a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.023+0000 7f9d2effd700 1 -- 172.21.15.33:0/1609742393 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8672+0+0 (secure 0 0 0) 0x7f9d340cd0c0 con 0x7f9d38073cf0 2024-05-08T20:15:16.023 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.024+0000 7f9d3d81e700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9d240a1310 0x7f9d240a37d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d28006010 tx=0x7f9d2800b540 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:16.024 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.027+0000 7f9d2effd700 1 -- 172.21.15.33:0/1609742393 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f9d34096440 con 0x7f9d38073cf0 2024-05-08T20:15:16.292 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.294+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9d38074a80 con 0x7f9d38073cf0 2024-05-08T20:15:16.305 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.307+0000 7f9d2effd700 1 -- 172.21.15.33:0/1609742393 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9d34020090 con 0x7f9d38073cf0 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.309+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9d240a1310 msgr2=0x7f9d240a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9d240a1310 0x7f9d240a37d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d28006010 tx=0x7f9d2800b540 comp rx=0 tx=0).stop 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d38073cf0 msgr2=0x7f9d38199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d38073cf0 0x7f9d38199c10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400d950 tx=0x7f9d3400dd10 comp rx=0 tx=0).stop 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 shutdown_connections 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d3810d730 0x7f9d3819dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380733d0 0x7f9d381996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f9d240a1310 0x7f9d240a37d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.308 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 --2- 172.21.15.33:0/1609742393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d38073cf0 0x7f9d38199c10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 >> 172.21.15.33:0/1609742393 conn(0x7f9d380fc9e0 msgr2=0x7f9d380fe240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:16.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 shutdown_connections 2024-05-08T20:15:16.309 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.310+0000 7f9d3fa82700 1 -- 172.21.15.33:0/1609742393 wait complete. 2024-05-08T20:15:16.309 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T20:15:16.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T20:15:16.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 -- 172.21.15.33:0/203798048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e8100430 msgr2=0x7f93e8105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 --2- 172.21.15.33:0/203798048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e8100430 0x7f93e8105bd0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f93dc009990 tx=0x7f93dc009ca0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 -- 172.21.15.33:0/203798048 shutdown_connections 2024-05-08T20:15:16.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 --2- 172.21.15.33:0/203798048 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e81062b0 0x7f93e810de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 --2- 172.21.15.33:0/203798048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e80ffa80 0x7f93e80ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.470 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 --2- 172.21.15.33:0/203798048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e8100430 0x7f93e8105bd0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 -- 172.21.15.33:0/203798048 >> 172.21.15.33:0/203798048 conn(0x7f93e8076110 msgr2=0x7f93e8076520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:16.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 -- 172.21.15.33:0/203798048 shutdown_connections 2024-05-08T20:15:16.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.471+0000 7f93ed678700 1 -- 172.21.15.33:0/203798048 wait complete. 2024-05-08T20:15:16.471 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.472+0000 7f93ed678700 1 Processor -- start 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.472+0000 7f93ed678700 1 -- start start 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93ed678700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80ffa80 0x7f93e8197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93ed678700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e81062b0 0x7f93e8197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93ed678700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e819bde0 0x7f93e819c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93ed678700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e819c860 con 0x7f93e81062b0 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93ed678700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e819c9d0 con 0x7f93e80ffa80 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93ed678700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e819cb90 con 0x7f93e819bde0 2024-05-08T20:15:16.473 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e81062b0 0x7f93e8197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e81062b0 0x7f93e8197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43276/0 (socket says 172.21.15.33:43276) 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 -- 172.21.15.33:0/452148831 learned_addr learned my addr 172.21.15.33:0/452148831 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e6ffd700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80ffa80 0x7f93e8197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e77fe700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e819bde0 0x7f93e819c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 -- 172.21.15.33:0/452148831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e819bde0 msgr2=0x7f93e819c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e819bde0 0x7f93e819c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 -- 172.21.15.33:0/452148831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80ffa80 msgr2=0x7f93e8197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80ffa80 0x7f93e8197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 -- 172.21.15.33:0/452148831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e0009520 con 0x7f93e81062b0 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93e67fc700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e81062b0 0x7f93e8197a40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000c00 tx=0x7f93dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:16.474 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93cffff700 1 -- 172.21.15.33:0/452148831 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc01d070 con 0x7f93e81062b0 2024-05-08T20:15:16.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.473+0000 7f93cffff700 1 -- 172.21.15.33:0/452148831 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f93dc00bea0 con 0x7f93e81062b0 2024-05-08T20:15:16.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.474+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93dc0095f0 con 0x7f93e81062b0 2024-05-08T20:15:16.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.474+0000 7f93cffff700 1 -- 172.21.15.33:0/452148831 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc021de0 con 0x7f93e81062b0 2024-05-08T20:15:16.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.474+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e81a4320 con 0x7f93e81062b0 2024-05-08T20:15:16.475 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.475+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e8109470 con 0x7f93e81062b0 2024-05-08T20:15:16.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.477+0000 7f93cffff700 1 -- 172.21.15.33:0/452148831 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f93dc0214a0 con 0x7f93e81062b0 2024-05-08T20:15:16.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.477+0000 7f93cffff700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f93d00a1290 0x7f93d00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:16.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.477+0000 7f93cffff700 1 -- 172.21.15.33:0/452148831 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8886+0+0 (secure 0 0 0) 0x7f93dc0ce360 con 0x7f93e81062b0 2024-05-08T20:15:16.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.477+0000 7f93e6ffd700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f93d00a1290 0x7f93d00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:16.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.478+0000 7f93e6ffd700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f93d00a1290 0x7f93d00a3750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93d800f540 tx=0x7f93d800b040 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:16.478 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.480+0000 7f93cffff700 1 -- 172.21.15.33:0/452148831 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f93dc0976d0 con 0x7f93e81062b0 2024-05-08T20:15:16.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-a[42466]: 2024-05-08T20:15:16.295+0000 7f0cdae40700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: pgmap v331: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/3134613453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1609742393' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: osdmap e97: 12 total, 12 up, 12 in 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1609742393' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mon[42490]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:15:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-g[93621]: ignoring --setuser ceph since I am not root 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:15:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-g[93621]: ignoring --setgroup ceph since I am not root 2024-05-08T20:15:16.580 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:15:16 smithi033 ceph-mds[93644]: -- 172.21.15.33:0/2905860354 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5560e47ca1a0 con 0x5560e47a0800 2024-05-08T20:15:16.581 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:15:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-g[93621]: starting mds.g at 2024-05-08T20:15:16.630 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-e[82856]: ignoring --setuser ceph since I am not root 2024-05-08T20:15:16.630 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-e[82856]: ignoring --setgroup ceph since I am not root 2024-05-08T20:15:16.630 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mds[82879]: -- 172.21.15.82:0/1607008449 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d9e2ff61a0 con 0x55d9e2fcd000 2024-05-08T20:15:16.630 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-e[82856]: starting mds.e at 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: pgmap v331: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/3134613453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1609742393' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: osdmap e97: 12 total, 12 up, 12 in 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1609742393' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T20:15:16.631 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mon[46774]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b[83545]: ignoring --setuser ceph since I am not root 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b[83545]: ignoring --setgroup ceph since I am not root 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mds[83569]: -- 172.21.15.82:0/1196083062 <== mon.2 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ec8c9021a0 con 0x55ec8c8d8800 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b[83545]: starting mds.b at 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[86583]: ignoring --setuser ceph since I am not root 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[86583]: ignoring --setgroup ceph since I am not root 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:15:16 smithi082 ceph-mds[86606]: -- 172.21.15.82:0/1359739951 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561f378ce1a0 con 0x561f378a5000 2024-05-08T20:15:16.632 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:15:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[86583]: starting mds.h at 2024-05-08T20:15:16.633 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:15:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i[83347]: ignoring --setuser ceph since I am not root 2024-05-08T20:15:16.633 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:15:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i[83347]: ignoring --setgroup ceph since I am not root 2024-05-08T20:15:16.633 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mds[83370]: -- 172.21.15.132:0/2563246099 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ecf9481a0 con 0x558ecf91e800 2024-05-08T20:15:16.633 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:15:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i[83347]: starting mds.i at 2024-05-08T20:15:16.633 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:15:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i[83347]: 2024-05-08T20:15:16.353+0000 7f32b3886700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6838/0: (98) Address already in use 2024-05-08T20:15:16.633 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: pgmap v331: 97 pgs: 97 active+clean; 25 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/3134613453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1609742393' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: osdmap e97: 12 total, 12 up, 12 in 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1609742393' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mon[47484]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-c[83003]: ignoring --setuser ceph since I am not root 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-c[83003]: ignoring --setgroup ceph since I am not root 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-mds[83026]: -- 172.21.15.132:0/2677237932 <== mon.1 v2:172.21.15.132:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e1afe641a0 con 0x55e1afe3b000 2024-05-08T20:15:16.634 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:15:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-c[83003]: starting mds.c at 2024-05-08T20:15:16.755 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:16.756+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f93e8198800 con 0x7f93e81062b0 2024-05-08T20:15:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.309+0000 7f93cffff700 1 -- 172.21.15.33:0/452148831 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f93dc09acf0 con 0x7f93e81062b0 2024-05-08T20:15:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.313+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f93d00a1290 msgr2=0x7f93d00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.313+0000 7f93ed678700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f93d00a1290 0x7f93d00a3750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f93d800f540 tx=0x7f93d800b040 comp rx=0 tx=0).stop 2024-05-08T20:15:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.313+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e81062b0 msgr2=0x7f93e8197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:17.311 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.313+0000 7f93ed678700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e81062b0 0x7f93e8197a40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000c00 tx=0x7f93dc004730 comp rx=0 tx=0).stop 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 shutdown_connections 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e819bde0 0x7f93e819c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93e80ffa80 0x7f93e8197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f93d00a1290 0x7f93d00a3750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 --2- 172.21.15.33:0/452148831 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f93e81062b0 0x7f93e8197a40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 >> 172.21.15.33:0/452148831 conn(0x7f93e8076110 msgr2=0x7f93e8104e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 shutdown_connections 2024-05-08T20:15:17.313 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.315+0000 7f93ed678700 1 -- 172.21.15.33:0/452148831 wait complete. 2024-05-08T20:15:17.328 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 -- 172.21.15.33:0/2702192010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 msgr2=0x7fc1a8101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/2702192010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8101540 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009990 tx=0x7fc1a4009ca0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 -- 172.21.15.33:0/2702192010 shutdown_connections 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/2702192010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a8106280 0x7fc1a810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/2702192010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8101540 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/2702192010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a8101b10 0x7fc1a8105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 -- 172.21.15.33:0/2702192010 >> 172.21.15.33:0/2702192010 conn(0x7fc1a80fc9e0 msgr2=0x7fc1a80fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 -- 172.21.15.33:0/2702192010 shutdown_connections 2024-05-08T20:15:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.477+0000 7fc1b04a0700 1 -- 172.21.15.33:0/2702192010 wait complete. 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 Processor -- start 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 -- start start 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a8106280 0x7fc1a8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a819be20 0x7fc1a819c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a819c8a0 con 0x7fc1a8101160 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a819ca10 con 0x7fc1a8106280 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1b04a0700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a819cbd0 con 0x7fc1a819be20 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.478+0000 7fc1ae23c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43286/0 (socket says 172.21.15.33:43286) 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 -- 172.21.15.33:0/1798912276 learned_addr learned my addr 172.21.15.33:0/1798912276 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ada3b700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a8106280 0x7fc1a8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1aea3d700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a819be20 0x7fc1a819c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 -- 172.21.15.33:0/1798912276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a819be20 msgr2=0x7fc1a819c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a819be20 0x7fc1a819c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 -- 172.21.15.33:0/1798912276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a8106280 msgr2=0x7fc1a8197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a8106280 0x7fc1a8197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 -- 172.21.15.33:0/1798912276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40095f0 con 0x7fc1a8101160 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1aea3d700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a819be20 0x7fc1a819c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1ae23c700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8197540 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4004760 tx=0x7fc1a4004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc19f7fe700 1 -- 172.21.15.33:0/1798912276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a401d070 con 0x7fc1a8101160 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a81a40d0 con 0x7fc1a8101160 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc19f7fe700 1 -- 172.21.15.33:0/1798912276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc1a4022470 con 0x7fc1a8101160 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc19f7fe700 1 -- 172.21.15.33:0/1798912276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4017650 con 0x7fc1a8101160 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.479+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a81a44f0 con 0x7fc1a8101160 2024-05-08T20:15:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.480+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a81094f0 con 0x7fc1a8101160 2024-05-08T20:15:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.482+0000 7fc19f7fe700 1 -- 172.21.15.33:0/1798912276 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7fc1a40225e0 con 0x7fc1a8101160 2024-05-08T20:15:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.482+0000 7fc19f7fe700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc1940a1290 0x7fc1940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.482+0000 7fc1ada3b700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc1940a1290 0x7fc1940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.482+0000 7fc19f7fe700 1 -- 172.21.15.33:0/1798912276 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8886+0+0 (secure 0 0 0) 0x7fc1a40ce230 con 0x7fc1a8101160 2024-05-08T20:15:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.483+0000 7fc1ada3b700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc1940a1290 0x7fc1940a3750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8198a90 tx=0x7fc19800b410 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:17.484 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.486+0000 7fc19f7fe700 1 -- 172.21.15.33:0/1798912276 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7fc1a4097640 con 0x7fc1a8101160 2024-05-08T20:15:17.579 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/452148831' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: Cluster is now healthy 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.132:6836/4010521549,v1:172.21.15.132:6838/4010521549] up:boot 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6838/1982817307,v1:172.21.15.82:6839/1982817307] up:boot 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.132:6837/4174716410,v1:172.21.15.132:6839/4174716410] up:boot 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6835/950763734,v1:172.21.15.82:6836/950763734] up:boot 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.82:6834/3457383518,v1:172.21.15.82:6837/3457383518] up:boot 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: mds.? [v2:172.21.15.33:6838/3659018959,v1:172.21.15.33:6839/3659018959] up:boot 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/452148831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: fsmap 12 up:standby 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:15:17.580 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:15:17.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:15:17.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:15:17.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:15:17.581 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:17 smithi033 ceph-mon[42490]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:15:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:17.714+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc1a81026b0 con 0x7fc1a8101160 2024-05-08T20:15:17.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/452148831' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:15:17.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T20:15:17.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T20:15:17.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: Cluster is now healthy 2024-05-08T20:15:17.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.132:6836/4010521549,v1:172.21.15.132:6838/4010521549] up:boot 2024-05-08T20:15:17.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6838/1982817307,v1:172.21.15.82:6839/1982817307] up:boot 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.132:6837/4174716410,v1:172.21.15.132:6839/4174716410] up:boot 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6835/950763734,v1:172.21.15.82:6836/950763734] up:boot 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.82:6834/3457383518,v1:172.21.15.82:6837/3457383518] up:boot 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: mds.? [v2:172.21.15.33:6838/3659018959,v1:172.21.15.33:6839/3659018959] up:boot 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/452148831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: fsmap 12 up:standby 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:15:17.881 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:17 smithi082 ceph-mon[46774]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/452148831' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: Cluster is now healthy 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.132:6836/4010521549,v1:172.21.15.132:6838/4010521549] up:boot 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6838/1982817307,v1:172.21.15.82:6839/1982817307] up:boot 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.132:6837/4174716410,v1:172.21.15.132:6839/4174716410] up:boot 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6835/950763734,v1:172.21.15.82:6836/950763734] up:boot 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.82:6834/3457383518,v1:172.21.15.82:6837/3457383518] up:boot 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: mds.? [v2:172.21.15.33:6838/3659018959,v1:172.21.15.33:6839/3659018959] up:boot 2024-05-08T20:15:17.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/452148831' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T20:15:17.884 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: fsmap 12 up:standby 2024-05-08T20:15:17.884 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T20:15:17.884 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T20:15:17.884 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T20:15:17.884 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T20:15:17.884 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T20:15:17.884 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:17 smithi132 ceph-mon[47484]: from='mgr.15264 172.21.15.33:0/877842919' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T20:15:18.507 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.506+0000 7fc19f7fe700 1 -- 172.21.15.33:0/1798912276 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc1a409ac60 con 0x7fc1a8101160 2024-05-08T20:15:18.510 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:18 smithi033 ceph-mon[42490]: pgmap v333: 97 pgs: 97 active+clean; 25 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T20:15:18.511 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:18 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1798912276' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.517+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc1940a1290 msgr2=0x7fc1940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.517+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc1940a1290 0x7fc1940a3750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8198a90 tx=0x7fc19800b410 comp rx=0 tx=0).stop 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.517+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 msgr2=0x7fc1a8197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.517+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8197540 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4004760 tx=0x7fc1a4004790 comp rx=0 tx=0).stop 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.518+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 shutdown_connections 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.518+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1a819be20 0x7fc1a819c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.518+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7fc1940a1290 0x7fc1940a3750 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc1a8198a90 tx=0x7fc19800b410 comp rx=0 tx=0).stop 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.518+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1a8101160 0x7fc1a8197540 secure :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4004760 tx=0x7fc1a4004790 comp rx=0 tx=0).stop 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.518+0000 7fc1b04a0700 1 --2- 172.21.15.33:0/1798912276 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc1a8106280 0x7fc1a8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.517 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.518+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 >> 172.21.15.33:0/1798912276 conn(0x7fc1a80fc9e0 msgr2=0x7fc1a80fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:18.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.519+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 shutdown_connections 2024-05-08T20:15:18.518 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.519+0000 7fc1b04a0700 1 -- 172.21.15.33:0/1798912276 wait complete. 2024-05-08T20:15:18.518 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2024-05-08T20:15:18.536 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T20:15:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 -- 172.21.15.33:0/2282575816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d4106290 msgr2=0x7f03d410de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 --2- 172.21.15.33:0/2282575816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d4106290 0x7f03d410de10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f03cc00b0d0 tx=0x7f03cc00b3e0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 -- 172.21.15.33:0/2282575816 shutdown_connections 2024-05-08T20:15:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 --2- 172.21.15.33:0/2282575816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d4106290 0x7f03d410de10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 --2- 172.21.15.33:0/2282575816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d40682e0 0x7f03d40686c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 --2- 172.21.15.33:0/2282575816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d4068c90 0x7f03d4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.690 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 -- 172.21.15.33:0/2282575816 >> 172.21.15.33:0/2282575816 conn(0x7f03d4076f40 msgr2=0x7f03d4077350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 -- 172.21.15.33:0/2282575816 shutdown_connections 2024-05-08T20:15:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.691+0000 7f03da100700 1 -- 172.21.15.33:0/2282575816 wait complete. 2024-05-08T20:15:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 Processor -- start 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 -- start start 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d40682e0 0x7f03d4197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d4106290 0x7f03d4197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d419be70 0x7f03d419c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d419c8f0 con 0x7f03d40682e0 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d419ca60 con 0x7f03d419be70 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.692+0000 7f03da100700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d419cc20 con 0x7f03d4106290 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d40682e0 0x7f03d4197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:18.693 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d40682e0 0x7f03d4197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43298/0 (socket says 172.21.15.33:43298) 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 -- 172.21.15.33:0/2310362070 learned_addr learned my addr 172.21.15.33:0/2310362070 (peer_addr_for_me v2:172.21.15.33:0/0) 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d3fff700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d419be70 0x7f03d419c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d2ffd700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d4106290 0x7f03d4197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 -- 172.21.15.33:0/2310362070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d4106290 msgr2=0x7f03d4197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d4106290 0x7f03d4197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 -- 172.21.15.33:0/2310362070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d419be70 msgr2=0x7f03d419c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d419be70 0x7f03d419c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 -- 172.21.15.33:0/2310362070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8009520 con 0x7f03d40682e0 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d37fe700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d40682e0 0x7f03d4197590 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03c400d950 tx=0x7f03c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d0ff9700 1 -- 172.21.15.33:0/2310362070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400f890 con 0x7f03d40682e0 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d0ff9700 1 -- 172.21.15.33:0/2310362070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f03c4010460 con 0x7f03d40682e0 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc009d00 con 0x7f03d40682e0 2024-05-08T20:15:18.694 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.693+0000 7f03d0ff9700 1 -- 172.21.15.33:0/2310362070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c400e610 con 0x7f03d40682e0 2024-05-08T20:15:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.694+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d41a44d0 con 0x7f03d40682e0 2024-05-08T20:15:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.695+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d4109440 con 0x7f03d40682e0 2024-05-08T20:15:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.696+0000 7f03d0ff9700 1 -- 172.21.15.33:0/2310362070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 25) v1 ==== 136004+0+0 (secure 0 0 0) 0x7f03c4010960 con 0x7f03d40682e0 2024-05-08T20:15:18.695 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.696+0000 7f03d0ff9700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f03bc0a1290 0x7f03bc0a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T20:15:18.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.696+0000 7f03d0ff9700 1 -- 172.21.15.33:0/2310362070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8332+0+0 (secure 0 0 0) 0x7f03c40cc9a0 con 0x7f03d40682e0 2024-05-08T20:15:18.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.696+0000 7f03d2ffd700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f03bc0a1290 0x7f03bc0a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T20:15:18.696 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.697+0000 7f03d2ffd700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f03bc0a1290 0x7f03bc0a3750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03d4198ae0 tx=0x7f03c8009260 comp rx=0 tx=0).ready entity=mgr.15264 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T20:15:18.699 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.701+0000 7f03d0ff9700 1 -- 172.21.15.33:0/2310362070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183622 (secure 0 0 0) 0x7f03c4095eb0 con 0x7f03d40682e0 2024-05-08T20:15:18.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:18 smithi082 ceph-mon[46774]: pgmap v333: 97 pgs: 97 active+clean; 25 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T20:15:18.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:18 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1798912276' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T20:15:18.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:18 smithi132 ceph-mon[47484]: pgmap v333: 97 pgs: 97 active+clean; 25 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-05-08T20:15:18.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:18 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1798912276' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T20:15:18.927 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:18.929+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f03d4067d50 con 0x7f03d40682e0 2024-05-08T20:15:19.527 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.527+0000 7f03d0ff9700 1 -- 172.21.15.33:0/2310362070 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7f03c40160d0 con 0x7f03d40682e0 2024-05-08T20:15:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.536+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f03bc0a1290 msgr2=0x7f03bc0a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.536+0000 7f03da100700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f03bc0a1290 0x7f03bc0a3750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03d4198ae0 tx=0x7f03c8009260 comp rx=0 tx=0).stop 2024-05-08T20:15:19.534 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.536+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d40682e0 msgr2=0x7f03d4197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T20:15:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.536+0000 7f03da100700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d40682e0 0x7f03d4197590 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f03c400d950 tx=0x7f03c400dc60 comp rx=0 tx=0).stop 2024-05-08T20:15:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.537+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 shutdown_connections 2024-05-08T20:15:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.537+0000 7f03da100700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f03d419be70 0x7f03d419c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.537+0000 7f03da100700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:6800/1417363085,v1:172.21.15.33:6801/1417363085] conn(0x7f03bc0a1290 0x7f03bc0a3750 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f03d4198ae0 tx=0x7f03c8009260 comp rx=0 tx=0).stop 2024-05-08T20:15:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.537+0000 7f03da100700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03d40682e0 0x7f03d4197590 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.537+0000 7f03da100700 1 --2- 172.21.15.33:0/2310362070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d4106290 0x7f03d4197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T20:15:19.535 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.537+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 >> 172.21.15.33:0/2310362070 conn(0x7f03d4076f40 msgr2=0x7f03d40fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T20:15:19.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.545+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 shutdown_connections 2024-05-08T20:15:19.546 INFO:teuthology.orchestra.run.smithi033.stderr:2024-05-08T20:15:19.548+0000 7f03da100700 1 -- 172.21.15.33:0/2310362070 wait complete. 2024-05-08T20:15:19.553 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2024-05-08T20:15:19.573 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T20:15:19.604 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T20:15:19.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T20:15:19.680 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-08T20:15:19.680 DEBUG:teuthology.orchestra.run.smithi033:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T20:15:19.702 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T20:15:19.722 DEBUG:teuthology.orchestra.run.smithi132:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T20:15:19.741 INFO:tasks.cephadm:Stopping all daemons... 2024-05-08T20:15:19.741 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-08T20:15:19.742 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a 2024-05-08T20:15:19.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:19 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/1798912276' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T20:15:19.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:19 smithi033 ceph-mon[42490]: osdmap e98: 12 total, 12 up, 12 in 2024-05-08T20:15:19.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:19 smithi033 ceph-mon[42490]: from='client.? 172.21.15.33:0/2310362070' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T20:15:19.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:19 smithi033 ceph-mon[42490]: pgmap v335: 65 pgs: 65 active+clean; 577 KiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:15:19.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:19 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/1798912276' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T20:15:19.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:19 smithi082 ceph-mon[46774]: osdmap e98: 12 total, 12 up, 12 in 2024-05-08T20:15:19.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:19 smithi082 ceph-mon[46774]: from='client.? 172.21.15.33:0/2310362070' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T20:15:19.880 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:19 smithi082 ceph-mon[46774]: pgmap v335: 65 pgs: 65 active+clean; 577 KiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:15:19.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:19 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/1798912276' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T20:15:19.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:19 smithi132 ceph-mon[47484]: osdmap e98: 12 total, 12 up, 12 in 2024-05-08T20:15:19.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:19 smithi132 ceph-mon[47484]: from='client.? 172.21.15.33:0/2310362070' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T20:15:19.883 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:19 smithi132 ceph-mon[47484]: pgmap v335: 65 pgs: 65 active+clean; 577 KiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T20:15:20.079 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:19 smithi033 systemd[1]: Stopping Ceph mon.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:20.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-a[42466]: 2024-05-08T20:15:20.008+0000 7f0ce064b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:20.080 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-a[42466]: 2024-05-08T20:15:20.008+0000 7f0ce064b700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-08T20:15:20.497 INFO:journalctl@ceph.mon.a.smithi033.stdout:May 08 20:15:20 smithi033 bash[113539]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-a 2024-05-08T20:15:20.504 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.a.service' 2024-05-08T20:15:20.607 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:20.607 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-08T20:15:20.607 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-08T20:15:20.608 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.b 2024-05-08T20:15:21.130 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:20 smithi082 systemd[1]: Stopping Ceph mon.b for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:21.131 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:20 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-b[46751]: 2024-05-08T20:15:20.863+0000 7f0baccd6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:21.131 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:20 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-b[46751]: 2024-05-08T20:15:20.863+0000 7f0baccd6700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-08T20:15:21.472 INFO:journalctl@ceph.mon.b.smithi082.stdout:May 08 20:15:21 smithi082 bash[89494]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-b 2024-05-08T20:15:21.478 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.b.service' 2024-05-08T20:15:21.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:21.528 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-08T20:15:21.529 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-08T20:15:21.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.c 2024-05-08T20:15:21.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:21 smithi132 systemd[1]: Stopping Ceph mon.c for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:21.876 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-c[47461]: 2024-05-08T20:15:21.776+0000 7f7e67b39700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:21.877 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-c[47461]: 2024-05-08T20:15:21.776+0000 7f7e67b39700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-08T20:15:22.133 INFO:journalctl@ceph.mon.c.smithi132.stdout:May 08 20:15:21 smithi132 bash[88984]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mon-c 2024-05-08T20:15:22.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mon.c.service' 2024-05-08T20:15:22.294 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:22.294 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-08T20:15:22.295 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-08T20:15:22.295 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.x 2024-05-08T20:15:22.579 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:15:22 smithi033 systemd[1]: Stopping Ceph mgr.x for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:22.579 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:15:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x[42743]: 2024-05-08T20:15:22.574+0000 7f7e76cc5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:23.330 INFO:journalctl@ceph.mgr.x.smithi033.stdout:May 08 20:15:23 smithi033 bash[113678]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-x 2024-05-08T20:15:23.355 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-08T20:15:23.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:23.399 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-08T20:15:23.399 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-08T20:15:23.399 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.y 2024-05-08T20:15:23.746 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:15:23 smithi082 systemd[1]: Stopping Ceph mgr.y for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:24.058 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:15:23 smithi082 bash[89634]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-y 2024-05-08T20:15:24.059 INFO:journalctl@ceph.mgr.y.smithi082.stdout:May 08 20:15:23 smithi082 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-08T20:15:24.064 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-08T20:15:24.102 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:24.102 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-08T20:15:24.102 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-08T20:15:24.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.z 2024-05-08T20:15:24.476 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:15:24 smithi132 systemd[1]: Stopping Ceph mgr.z for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:24.828 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:15:24 smithi132 bash[89126]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mgr-z 2024-05-08T20:15:24.828 INFO:journalctl@ceph.mgr.z.smithi132.stdout:May 08 20:15:24 smithi132 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-08T20:15:24.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-08T20:15:24.871 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:24.871 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-08T20:15:24.871 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-08T20:15:24.871 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.0 2024-05-08T20:15:25.330 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:15:24 smithi033 systemd[1]: Stopping Ceph osd.0 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:25.330 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:15:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-0[61701]: 2024-05-08T20:15:25.123+0000 7f53e6e91700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:25.330 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:15:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-0[61701]: 2024-05-08T20:15:25.123+0000 7f53e6e91700 -1 osd.0 99 *** Got signal Terminated *** 2024-05-08T20:15:25.330 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:15:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-0[61701]: 2024-05-08T20:15:25.123+0000 7f53e6e91700 -1 osd.0 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:15:30.830 INFO:journalctl@ceph.osd.0.smithi033.stdout:May 08 20:15:30 smithi033 bash[113821]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-0 2024-05-08T20:15:31.902 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.0.service' 2024-05-08T20:15:31.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:31.955 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-08T20:15:31.955 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-08T20:15:31.956 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.1 2024-05-08T20:15:32.380 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:15:31 smithi082 systemd[1]: Stopping Ceph osd.1 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:32.380 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:15:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-1[51770]: 2024-05-08T20:15:32.190+0000 7f6a9ad37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:32.380 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:15:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-1[51770]: 2024-05-08T20:15:32.190+0000 7f6a9ad37700 -1 osd.1 99 *** Got signal Terminated *** 2024-05-08T20:15:32.380 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:15:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-1[51770]: 2024-05-08T20:15:32.190+0000 7f6a9ad37700 -1 osd.1 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:15:38.131 INFO:journalctl@ceph.osd.1.smithi082.stdout:May 08 20:15:37 smithi082 bash[89772]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-1 2024-05-08T20:15:39.027 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.1.service' 2024-05-08T20:15:39.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:39.067 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-08T20:15:39.067 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-08T20:15:39.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.2 2024-05-08T20:15:39.383 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:15:39 smithi132 systemd[1]: Stopping Ceph osd.2 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:39.383 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:15:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-2[53255]: 2024-05-08T20:15:39.304+0000 7eff0c25e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:39.383 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:15:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-2[53255]: 2024-05-08T20:15:39.304+0000 7eff0c25e700 -1 osd.2 99 *** Got signal Terminated *** 2024-05-08T20:15:39.383 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:15:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-2[53255]: 2024-05-08T20:15:39.304+0000 7eff0c25e700 -1 osd.2 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:15:45.133 INFO:journalctl@ceph.osd.2.smithi132.stdout:May 08 20:15:44 smithi132 bash[89270]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-2 2024-05-08T20:15:46.066 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.2.service' 2024-05-08T20:15:46.106 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:46.106 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-08T20:15:46.106 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-08T20:15:46.106 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.3 2024-05-08T20:15:46.580 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:15:46 smithi033 systemd[1]: Stopping Ceph osd.3 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:46.580 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:15:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-3[69600]: 2024-05-08T20:15:46.370+0000 7fd81aa78700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:46.580 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:15:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-3[69600]: 2024-05-08T20:15:46.370+0000 7fd81aa78700 -1 osd.3 99 *** Got signal Terminated *** 2024-05-08T20:15:46.580 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:15:46 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-3[69600]: 2024-05-08T20:15:46.370+0000 7fd81aa78700 -1 osd.3 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:15:51.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:50 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:50.994+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:52.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:52 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:52.016+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:52.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:52 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:52.002+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:52.330 INFO:journalctl@ceph.osd.3.smithi033.stdout:May 08 20:15:51 smithi033 bash[114082]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-3 2024-05-08T20:15:52.880 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:52 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:52.610+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:15:53.282 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:53 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:53.060+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:53.282 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:52 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:52.958+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:53.291 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.3.service' 2024-05-08T20:15:53.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:15:53.344 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-08T20:15:53.344 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-08T20:15:53.345 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.4 2024-05-08T20:15:53.631 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:15:53 smithi082 systemd[1]: Stopping Ceph osd.4 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:15:53.631 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:15:53 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4[60475]: 2024-05-08T20:15:53.594+0000 7f439e59f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:15:53.631 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:15:53 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4[60475]: 2024-05-08T20:15:53.594+0000 7f439e59f700 -1 osd.4 99 *** Got signal Terminated *** 2024-05-08T20:15:53.631 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:15:53 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4[60475]: 2024-05-08T20:15:53.594+0000 7f439e59f700 -1 osd.4 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:15:54.130 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:53 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:53.636+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:15:54.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:54 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:54.032+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:54.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:53 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:53.940+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:54.383 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:15:54 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:15:54.067+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:15:54.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:15:54 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:15:54.126+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:15:54.880 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:54 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:54.619+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:15:55.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:54 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:54.994+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:55.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:54 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:54.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:55.383 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:15:55 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:15:55.067+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:15:55.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:15:55 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:15:55.159+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:15:55.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:55 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:55.587+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:15:56.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:55 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:55.976+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:56.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:55 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:55.924+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:56.383 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:15:56 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:15:56.105+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:15:56.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:15:56 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:15:56.162+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:15:56.880 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:56 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:56.610+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:15:57.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:57 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:57.008+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:57.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:56 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:56.948+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:57.383 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:15:57 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:15:57.059+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:15:57.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:15:57 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:15:57.130+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:15:57.880 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:57 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:57.609+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:15:58.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:58.052+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:58.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:57 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:57.974+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:58.384 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:15:58 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:15:58.081+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:15:58.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:15:58 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:15:58.172+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:15:58.565 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:15:58 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4[60475]: 2024-05-08T20:15:58.293+0000 7f4396b8d700 -1 osd.4 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.195500+0000 front 2024-05-08T20:15:36.195463+0000 (oldest deadline 2024-05-08T20:15:57.895686+0000) 2024-05-08T20:15:58.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:58 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:58.567+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:15:59.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:15:59 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:15:59.065+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:15:59.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:58.996+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:15:59.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:15:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:15:58.996+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:15:59.383 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:15:59 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:15:59.092+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:15:59.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:15:59 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:15:59.139+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:15:59.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:15:59 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:15:59.139+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:15:59.609 INFO:journalctl@ceph.osd.4.smithi082.stdout:May 08 20:15:59 smithi082 bash[90033]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-4 2024-05-08T20:15:59.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:15:59 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:15:59.609+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:00.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:00.064+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:00.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:00.064+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:00.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:00.022+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:00.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:00 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:00.022+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:00.383 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:00.130+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:16:00.383 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:00.130+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.526593+0000 front 2024-05-08T20:15:34.526434+0000 (oldest deadline 2024-05-08T20:15:59.826294+0000) 2024-05-08T20:16:00.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:00.142+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:00.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:00.142+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:00.413 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.4.service' 2024-05-08T20:16:00.454 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:00.454 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-08T20:16:00.454 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-08T20:16:00.454 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.5 2024-05-08T20:16:00.774 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:00 smithi132 systemd[1]: Stopping Ceph osd.5 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:00.774 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:00.691+0000 7f07f5987700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:00.774 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:00.691+0000 7f07f5987700 -1 osd.5 99 *** Got signal Terminated *** 2024-05-08T20:16:00.774 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:00.691+0000 7f07f5987700 -1 osd.5 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:16:00.880 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:00 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:00.646+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:01.133 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:00 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:00.775+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:01.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:01.030+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:01.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:01.030+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:01.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:01.046+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:01.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:01.046+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:01.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:01 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:01.187+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:01.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:01 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:01.187+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:01.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:01 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:01.150+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:16:01.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:01 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:01.150+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.526593+0000 front 2024-05-08T20:15:34.526434+0000 (oldest deadline 2024-05-08T20:15:59.826294+0000) 2024-05-08T20:16:01.880 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:01 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:01.610+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:02.133 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:01 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:01.802+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:02.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:02 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:02.064+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:02.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:02 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:02.064+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:02.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:02 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:02.020+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:02.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:02 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:02.020+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:02.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:02 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:02.209+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:02.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:02 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:02.209+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:02.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:02 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:02.166+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:16:02.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:02 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:02.166+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.526593+0000 front 2024-05-08T20:15:34.526434+0000 (oldest deadline 2024-05-08T20:15:59.826294+0000) 2024-05-08T20:16:03.131 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:02 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:02.671+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:03.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:02 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:02.644+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:03.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:02 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:02.644+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:03.133 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:02 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:02.841+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:03.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:03 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:03.054+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:03.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:03 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:03.054+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:03.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:03 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:03.038+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:03.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:03 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:03.038+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:03.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:03 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:03.242+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:03.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:03 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:03.242+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:03.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:03 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:03.175+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:16:03.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:03 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:03.175+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.526593+0000 front 2024-05-08T20:15:34.526434+0000 (oldest deadline 2024-05-08T20:15:59.826294+0000) 2024-05-08T20:16:04.130 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:03 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:03.659+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:04.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:03 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:03.665+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:04.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:03 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:03.665+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:04.133 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:03 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:03.845+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:04.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:04.092+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:04.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:04.092+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:04.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:04.005+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:04.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:04.005+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:04.633 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:04 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:04.184+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:16:04.633 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:04 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:04.184+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.526593+0000 front 2024-05-08T20:15:34.526434+0000 (oldest deadline 2024-05-08T20:15:59.826294+0000) 2024-05-08T20:16:04.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:04 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:04.219+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:04.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:04 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:04.219+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:04.880 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:04.696+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:04.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:04.618+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:04.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:04.618+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:05.133 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:04 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:04.871+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:05.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:05 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:05.139+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:05.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:05 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:05.139+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:05.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:04.971+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:05.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:04 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:04.971+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:05.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:05 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:05.200+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:05.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:05 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:05.200+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:05.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:05 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:05.138+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.125222+0000 front 2024-05-08T20:15:28.125386+0000 (oldest deadline 2024-05-08T20:15:54.025136+0000) 2024-05-08T20:16:05.634 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:05 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5[61061]: 2024-05-08T20:16:05.138+0000 7f07f1f7d700 -1 osd.5 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.526593+0000 front 2024-05-08T20:15:34.526434+0000 (oldest deadline 2024-05-08T20:15:59.826294+0000) 2024-05-08T20:16:05.880 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:05 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:05.735+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:05.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:05 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:05.579+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:05.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:05 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:05.579+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:05.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:05 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:05.579+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:06.168 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:05 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:05.910+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:06.169 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:05 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:05.910+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:06.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:05 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:05.949+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:06.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:05 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:05.949+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:06.331 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:06 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:06.090+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:06.331 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:06 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:06.090+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:06.331 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:06 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:06.090+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.816285+0000 front 2024-05-08T20:15:42.816256+0000 (oldest deadline 2024-05-08T20:16:05.716466+0000) 2024-05-08T20:16:06.427 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:06 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:06.169+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:06.427 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:06 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:06.169+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:06.880 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:06 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:06.692+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:06.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:06 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:06.692+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:06.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:06 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:06.611+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:06.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:06 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:06.611+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:06.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:06 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:06.611+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:06.883 INFO:journalctl@ceph.osd.5.smithi132.stdout:May 08 20:16:06 smithi132 bash[89523]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-5 2024-05-08T20:16:07.309 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:06 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:06.934+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:07.310 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:06 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:06.934+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:07.310 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:07 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:07.156+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:07.310 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:07 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:07.156+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:07.310 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:07 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:07.156+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:07.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:06 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:06.963+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:07.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:06 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:06.963+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:07.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:07.085+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:07.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:07.085+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:07.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:07.085+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.816285+0000 front 2024-05-08T20:15:42.816256+0000 (oldest deadline 2024-05-08T20:16:05.716466+0000) 2024-05-08T20:16:07.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.5.service' 2024-05-08T20:16:07.711 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:07.711 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-08T20:16:07.711 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-08T20:16:07.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.6 2024-05-08T20:16:07.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:07 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:07.735+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:07.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:07 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:07.735+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:07.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:07 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:07.607+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:07.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:07 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:07.607+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:07.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:07 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:07.607+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:08.080 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:07 smithi033 systemd[1]: Stopping Ceph osd.6 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:08.080 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:07.975+0000 7f3e9059d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:08.080 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:07.975+0000 7f3e9059d700 -1 osd.6 99 *** Got signal Terminated *** 2024-05-08T20:16:08.081 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:07.975+0000 7f3e9059d700 -1 osd.6 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:16:08.081 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:07.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:08.081 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:07.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:08.081 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:07 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:07.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:08.385 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:08 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:08.119+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:08.386 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:08 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:08.119+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:08.387 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:08 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:08.119+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:08.387 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:07 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:07.964+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:08.387 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:07 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:07.964+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:08.580 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:08.089+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:08.580 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:08.089+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:08.580 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:08.090+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.816285+0000 front 2024-05-08T20:15:42.816256+0000 (oldest deadline 2024-05-08T20:16:05.716466+0000) 2024-05-08T20:16:09.130 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:08 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:08.732+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:09.131 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:08 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:08.732+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:09.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:08 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:08.647+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:09.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:08 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:08.647+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:09.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:08 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:08.647+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:09.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:09 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:09.039+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:09.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:09 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:09.039+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:09.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:09 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:09.040+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.816285+0000 front 2024-05-08T20:15:42.816256+0000 (oldest deadline 2024-05-08T20:16:05.716466+0000) 2024-05-08T20:16:09.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:08.983+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:09.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:08.983+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:09.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:08 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:08.983+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:09.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:09 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:09.102+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:09.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:09 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:09.102+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:09.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:09 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:09.102+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:09.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:08 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:08.990+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:09.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:08 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:08.990+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:09.880 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:09 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:09.623+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:09.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:09 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:09.623+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:09.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:09 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:09.623+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:09.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:09 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:09.764+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:09.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:09 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:09.764+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:10.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:10.078+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:10.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:10.078+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:10.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:10.078+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.816285+0000 front 2024-05-08T20:15:42.816256+0000 (oldest deadline 2024-05-08T20:16:05.716466+0000) 2024-05-08T20:16:10.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:10.009+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:10.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:10.009+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:10.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:10.009+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:10.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:10 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:10.146+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:10.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:10 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:10.146+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:10.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:10 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:10.146+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:10.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:10 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:10.015+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:10.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:10 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:10.015+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:10.880 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:10 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:10.757+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:10.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:10 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:10.757+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:10.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:10 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:10.590+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:10.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:10 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:10.590+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:10.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:10 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:10.590+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:11.331 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:11 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:11.048+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:11.331 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:11 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:11.048+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:11.331 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:11 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:11.048+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.816285+0000 front 2024-05-08T20:15:42.816256+0000 (oldest deadline 2024-05-08T20:16:05.716466+0000) 2024-05-08T20:16:11.332 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:10.984+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:11.332 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:10.984+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:11.332 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:10 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:10.984+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:11.383 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:10 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:10.981+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:11.383 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:10 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:10.981+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:11.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:11 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:11.175+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:11.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:11 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:11.175+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:11.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:11 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:11.175+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:11.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:11 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:11.735+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:11.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:11 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:11.735+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:11.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:11 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:11.541+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:11.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:11 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:11.541+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:11.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:11 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:11.541+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:12.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:12 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:12.004+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:26.512784+0000 front 2024-05-08T20:15:26.512811+0000 (oldest deadline 2024-05-08T20:15:50.612944+0000) 2024-05-08T20:16:12.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:12 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:12.004+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.015317+0000 front 2024-05-08T20:15:37.015362+0000 (oldest deadline 2024-05-08T20:15:59.315250+0000) 2024-05-08T20:16:12.330 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:12 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6[77549]: 2024-05-08T20:16:12.004+0000 7f3e8cb93700 -1 osd.6 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.816285+0000 front 2024-05-08T20:15:42.816256+0000 (oldest deadline 2024-05-08T20:16:05.716466+0000) 2024-05-08T20:16:12.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:11 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:11.997+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:12.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:11 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:11.997+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:12.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:11 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:11.997+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:12.385 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:12 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:12.173+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:12.385 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:12 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:12.173+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:12.385 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:12 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:12.173+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:12.386 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:11 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:11.967+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:12.386 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:11 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:11.967+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:12.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:12 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:12.695+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:12.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:12 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:12.695+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:12.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:12 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:12.532+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:12.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:12 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:12.532+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:12.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:12 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:12.532+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:13.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:12 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:12.991+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:13.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:12 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:12.991+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:13.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:12 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:12.991+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:13.383 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:12 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:12.918+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:13.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:12 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:12.918+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:13.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:13 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:13.167+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:13.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:13 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:13.167+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:13.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:13 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:13.167+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:13.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:13 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:13.167+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:13.830 INFO:journalctl@ceph.osd.6.smithi033.stdout:May 08 20:16:13 smithi033 bash[114340]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-6 2024-05-08T20:16:13.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:13 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:13.710+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:13.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:13 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:13.710+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:13.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:13 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:13.517+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:13.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:13 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:13.517+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:13.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:13 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:13.517+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:14.153 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:13 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:13.895+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:14.154 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:13 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:13.895+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:14.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:14 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:14.035+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:14.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:14 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:14.035+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:14.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:14 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:14.035+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:14.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:14 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:14.035+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:14.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:14.155+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:14.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:14.155+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:14.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:14.155+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:14.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:14.155+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:14.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:14 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:14.755+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:14.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:14 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:14.755+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:14.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:14 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:14.565+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:14.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:14 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:14.565+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:14.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:14 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:14.565+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:14.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:14 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:14.565+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:14.929 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.6.service' 2024-05-08T20:16:14.983 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:14.983 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-08T20:16:14.983 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-08T20:16:14.984 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.7 2024-05-08T20:16:15.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:15 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:15.071+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:15.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:15 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:15.071+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:15.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:15 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:15.071+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:15.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:15 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:15.071+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:15.381 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:15 smithi082 systemd[1]: Stopping Ceph osd.7 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:15.381 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:15.214+0000 7fc96cdad700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:15.381 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:15.214+0000 7fc96cdad700 -1 osd.7 99 *** Got signal Terminated *** 2024-05-08T20:16:15.381 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:15.214+0000 7fc96cdad700 -1 osd.7 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:16:15.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:15.164+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:15.383 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:15.164+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:15.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:15.164+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:15.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:15.164+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:15.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:14.919+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:15.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:14.919+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:15.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:14 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:14.919+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:15.880 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:15.707+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:15.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:15.707+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:15.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:15.707+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:51.270090+0000 front 2024-05-08T20:15:51.270034+0000 (oldest deadline 2024-05-08T20:16:15.270439+0000) 2024-05-08T20:16:15.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:15.578+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:15.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:15.578+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:15.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:15.578+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:15.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:15 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:15.578+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:16.195 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:15.890+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:16.195 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:15.890+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:16.196 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:15 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:15.890+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:16.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:16.098+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:16.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:16.098+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:16.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:16.098+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:16.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:16 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:16.098+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:16.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:16.197+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:16.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:16.197+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:16.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:16.197+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:16.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:16.197+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:16.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:16.739+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:16.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:16.739+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:16.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:16.739+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:51.270090+0000 front 2024-05-08T20:15:51.270034+0000 (oldest deadline 2024-05-08T20:16:15.270439+0000) 2024-05-08T20:16:16.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:16.569+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:16.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:16.569+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:16.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:16.569+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:16.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:16 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:16.569+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:17.216 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:16.925+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:17.216 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:16.925+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:17.216 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:16 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:16.925+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:17.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:17 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:17.103+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:17.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:17 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:17.103+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:17.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:17 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:17.103+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:17.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:17 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:17.103+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:17.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:17.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:17.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:17.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:17.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:17.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:17.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:17.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:17.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:17.712+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:17.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:17.712+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:17.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:17.712+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:51.270090+0000 front 2024-05-08T20:15:51.270034+0000 (oldest deadline 2024-05-08T20:16:15.270439+0000) 2024-05-08T20:16:17.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:17.608+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:17.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:17.608+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:17.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:17.608+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:17.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:17.608+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:18.252 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:17.933+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:18.252 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:17.933+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:18.253 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:17 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:17.933+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:18.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:18 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:18.124+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:18.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:18 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:18.124+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:18.581 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:18 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:18.124+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:18.581 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:18 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:18.124+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:18.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:18 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:18.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:18.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:18 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:18.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:18.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:18 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:18.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:18.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:18 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:18.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:18.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:18 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:18.713+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:18.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:18 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:18.713+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:18.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:18 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:18.713+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:51.270090+0000 front 2024-05-08T20:15:51.270034+0000 (oldest deadline 2024-05-08T20:16:15.270439+0000) 2024-05-08T20:16:18.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:18 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:18.584+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:18.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:18 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:18.584+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:18.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:18 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:18.584+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:18.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:18 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:18.584+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:19.250 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:18 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:18.907+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:19.250 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:18 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:18.907+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:19.250 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:18 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:18.907+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:19.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:19.122+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:19.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:19.122+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:19.581 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:19.122+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:19.581 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:19 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:19.122+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:19.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:19.251+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:19.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:19.251+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:19.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:19.251+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:19.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:19.251+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:19.719+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:36.568004+0000 front 2024-05-08T20:15:36.568041+0000 (oldest deadline 2024-05-08T20:16:02.468207+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:19.719+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.468875+0000 front 2024-05-08T20:15:42.468740+0000 (oldest deadline 2024-05-08T20:16:05.968886+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:19.719+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:51.270090+0000 front 2024-05-08T20:15:51.270034+0000 (oldest deadline 2024-05-08T20:16:15.270439+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7[69168]: 2024-05-08T20:16:19.719+0000 7fc9693a3700 -1 osd.7 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.571432+0000 front 2024-05-08T20:15:57.571448+0000 (oldest deadline 2024-05-08T20:16:19.271600+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:19.540+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:19.540+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:19.540+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:19.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:19 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:19.540+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:20.227 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:19.929+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:20.227 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:19.929+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:20.227 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:19 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:19.929+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:20.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:20.102+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:20.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:20.102+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:20.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:20.102+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:20.581 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:20 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:20.102+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:20.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:20.228+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:20.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:20.228+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:20.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:20.228+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:20.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:20.229+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:20.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:20 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:20.501+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:20.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:20 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:20.501+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:20.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:20 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:20.501+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:20.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:20 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:20.501+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:21.218 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:20.921+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:21.218 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:20.921+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:21.218 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:20 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:20.921+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:21.381 INFO:journalctl@ceph.osd.7.smithi082.stdout:May 08 20:16:20 smithi082 bash[90298]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-7 2024-05-08T20:16:21.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:21.091+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:21.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:21.091+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:21.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:21.091+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:21.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:21 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:21.091+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:21.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:21.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:21.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:21.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:21.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:21.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:21.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:21.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:21.808 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:21.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:21.809 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:21.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:21.809 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:21.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:21.809 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:21 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:21.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:22.141 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.7.service' 2024-05-08T20:16:22.181 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:22.182 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-08T20:16:22.182 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-08T20:16:22.182 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.8 2024-05-08T20:16:22.213 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:21.924+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:22.213 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:21.924+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:22.213 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:21.924+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:22.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:22.109+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:22.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:22.109+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:22.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:22.109+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:22.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:22.109+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:22.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:22 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:22.109+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 systemd[1]: Stopping Ceph osd.8 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:22.447+0000 7f40ed66a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:22.447+0000 7f40ed66a700 -1 osd.8 99 *** Got signal Terminated *** 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:22.447+0000 7f40ed66a700 -1 osd.8 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:22.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:22.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:22.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:22.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:22.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:22.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:22.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:22.474+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:22.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:22.474+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:22.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:22.474+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:22.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:22 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:22.474+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:23.253 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:22.889+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:23.253 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:22.889+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:23.253 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:22.889+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:23.253 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:22 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:22.889+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.491474+0000 front 2024-05-08T20:15:57.491370+0000 (oldest deadline 2024-05-08T20:16:22.191122+0000) 2024-05-08T20:16:23.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:23 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:23.063+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:23.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:23 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:23.063+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:23.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:23 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:23.063+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:23.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:23 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:23.063+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:23.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:23 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:23.063+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:23.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:23.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:23.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:23.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:23.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:23.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:23.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:23.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:23.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:23.254+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:23.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:23.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:23.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:23.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:23.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:23.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:23.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:23 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:23.484+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:24.216 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:23.911+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:24.217 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:23.911+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:24.217 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:23.911+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:24.217 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:23 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:23.911+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.491474+0000 front 2024-05-08T20:15:57.491370+0000 (oldest deadline 2024-05-08T20:16:22.191122+0000) 2024-05-08T20:16:24.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:24.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:24.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:24.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:24.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:24.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:24.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:24.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:24.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:24 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:24.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:24.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:24.218+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:24.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:24.218+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:24.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:24.218+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:24.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:24.218+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:24.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:24.218+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:24.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:24 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:24.470+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:24.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:24 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:24.470+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:24.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:24 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:24.470+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:24.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:24 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:24.470+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:25.232 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:24.950+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:25.233 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:24.950+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:25.233 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:24.950+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:25.233 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:24 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:24.950+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.491474+0000 front 2024-05-08T20:15:57.491370+0000 (oldest deadline 2024-05-08T20:16:22.191122+0000) 2024-05-08T20:16:25.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:25.013+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:25.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:25.013+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:25.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:25.013+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:25.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:25.013+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:25.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:25 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:25.013+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:25.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:25.233+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:25.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:25.233+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:25.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:25.233+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:25.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:25.233+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:25.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:25.233+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:25.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:25.435+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:25.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:25.435+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:25.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:25.435+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:25.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:25.435+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:25.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:25 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:25.435+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:26.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:26.038+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:26.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:26.038+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:26.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:26.038+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:26.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:26.038+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:26.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:26 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:26.038+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:26.383 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:25.998+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:25.998+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:25.998+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:25.998+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.491474+0000 front 2024-05-08T20:15:57.491370+0000 (oldest deadline 2024-05-08T20:16:22.191122+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:26.215+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:26.215+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:26.215+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:26.215+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:26.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:26 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:26.215+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:26.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:26 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:26.443+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:26.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:26 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:26.443+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:26.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:26 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:26.443+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:26.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:26 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:26.443+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:26.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:26 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:26.443+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:27.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:27.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:27.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:27.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:27.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:27.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:27.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:27.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:27.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:27 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:27.047+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:27.383 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:27.017+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:37.088097+0000 front 2024-05-08T20:15:37.088188+0000 (oldest deadline 2024-05-08T20:16:00.488901+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:27.017+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:40.489250+0000 front 2024-05-08T20:15:40.489331+0000 (oldest deadline 2024-05-08T20:16:05.189464+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:27.017+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.890295+0000 front 2024-05-08T20:15:49.890472+0000 (oldest deadline 2024-05-08T20:16:13.990313+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8[68973]: 2024-05-08T20:16:27.017+0000 7f40e5c58700 -1 osd.8 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.491474+0000 front 2024-05-08T20:15:57.491370+0000 (oldest deadline 2024-05-08T20:16:22.191122+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:27.216+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:27.216+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:27.216+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:27.216+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:27.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:27 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:27.216+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:27.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:27.479+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:27.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:27.479+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:27.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:27.479+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:27.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:27.479+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:27.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:27.479+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:27.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:27 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:27.479+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:28.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:28 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:28.044+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:28.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:28 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:28.044+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:28.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:28 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:28.044+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:28.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:28 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:28.044+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:28.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:28 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:28.044+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:28.384 INFO:journalctl@ceph.osd.8.smithi132.stdout:May 08 20:16:28 smithi132 bash[89784]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-8 2024-05-08T20:16:28.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:28 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:28.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:28.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:28 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:28.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:28.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:28 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:28.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:28.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:28 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:28.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:28.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:28 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:28.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:28.384 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:28 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:28.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:28.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:28 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:28.466+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:28.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:28 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:28.466+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:28.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:28 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:28.466+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:28.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:28 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:28.466+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:28.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:28 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:28.466+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:28.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:28 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:28.466+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:29.274 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.8.service' 2024-05-08T20:16:29.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.025+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:29.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.025+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:29.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.025+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:29.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.025+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:29.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.025+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:29.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.025+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:01.948550+0000 front 2024-05-08T20:16:01.948519+0000 (oldest deadline 2024-05-08T20:16:28.949254+0000) 2024-05-08T20:16:29.356 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:29.356 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-08T20:16:29.356 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-08T20:16:29.357 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.9 2024-05-08T20:16:29.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:29.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:29.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:29.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:29.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:29.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:29.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:29.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:29.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:29.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:29.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:29.220+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:29.831 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 systemd[1]: Stopping Ceph osd.9 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:29.831 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.613+0000 7f723acb3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:29.831 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.613+0000 7f723acb3700 -1 osd.9 99 *** Got signal Terminated *** 2024-05-08T20:16:29.831 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:29 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:29.613+0000 7f723acb3700 -1 osd.9 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:16:29.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:29 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:29.422+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:29.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:29 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:29.422+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:29.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:29 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:29.422+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:29.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:29 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:29.422+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:29.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:29 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:29.422+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:29.882 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:29 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:29.422+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:30.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.012+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:30.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.012+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:30.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.012+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:30.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.012+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:30.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.012+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:30.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.012+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:01.948550+0000 front 2024-05-08T20:16:01.948519+0000 (oldest deadline 2024-05-08T20:16:28.949254+0000) 2024-05-08T20:16:30.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:30 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:30.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:30.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:30 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:30.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:30.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:30 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:30.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:30.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:30 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:30.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:30.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:30 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:30.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:30.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:30 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:30.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:30.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:30 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:30.413+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:30.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:30 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:30.413+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:30.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:30 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:30.413+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:30.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:30 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:30.413+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:30.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:30 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:30.413+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:30.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:30 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:30.413+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:31.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.965+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:31.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.965+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:31.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.965+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:31.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.965+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:31.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.965+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:31.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:30 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:30.965+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:01.948550+0000 front 2024-05-08T20:16:01.948519+0000 (oldest deadline 2024-05-08T20:16:28.949254+0000) 2024-05-08T20:16:31.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:31 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:31.192+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:31.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:31 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:31.192+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:31.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:31 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:31.192+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:31.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:31 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:31.192+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:31.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:31 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:31.192+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:31.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:31 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:31.192+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:31.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:31 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:31.384+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:31.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:31 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:31.384+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:31.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:31 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:31.384+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:31.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:31 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:31.384+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:31.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:31 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:31.384+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:31.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:31 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:31.384+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:32.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.011+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:32.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.011+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:32.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.011+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:32.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.011+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:32.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.011+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:32.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.011+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:01.948550+0000 front 2024-05-08T20:16:01.948519+0000 (oldest deadline 2024-05-08T20:16:28.949254+0000) 2024-05-08T20:16:32.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:32.342+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:32.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:32.342+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:32.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:32.342+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:32.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:32.342+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:32.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:32.342+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:32.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:32 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:32.342+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:32.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:32 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:32.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:32.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:32 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:32.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:32.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:32 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:32.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:32.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:32 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:32.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:32.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:32 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:32.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:32.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:32 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:32.240+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:33.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.977+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:33.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.977+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:33.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.977+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:33.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.977+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:33.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.977+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:33.331 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:32 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:32.977+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:01.948550+0000 front 2024-05-08T20:16:01.948519+0000 (oldest deadline 2024-05-08T20:16:28.949254+0000) 2024-05-08T20:16:33.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:33 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:33.304+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:33.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:33 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:33.304+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:33.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:33 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:33.304+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:33.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:33 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:33.304+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:33.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:33 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:33.304+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:33.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:33 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:33.304+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:33.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:33.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:33.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:33.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:33.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:33.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:33.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:33.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:33.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:33.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:33.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:33.193+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:34.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:33 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:33.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:25.742738+0000 front 2024-05-08T20:15:25.742713+0000 (oldest deadline 2024-05-08T20:15:51.042866+0000) 2024-05-08T20:16:34.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:33 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:33.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:33.343847+0000 front 2024-05-08T20:15:33.344060+0000 (oldest deadline 2024-05-08T20:15:58.643897+0000) 2024-05-08T20:16:34.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:33 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:33.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.045670+0000 front 2024-05-08T20:15:42.045613+0000 (oldest deadline 2024-05-08T20:16:07.345819+0000) 2024-05-08T20:16:34.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:33 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:33.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:47.346243+0000 front 2024-05-08T20:15:47.346307+0000 (oldest deadline 2024-05-08T20:16:13.146752+0000) 2024-05-08T20:16:34.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:33 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:33.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:57.847996+0000 front 2024-05-08T20:15:57.847965+0000 (oldest deadline 2024-05-08T20:16:21.947959+0000) 2024-05-08T20:16:34.330 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:33 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9[86143]: 2024-05-08T20:16:33.937+0000 7f72372a9700 -1 osd.9 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:01.948550+0000 front 2024-05-08T20:16:01.948519+0000 (oldest deadline 2024-05-08T20:16:28.949254+0000) 2024-05-08T20:16:34.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:34 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:34.330+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:34.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:34 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:34.330+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:34.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:34 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:34.330+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:34.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:34 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:34.330+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:34.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:34 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:34.330+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:34.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:34 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:34.330+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:34.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:34 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:34.198+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:34.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:34 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:34.198+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:34.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:34 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:34.198+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:34.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:34 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:34.198+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:34.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:34 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:34.198+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:34.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:34 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:34.198+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:35.580 INFO:journalctl@ceph.osd.9.smithi033.stdout:May 08 20:16:35 smithi033 bash[114598]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-9 2024-05-08T20:16:35.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:35 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:35.333+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:35.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:35 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:35.333+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:35.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:35 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:35.333+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:35.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:35 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:35.333+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:35.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:35 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:35.333+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:35.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:35 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:35.333+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:35.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:35 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:35.182+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:35.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:35 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:35.182+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:35.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:35 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:35.182+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:35.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:35 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:35.182+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:35.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:35 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:35.182+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:35.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:35 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:35.182+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:36.575 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.9.service' 2024-05-08T20:16:36.629 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:36.629 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-08T20:16:36.629 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-08T20:16:36.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.10 2024-05-08T20:16:36.630 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.380+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:36.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.380+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:36.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.380+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:36.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.380+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:36.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.380+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:36.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.380+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:36.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:36 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:36.176+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:36.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:36 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:36.176+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:36.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:36 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:36.176+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:36.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:36 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:36.176+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:36.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:36 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:36.176+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:36.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:36 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:36.176+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:37.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 systemd[1]: Stopping Ceph osd.10 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:37.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.867+0000 7f15149c8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:37.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.867+0000 7f15149c8700 -1 osd.10 99 *** Got signal Terminated *** 2024-05-08T20:16:37.131 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:36 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:36.867+0000 7f15149c8700 -1 osd.10 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:16:37.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:37.334+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:37.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:37.334+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:37.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:37.334+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:37.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:37.334+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:37.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:37.334+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:37.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:37 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:37.334+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:37.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:37.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:37.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:37.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:37.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:37.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:37.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:37.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:37.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:37.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:37.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:37 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:37.185+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:38.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:38.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:38.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:38.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:38.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:38.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:38.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:38.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:38.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:38.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:38.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:38.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:38.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:38 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:38.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-05-08T20:16:07.109203+0000 front 2024-05-08T20:16:07.109147+0000 (oldest deadline 2024-05-08T20:16:38.309508+0000) 2024-05-08T20:16:38.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:38.202+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:38.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:38.202+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:38.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:38.202+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:38.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:38.202+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:38.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:38.202+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:38.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:38 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:38.202+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:39.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:39.379+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:39.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:39.379+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:39.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:39.379+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:39.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:39.379+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:39.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:39.379+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:39.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:39.379+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:39.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:39 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:39.379+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-05-08T20:16:07.109203+0000 front 2024-05-08T20:16:07.109147+0000 (oldest deadline 2024-05-08T20:16:38.309508+0000) 2024-05-08T20:16:39.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:39.244+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:39.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:39.244+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:39.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:39.244+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:39.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:39.244+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:39.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:39.244+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:39.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:39 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:39.244+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:40.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:40.375+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:40.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:40.375+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:40.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:40.375+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:40.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:40.375+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:40.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:40.375+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:40.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:40.375+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:40.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:40 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:40.375+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-05-08T20:16:07.109203+0000 front 2024-05-08T20:16:07.109147+0000 (oldest deadline 2024-05-08T20:16:38.309508+0000) 2024-05-08T20:16:40.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:40.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:40.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:40.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:40.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:40.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:40.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:40.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:40.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:40.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:40.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:40 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:40.217+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:41.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:41.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:28.802151+0000 front 2024-05-08T20:15:28.802123+0000 (oldest deadline 2024-05-08T20:15:52.302194+0000) 2024-05-08T20:16:41.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:41.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:32.803043+0000 front 2024-05-08T20:15:32.803059+0000 (oldest deadline 2024-05-08T20:16:02.203831+0000) 2024-05-08T20:16:41.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:41.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.204380+0000 front 2024-05-08T20:15:42.204396+0000 (oldest deadline 2024-05-08T20:16:05.104463+0000) 2024-05-08T20:16:41.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:41.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:49.805606+0000 front 2024-05-08T20:15:49.805503+0000 (oldest deadline 2024-05-08T20:16:13.805978+0000) 2024-05-08T20:16:41.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:41.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:55.506811+0000 front 2024-05-08T20:15:55.506829+0000 (oldest deadline 2024-05-08T20:16:24.907344+0000) 2024-05-08T20:16:41.631 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:41.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:05.408560+0000 front 2024-05-08T20:16:05.408496+0000 (oldest deadline 2024-05-08T20:16:27.108365+0000) 2024-05-08T20:16:41.632 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:41 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10[77135]: 2024-05-08T20:16:41.364+0000 7f150cfb6700 -1 osd.10 99 heartbeat_check: no reply from 172.21.15.33:6822 osd.6 since back 2024-05-08T20:16:07.109203+0000 front 2024-05-08T20:16:07.109147+0000 (oldest deadline 2024-05-08T20:16:38.309508+0000) 2024-05-08T20:16:41.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:41.238+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:41.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:41.238+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:41.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:41.238+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:41.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:41.238+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:41.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:41.238+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:41.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:41.238+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:41.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:41 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:41.238+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:42.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:42.246+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:42.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:42.246+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:42.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:42.246+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:42.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:42.246+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:42.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:42.246+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:42.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:42.246+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:42.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:42 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:42.246+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:42.881 INFO:journalctl@ceph.osd.10.smithi082.stdout:May 08 20:16:42 smithi082 bash[90555]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-10 2024-05-08T20:16:43.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:43.224+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:43.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:43.224+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:43.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:43.224+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:43.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:43.224+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:43.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:43.224+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:43.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:43.224+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:43.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:43.224+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:43.778 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.10.service' 2024-05-08T20:16:43.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:43.822 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-08T20:16:43.822 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-08T20:16:43.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.11 2024-05-08T20:16:44.134 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:43 smithi132 systemd[1]: Stopping Ceph osd.11 for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:44.134 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.076+0000 7fe0cfb29700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:44.134 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.076+0000 7fe0cfb29700 -1 osd.11 99 *** Got signal Terminated *** 2024-05-08T20:16:44.134 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.076+0000 7fe0cfb29700 -1 osd.11 99 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T20:16:44.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.265+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:44.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.265+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:44.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.265+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:44.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.265+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:44.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.265+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:44.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.265+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:44.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:44 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:44.265+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:45.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:45 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:45.309+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:45.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:45 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:45.309+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:45.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:45 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:45.309+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:45.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:45 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:45.309+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:45.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:45 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:45.309+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:45.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:45 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:45.309+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:45.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:45 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:45.309+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:46.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:46 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:46.351+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:46.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:46 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:46.351+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:46.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:46 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:46.351+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:46.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:46 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:46.351+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:46.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:46 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:46.351+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:46.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:46 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:46.351+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:46.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:46 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:46.351+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:47.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:47 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:47.316+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:47.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:47 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:47.316+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:47.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:47 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:47.316+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:47.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:47 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:47.316+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:47.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:47 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:47.316+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:47.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:47 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:47.316+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:47.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:47 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:47.316+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:48.633 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:48 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:48.321+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6806 osd.0 since back 2024-05-08T20:15:29.513023+0000 front 2024-05-08T20:15:29.513206+0000 (oldest deadline 2024-05-08T20:15:53.613133+0000) 2024-05-08T20:16:48.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:48 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:48.321+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6804 osd.1 since back 2024-05-08T20:15:34.114169+0000 front 2024-05-08T20:15:34.114193+0000 (oldest deadline 2024-05-08T20:15:58.814098+0000) 2024-05-08T20:16:48.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:48 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:48.321+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6804 osd.2 since back 2024-05-08T20:15:42.815943+0000 front 2024-05-08T20:15:42.815987+0000 (oldest deadline 2024-05-08T20:16:06.316119+0000) 2024-05-08T20:16:48.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:48 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:48.321+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.33:6814 osd.3 since back 2024-05-08T20:15:48.017156+0000 front 2024-05-08T20:15:48.017111+0000 (oldest deadline 2024-05-08T20:16:12.717157+0000) 2024-05-08T20:16:48.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:48 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:48.321+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6812 osd.4 since back 2024-05-08T20:15:56.718899+0000 front 2024-05-08T20:15:56.718968+0000 (oldest deadline 2024-05-08T20:16:21.418758+0000) 2024-05-08T20:16:48.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:48 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:48.321+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.132:6812 osd.5 since back 2024-05-08T20:16:03.119772+0000 front 2024-05-08T20:16:03.119703+0000 (oldest deadline 2024-05-08T20:16:27.219759+0000) 2024-05-08T20:16:48.634 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:48 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11[76933]: 2024-05-08T20:16:48.321+0000 7fe0cc11f700 -1 osd.11 99 heartbeat_check: no reply from 172.21.15.82:6820 osd.7 since back 2024-05-08T20:16:20.022231+0000 front 2024-05-08T20:16:20.022155+0000 (oldest deadline 2024-05-08T20:16:41.022422+0000) 2024-05-08T20:16:49.883 INFO:journalctl@ceph.osd.11.smithi132.stdout:May 08 20:16:49 smithi132 bash[90040]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-osd-11 2024-05-08T20:16:50.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@osd.11.service' 2024-05-08T20:16:50.870 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:50.870 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-08T20:16:50.870 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-08T20:16:50.871 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.a 2024-05-08T20:16:51.330 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:16:50 smithi033 systemd[1]: Stopping Ceph mds.a for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:51.331 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:16:51 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-a[94009]: 2024-05-08T20:16:51.151+0000 7fc9ead3f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:51.331 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:16:51 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-a[94009]: 2024-05-08T20:16:51.151+0000 7fc9ead3f700 -1 mds.a *** got signal Terminated *** 2024-05-08T20:16:54.075 INFO:journalctl@ceph.mds.a.smithi033.stdout:May 08 20:16:53 smithi033 bash[114853]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-a 2024-05-08T20:16:54.082 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.a.service' 2024-05-08T20:16:54.124 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:54.124 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-08T20:16:54.124 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-08T20:16:54.124 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.d 2024-05-08T20:16:54.330 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:16:54 smithi033 systemd[1]: Stopping Ceph mds.d for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:54.830 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:16:54 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-d[93100]: 2024-05-08T20:16:54.400+0000 7fc52af29700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:54.830 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:16:54 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-d[93100]: 2024-05-08T20:16:54.400+0000 7fc52af29700 -1 mds.d *** got signal Terminated *** 2024-05-08T20:16:57.780 INFO:journalctl@ceph.mds.d.smithi033.stdout:May 08 20:16:57 smithi033 bash[115000]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-d 2024-05-08T20:16:57.788 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.d.service' 2024-05-08T20:16:57.830 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:16:57.831 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-08T20:16:57.831 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-08T20:16:57.831 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.g 2024-05-08T20:16:58.080 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:16:57 smithi033 systemd[1]: Stopping Ceph mds.g for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:16:58.580 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:16:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-g[93621]: 2024-05-08T20:16:58.125+0000 7f8dab077700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:16:58.580 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:16:58 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-g[93621]: 2024-05-08T20:16:58.125+0000 7f8dab077700 -1 mds.g *** got signal Terminated *** 2024-05-08T20:17:00.830 INFO:journalctl@ceph.mds.g.smithi033.stdout:May 08 20:17:00 smithi033 bash[115139]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-g 2024-05-08T20:17:00.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.g.service' 2024-05-08T20:17:00.956 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:00.957 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-08T20:17:00.957 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-08T20:17:00.957 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.j 2024-05-08T20:17:01.281 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:17:01 smithi033 systemd[1]: Stopping Ceph mds.j for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:01.580 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:17:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-j[92712]: 2024-05-08T20:17:01.282+0000 7ff4c6599700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:01.580 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:17:01 smithi033 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-j[92712]: 2024-05-08T20:17:01.282+0000 7ff4c6599700 -1 mds.j *** got signal Terminated *** 2024-05-08T20:17:03.830 INFO:journalctl@ceph.mds.j.smithi033.stdout:May 08 20:17:03 smithi033 bash[115279]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-j 2024-05-08T20:17:03.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.j.service' 2024-05-08T20:17:03.952 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:03.952 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-08T20:17:03.952 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-08T20:17:03.952 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.b 2024-05-08T20:17:04.381 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:17:03 smithi082 systemd[1]: Stopping Ceph mds.b for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:04.381 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:17:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b[83545]: 2024-05-08T20:17:04.195+0000 7fe1fef08700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:04.381 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:17:04 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b[83545]: 2024-05-08T20:17:04.195+0000 7fe1fef08700 -1 mds.b *** got signal Terminated *** 2024-05-08T20:17:08.605 INFO:journalctl@ceph.mds.b.smithi082.stdout:May 08 20:17:08 smithi082 bash[90809]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-b 2024-05-08T20:17:08.611 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.b.service' 2024-05-08T20:17:08.649 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:08.649 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-08T20:17:08.649 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-08T20:17:08.650 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.e 2024-05-08T20:17:08.881 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:17:08 smithi082 systemd[1]: Stopping Ceph mds.e for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:09.381 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:17:08 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-e[82856]: 2024-05-08T20:17:08.918+0000 7f1cfcabb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:09.381 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:17:08 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-e[82856]: 2024-05-08T20:17:08.918+0000 7f1cfcabb700 -1 mds.e *** got signal Terminated *** 2024-05-08T20:17:12.817 INFO:journalctl@ceph.mds.e.smithi082.stdout:May 08 20:17:12 smithi082 bash[90956]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-e 2024-05-08T20:17:12.823 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.e.service' 2024-05-08T20:17:12.858 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:12.859 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-08T20:17:12.859 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-08T20:17:12.860 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h 2024-05-08T20:17:13.116 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:17:12 smithi082 systemd[1]: Stopping Ceph mds.h for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:13.381 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:17:13 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[86583]: 2024-05-08T20:17:13.117+0000 7f39edb1d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:13.381 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:17:13 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h[86583]: 2024-05-08T20:17:13.117+0000 7f39edb1d700 -1 mds.h *** got signal Terminated *** 2024-05-08T20:17:16.730 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:17:16 smithi082 bash[91096]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-h 2024-05-08T20:17:16.730 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:17:16 smithi082 systemd[1]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h.service: Succeeded. 2024-05-08T20:17:16.730 INFO:journalctl@ceph.mds.h.smithi082.stdout:May 08 20:17:16 smithi082 systemd[1]: Stopped Ceph mds.h for 0ee61dd4-0d75-11ef-bc97-c7b262605968. 2024-05-08T20:17:16.731 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.h.service' 2024-05-08T20:17:16.765 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:16.766 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-08T20:17:16.766 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-08T20:17:16.766 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.k 2024-05-08T20:17:17.015 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:17:16 smithi082 systemd[1]: Stopping Ceph mds.k for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:17.381 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:17:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-k[82514]: 2024-05-08T20:17:17.016+0000 7f7be8133700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:17.381 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:17:17 smithi082 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-k[82514]: 2024-05-08T20:17:17.016+0000 7f7be8133700 -1 mds.k *** got signal Terminated *** 2024-05-08T20:17:21.527 INFO:journalctl@ceph.mds.k.smithi082.stdout:May 08 20:17:21 smithi082 bash[91234]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-k 2024-05-08T20:17:21.534 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.k.service' 2024-05-08T20:17:21.568 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:21.568 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-08T20:17:21.568 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-08T20:17:21.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.c 2024-05-08T20:17:21.884 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:17:21 smithi132 systemd[1]: Stopping Ceph mds.c for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:21.884 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:17:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-c[83003]: 2024-05-08T20:17:21.829+0000 7f159b98a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:21.884 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:17:21 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-c[83003]: 2024-05-08T20:17:21.829+0000 7f159b98a700 -1 mds.c *** got signal Terminated *** 2024-05-08T20:17:24.884 INFO:journalctl@ceph.mds.c.smithi132.stdout:May 08 20:17:24 smithi132 bash[90303]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-c 2024-05-08T20:17:24.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.c.service' 2024-05-08T20:17:24.955 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:24.956 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-08T20:17:24.956 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-08T20:17:24.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.f 2024-05-08T20:17:25.228 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:17:25 smithi132 systemd[1]: Stopping Ceph mds.f for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:25.634 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:17:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-f[82663]: 2024-05-08T20:17:25.228+0000 7f6731f5e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:25.634 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:17:25 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-f[82663]: 2024-05-08T20:17:25.228+0000 7f6731f5e700 -1 mds.f *** got signal Terminated *** 2024-05-08T20:17:29.134 INFO:journalctl@ceph.mds.f.smithi132.stdout:May 08 20:17:28 smithi132 bash[90445]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-f 2024-05-08T20:17:29.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.f.service' 2024-05-08T20:17:29.268 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:29.268 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-08T20:17:29.268 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-08T20:17:29.268 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.i 2024-05-08T20:17:29.562 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:17:29 smithi132 systemd[1]: Stopping Ceph mds.i for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:29.884 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:17:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i[83347]: 2024-05-08T20:17:29.563+0000 7f32b1882700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:29.884 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:17:29 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i[83347]: 2024-05-08T20:17:29.563+0000 7f32b1882700 -1 mds.i *** got signal Terminated *** 2024-05-08T20:17:32.859 INFO:journalctl@ceph.mds.i.smithi132.stdout:May 08 20:17:32 smithi132 bash[90584]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-i 2024-05-08T20:17:32.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.i.service' 2024-05-08T20:17:32.899 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:32.899 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-08T20:17:32.899 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-08T20:17:32.899 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.l 2024-05-08T20:17:33.134 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:17:32 smithi132 systemd[1]: Stopping Ceph mds.l for 0ee61dd4-0d75-11ef-bc97-c7b262605968... 2024-05-08T20:17:33.634 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:17:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-l[82313]: 2024-05-08T20:17:33.176+0000 7f8ee3f6a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T20:17:33.634 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:17:33 smithi132 ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-l[82313]: 2024-05-08T20:17:33.176+0000 7f8ee3f6a700 -1 mds.l *** got signal Terminated *** 2024-05-08T20:17:36.373 INFO:journalctl@ceph.mds.l.smithi132.stdout:May 08 20:17:36 smithi132 bash[90723]: ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968-mds-l 2024-05-08T20:17:36.380 DEBUG:teuthology.orchestra.run.smithi132:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ee61dd4-0d75-11ef-bc97-c7b262605968@mds.l.service' 2024-05-08T20:17:36.414 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T20:17:36.414 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-08T20:17:36.415 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T20:17:36.614 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T20:17:38.203 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T20:17:38.393 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T20:17:39.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T20:17:39.974 INFO:teuthology.orchestra.run.smithi132.stdout:Deleting cluster with fsid: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T20:17:41.369 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T20:17:41.410 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T20:17:41.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T20:17:41.477 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-08T20:17:41.479 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi033/crash 2024-05-08T20:17:41.480 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash -- . 2024-05-08T20:17:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:tar: /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T20:17:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:tar: Error is not recoverable: exiting now 2024-05-08T20:17:41.517 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi082/crash 2024-05-08T20:17:41.518 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash -- . 2024-05-08T20:17:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T20:17:41.560 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-05-08T20:17:41.562 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi132/crash 2024-05-08T20:17:41.563 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash -- . 2024-05-08T20:17:41.600 INFO:teuthology.orchestra.run.smithi132.stderr:tar: /var/lib/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T20:17:41.601 INFO:teuthology.orchestra.run.smithi132.stderr:tar: Error is not recoverable: exiting now 2024-05-08T20:17:41.601 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-08T20:17:41.602 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-08T20:17:41.640 INFO:teuthology.orchestra.run.smithi033.stderr:grep: /var/log/ceph/0ee61dd4-0d75-11ef-bc97-c7b262605968/ceph.log: No such file or directory 2024-05-08T20:17:41.643 INFO:tasks.cephadm:Compressing logs... 2024-05-08T20:17:41.643 DEBUG:teuthology.orchestra.run.smithi033:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:17:41.686 DEBUG:teuthology.orchestra.run.smithi082:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:17:41.688 DEBUG:teuthology.orchestra.run.smithi132:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:17:41.715 INFO:teuthology.orchestra.run.smithi132.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T20:17:41.718 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T20:17:41.718 INFO:teuthology.orchestra.run.smithi033.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T20:18:35.391 INFO:tasks.cephadm:Archiving logs... 2024-05-08T20:18:35.392 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi033/log 2024-05-08T20:18:35.393 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T20:18:38.300 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi082/log 2024-05-08T20:18:38.301 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T20:18:45.176 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi132/log 2024-05-08T20:18:45.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T20:18:48.202 INFO:tasks.cephadm:Removing cluster... 2024-05-08T20:18:48.202 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 --force 2024-05-08T20:18:48.402 INFO:teuthology.orchestra.run.smithi033.stdout:Deleting cluster with fsid: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T20:18:48.690 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 --force 2024-05-08T20:18:48.878 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T20:18:49.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ee61dd4-0d75-11ef-bc97-c7b262605968 --force 2024-05-08T20:18:49.365 INFO:teuthology.orchestra.run.smithi132.stdout:Deleting cluster with fsid: 0ee61dd4-0d75-11ef-bc97-c7b262605968 2024-05-08T20:18:49.626 INFO:tasks.cephadm:Removing cephadm ... 2024-05-08T20:18:49.627 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T20:18:49.649 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T20:18:49.668 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T20:18:49.686 INFO:tasks.cephadm:Teardown complete 2024-05-08T20:18:49.686 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T20:18:49.698 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T20:18:49.698 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T20:18:49.700 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T20:18:49.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T20:18:49.823 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T20:18:49.835 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T20:18:49.835 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:18:49.838 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:18:49.840 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T20:18:49.855 INFO:teuthology.orchestra.run.smithi082.stderr:bash: ntpq: command not found 2024-05-08T20:18:49.856 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2024-05-08T20:18:49.856 INFO:teuthology.orchestra.run.smithi132.stderr:bash: ntpq: command not found 2024-05-08T20:18:49.858 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T20:18:49.858 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-08T20:18:49.859 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +656us[ +724us] +/- 45ms 2024-05-08T20:18:49.859 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 -1416us[-1416us] +/- 69ms 2024-05-08T20:18:49.859 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 24 +376us[ +444us] +/- 77ms 2024-05-08T20:18:49.859 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:18:49.861 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T20:18:49.861 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-05-08T20:18:49.861 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +726us[ +725us] +/- 45ms 2024-05-08T20:18:49.861 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -1378us[-1378us] +/- 69ms 2024-05-08T20:18:49.861 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +420us[ +420us] +/- 77ms 2024-05-08T20:18:49.861 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:18:49.862 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T20:18:49.862 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2024-05-08T20:18:49.862 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv01.front.sepia.ceph.com 3 6 377 24 +646us[ +655us] +/- 45ms 2024-05-08T20:18:49.862 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 21 -1406us[-1406us] +/- 69ms 2024-05-08T20:18:49.862 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 +388us[ +388us] +/- 78ms 2024-05-08T20:18:49.863 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T20:18:49.863 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T20:18:49.875 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T20:18:49.876 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T20:18:49.888 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T20:18:49.990 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T20:18:50.058 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T20:18:50.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:18:50.167 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:18:50.167 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:18:50.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:18:50.198 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-08T20:18:50.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:18:50.228 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T20:18:50.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T20:18:50.250 INFO:teuthology.task.internal:Duration was 2185.603286 seconds 2024-05-08T20:18:50.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T20:18:50.261 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T20:18:50.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T20:18:50.264 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T20:18:50.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T20:18:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:18:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:18:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T20:18:50.645 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T20:18:50.645 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2024-05-08T20:18:50.645 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T20:18:50.674 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T20:18:50.674 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T20:18:50.696 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-05-08T20:18:50.697 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T20:18:50.719 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T20:18:50.719 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:18:50.722 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:18:50.739 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T20:18:50.811 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T20:18:50.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T20:18:50.814 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T20:18:50.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T20:18:50.930 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T20:18:50.942 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T20:18:50.942 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T20:18:50.973 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T20:18:51.001 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T20:18:51.028 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T20:18:51.040 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:18:51.043 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:18:51.045 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:18:51.069 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-05-08T20:18:51.073 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2024-05-08T20:18:51.094 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-05-08T20:18:51.154 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:18:51.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:18:51.176 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:18:51.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:18:51.193 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T20:18:51.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T20:18:51.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T20:18:51.223 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T20:18:51.224 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi033 2024-05-08T20:18:51.224 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T20:18:51.276 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi082 2024-05-08T20:18:51.276 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T20:18:51.318 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-08_19:22:21-fs-wip-pdonnell-testing-20240508.150423-reef-distro-default-smithi/7697962/remote/smithi132 2024-05-08T20:18:51.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T20:18:51.358 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T20:18:51.358 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T20:18:51.361 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T20:18:51.363 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T20:18:51.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T20:18:51.421 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T20:18:51.421 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T20:18:51.433 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T20:18:51.433 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T20:18:51.435 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T20:18:51.437 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T20:18:51.451 INFO:teuthology.orchestra.run.smithi082.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 20:18 /home/ubuntu/cephtest 2024-05-08T20:18:51.454 INFO:teuthology.orchestra.run.smithi033.stdout: 262175 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 20:18 /home/ubuntu/cephtest 2024-05-08T20:18:51.465 INFO:teuthology.orchestra.run.smithi132.stdout: 262164 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 20:18 /home/ubuntu/cephtest 2024-05-08T20:18:51.467 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T20:18:51.479 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T20:18:51.508 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/yes 5-workunit/fs/norstats}} duration: 2185.603285551071 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-08T20:18:51.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T20:18:51.583 INFO:teuthology.run:pass